2022-04-28T14:30:39.969 INFO:root:teuthology version: 1.1.1.dev328+g004701de 2022-04-28T14:30:39.970 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/yuriw-2022-04-28_13:46:48-fs-pacific-distro-default-smithi/6810810 --name yuriw-2022-04-28_13:46:48-fs-pacific-distro-default-smithi --owner scheduled_yuriw@teuthology --description fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} -- /home/teuthworker/archive/yuriw-2022-04-28_13:46:48-fs-pacific-distro-default-smithi/6810810/orig.config.yaml 2022-04-28T14:30:40.032 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-04-28T14:30:40.108 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2022-04-28_13:46:48-fs-pacific-distro-default-smithi/6810810 branch: pacific description: fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} email: null first_in_suite: false job_id: '6810810' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'install ceph/nautilus latest ' name: yuriw-2022-04-28_13:46:48-fs-pacific-distro-default-smithi nuke-on-error: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: pacific ceph: cephfs: max_mds: 2 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: bluestore warn on legacy statfs: false bluestore warn on no per pool omap: false mon pg warn min per osd: 0 mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on osd down out interval zero: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - scrub mismatch - ScrubResult - wrongly marked - \(POOL_APP_NOT_ENABLED\) - \(SLOW_OPS\) - overall HEALTH_ - \(MON_MSGR2_NOT_ENABLED\) - slow request - missing required features log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 4fa079ba14503defa8dc257d7c2d506ebefcfe6d ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 4fa079ba14503defa8dc257d7c2d506ebefcfe6d nuke-on-error: false selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: pacific sha1: 4fa079ba14503defa8dc257d7c2d506ebefcfe6d owner: scheduled_yuriw@teuthology priority: 70 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - mds.b - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - client.0 - - client.1 sha1: 4fa079ba14503defa8dc257d7c2d506ebefcfe6d sleep_before_teardown: 0 suite: fs suite_branch: pacific suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_4fa079ba14503defa8dc257d7c2d506ebefcfe6d/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 4fa079ba14503defa8dc257d7c2d506ebefcfe6d targets: smithi022.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGBPD82XVQq8/r2zhDct+FtjpgqhM14uxFiwcvNi0rmWXwkm3QfeE/DsWJdxz6VWXgFvaokBZHSDAIALwL/QivcAcjM6nfyuorVp2FkRPdjwiEmYZo3n1sdABSG5fNjRI2LkofkUjDM9TU+mgsHdsnYHzmYzfUXBiKLuYFQweCsbMWxK8DFxg2c148v6VjKEE+a481k6R5+C/SHKo+72Vs/bGh+uto6DTbC8qCO3W94HNMnx/yZEkswD3Qzm/H1VTBF1WDrNNClbd0rp/OUNdn6Wv6cLq2Rq/j9hPAqAsw3F/odGfcp0Q5dsHiXowAWjs6aapMEzt6jlQQCbprSTRtaXR17X1yAVDFQEck4NUphSxnBYvV/ssPeIdg2xpHR6jpDRXTs5Nes/7JvPSkKdocXuYzuXhhuOY1JnZVhEeOdihkLrwINuRvT9UoBMH9Ndnpk1fQelSwJn21sKfbSlJdZlZ4ZVbEgkxQPs1/5mHCoDiUKhvrzeT5aVz2zbBiR4k= smithi037.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCuS0bGi1Izsn66HFWRztZ6OaoBlGhw6XfZI197mIm0/XTGC9u45wDjmqWVinJH4FD61+usAaZo7j+nd34RX5kb7hICf7Au1Dnj7PuqAKRHkmEEXnrpN7nJ/o9FI24pb1rq8SSv8MJRABTloY05S7HkX9tLeW/+HuD75KsYB+16NIMh49tNEfm3rlQ3FIa72WlkpZ0tcFMRXZQpCCcd6KEtbtYo8JicE8JDWpGzKii2F0J621ViRdfWKgjKcJTVpPRj5UShYqUyFeTXF667QPDtZFSDeKmiZAPL5/KmJJMWPx22QVKAzOMtV/2KXLpwK0Q+ruwXjHoy4gQBtXDjryWGDSOuFZcbwJuZCDb52Ah3wTCVyqvdQvWcvYAJRXvG8cgNkG5rm+25NHUJcycdRPpaRuJ2Iy0voZR/F/ODvtYtQYwbEH0wNbJYR0tfAH50iy1hGnkoXkipTdm5K4g0CBwDqeRwqOEa0qRn6T8m1Wcomzwc1zAq9AY9OqF8J/zsYJE= smithi039.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFtho9m4Y58t6Inrqav8xgmCf/OCSC4nMJWaY4WHDPQDUYmjdWNHv9nHkexXzYZO05i8X+woy9RZ8Z6Gh/CIIS7bymq7akLZx8Of7s06WqH53SfmIj+itmxulbyJi44C/Mffgg6GUKPUss0VeMoECM/HAZWr9u6JPMD0kwSxS7DZd4IVaaC0MoZbdAxefW8fun6+xZaD/bMyrrab8uuAwjV8Zr1SZElNipyZfBBvV9Db0yMRFw920Uvy/Y/2ZuKd+PxxNfekiuD088Ut45o0tENyynL7Qlon0cA73VNklJTtXfxBQm9X5UfIjrtBpfk9wQMNDkxVydVMDKtQRq6bJtMX44II6ioL4LRQ7Q2ob9B0T4gxkBvf19UxXtp04So5bPMKVIcD6A/VhiuNt/oPHcRTyUbHeY99uVy0QU5BTtSCjDJcwflhXcJ+PzAVODCMo/EMVL/+PP1FKU+tEJKKkU7/jobBqWY+vLDu8khwQs/5nYaSkHTF/srP8jfYJR2+E= tasks: - install: branch: nautilus exclude_packages: - librados3 - ceph-mgr-dashboard - ceph-mgr-diskprediction-local - ceph-mgr-rook - ceph-mgr-cephadm - cephadm - ceph-immutable-object-cache - python3-rados - python3-rgw - python3-rbd - python3-cephfs extra_packages: - librados2 - print: '**** done installing nautilus' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-ignorelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon - exec: osd.0: - ceph osd set-require-min-compat-client nautilus - print: '**** done ceph' - ceph-fuse: null - print: '**** done nautilus client' - print: '**** done fsstress' - mds_pre_upgrade: null - print: '**** done mds pre-upgrade sequence' - install.upgrade: mon.a: null mon.b: null - print: '**** done install.upgrade both hosts' - ceph.restart: daemons: - mon.* - mgr.* mon-health-to-clog: false wait-for-healthy: false - ceph.healthy: null - ceph.restart: daemons: - osd.* wait-for-healthy: false wait-for-osds-up: true - ceph.stop: - mds.* - ceph.restart: daemons: - mds.* wait-for-healthy: false wait-for-osds-up: true - exec: mon.a: - ceph versions - ceph osd dump -f json-pretty - ceph osd require-osd-release pacific - for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done - ceph.healthy: null - print: '**** done ceph.restart' - install.upgrade: client.0: null - print: '**** done install.upgrade on client.0' - ceph-fuse: client.0: mounted: false client.1: skip: true - ceph-fuse: client.0: null client.1: skip: true - print: '**** done remount client' - exec: mon.a: - ceph fs dump --format=json-pretty - ceph fs required_client_features cephfs add metric_collect - sleep: duration: 5 - fs.clients_evicted: clients: client.0: false client.1: true - workunit: clients: client.0: - suites/fsstress.sh - print: '**** done fsstress' teuthology_branch: master teuthology_sha1: 004701def07b67dd914d7b1775457fec6788a495 timestamp: 2022-04-28_13:46:48 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.5191 2022-04-28T14:30:40.109 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_4fa079ba14503defa8dc257d7c2d506ebefcfe6d/qa; will attempt to use it 2022-04-28T14:30:40.110 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_4fa079ba14503defa8dc257d7c2d506ebefcfe6d/qa/tasks 2022-04-28T14:30:40.110 INFO:teuthology.run_tasks:Running task internal.check_packages... 2022-04-28T14:30:40.115 INFO:teuthology.task.internal:Checking packages... 2022-04-28T14:30:40.135 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '4fa079ba14503defa8dc257d7c2d506ebefcfe6d' 2022-04-28T14:30:40.136 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-04-28T14:30:40.136 INFO:teuthology.packaging:ref: None 2022-04-28T14:30:40.136 INFO:teuthology.packaging:tag: None 2022-04-28T14:30:40.136 INFO:teuthology.packaging:branch: pacific 2022-04-28T14:30:40.136 INFO:teuthology.packaging:sha1: 4fa079ba14503defa8dc257d7c2d506ebefcfe6d 2022-04-28T14:30:40.136 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2022-04-28T14:30:40.401 INFO:teuthology.task.internal:Found packages for ceph version 16.2.7-969.g4fa079ba 2022-04-28T14:30:40.402 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2022-04-28T14:30:40.413 INFO:teuthology.task.internal:no buildpackages task found 2022-04-28T14:30:40.413 INFO:teuthology.run_tasks:Running task internal.save_config... 2022-04-28T14:30:40.521 INFO:teuthology.task.internal:Saving configuration 2022-04-28T14:30:40.544 INFO:teuthology.run_tasks:Running task internal.check_lock... 2022-04-28T14:30:40.577 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-28T14:30:40.599 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2022-04-28_13:46:48-fs-pacific-distro-default-smithi/6810810', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-04-28 14:24:56.841126', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEymOkrQrJUv9MRSTdnA1r1ZL8g4BL88zd1+ExS5MuMJp42zt46jbPz0ReE++gsyIqFfZ3oTnwsGWwXkiDy7kd0='} 2022-04-28T14:30:40.620 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2022-04-28_13:46:48-fs-pacific-distro-default-smithi/6810810', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-04-28 14:24:56.840095', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLsGVtbz0zHdOdiZKNUCS94+l0VTB9Azt3C+owKHsZIPHNp4jh91YoQix/AkGK47j4Dz5pCyJfBSpObtXxThQVU='} 2022-04-28T14:30:40.643 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi039.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2022-04-28_13:46:48-fs-pacific-distro-default-smithi/6810810', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-04-28 14:24:56.838785', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIQk7eKTbPEt+qAQmBlUcx0elpYlRZf/zkRQXVoAmL0AVcRU8hDSSln+5OFc5i+qX9m2K8qw0sGB6zdbL1rgaM4='} 2022-04-28T14:30:40.643 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2022-04-28T14:30:40.652 INFO:teuthology.task.internal:roles: ubuntu@smithi022.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2022-04-28T14:30:40.652 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['client.0'] 2022-04-28T14:30:40.652 INFO:teuthology.task.internal:roles: ubuntu@smithi039.front.sepia.ceph.com - ['client.1'] 2022-04-28T14:30:40.653 INFO:teuthology.run_tasks:Running task console_log... 2022-04-28T14:30:40.816 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9b4b471488>, signals=[15]) 2022-04-28T14:30:40.817 INFO:teuthology.run_tasks:Running task internal.connect... 2022-04-28T14:30:40.827 INFO:teuthology.task.internal:Opening connections... 2022-04-28T14:30:40.828 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi022.front.sepia.ceph.com 2022-04-28T14:30:40.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-04-28T14:30:40.913 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2022-04-28T14:30:40.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-04-28T14:30:40.994 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi039.front.sepia.ceph.com 2022-04-28T14:30:40.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-04-28T14:30:41.075 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2022-04-28T14:30:41.086 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2022-04-28T14:30:41.108 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2022-04-28T14:30:41.108 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2022-04-28T14:30:41.168 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream" 2022-04-28T14:30:41.169 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8" 2022-04-28T14:30:41.169 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2022-04-28T14:30:41.169 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2022-04-28T14:30:41.169 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8" 2022-04-28T14:30:41.169 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8" 2022-04-28T14:30:41.169 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 8" 2022-04-28T14:30:41.169 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2022-04-28T14:30:41.169 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-04-28T14:30:41.170 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/" 2022-04-28T14:30:41.170 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-04-28T14:30:41.170 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-04-28T14:30:41.170 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-04-28T14:30:41.171 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2022-04-28T14:30:41.190 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2022-04-28T14:30:41.211 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2022-04-28T14:30:41.211 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2022-04-28T14:30:41.271 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2022-04-28T14:30:41.271 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8" 2022-04-28T14:30:41.272 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2022-04-28T14:30:41.272 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2022-04-28T14:30:41.272 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8" 2022-04-28T14:30:41.272 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8" 2022-04-28T14:30:41.272 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 8" 2022-04-28T14:30:41.272 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2022-04-28T14:30:41.272 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-04-28T14:30:41.272 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2022-04-28T14:30:41.272 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-04-28T14:30:41.273 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-04-28T14:30:41.273 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-04-28T14:30:41.273 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2022-04-28T14:30:41.290 DEBUG:teuthology.orchestra.run.smithi039:> uname -m 2022-04-28T14:30:41.311 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2022-04-28T14:30:41.312 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2022-04-28T14:30:41.372 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream" 2022-04-28T14:30:41.372 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="8" 2022-04-28T14:30:41.372 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos" 2022-04-28T14:30:41.373 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora" 2022-04-28T14:30:41.373 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="8" 2022-04-28T14:30:41.373 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el8" 2022-04-28T14:30:41.373 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 8" 2022-04-28T14:30:41.373 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2022-04-28T14:30:41.373 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-04-28T14:30:41.373 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/" 2022-04-28T14:30:41.373 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-04-28T14:30:41.374 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-04-28T14:30:41.374 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-04-28T14:30:41.374 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2022-04-28T14:30:41.392 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2022-04-28T14:30:41.415 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2022-04-28T14:30:41.512 INFO:teuthology.task.internal:Checking for old test directory... 2022-04-28T14:30:41.512 DEBUG:teuthology.orchestra.run.smithi022:> test '!' -e /home/ubuntu/cephtest 2022-04-28T14:30:41.514 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2022-04-28T14:30:41.516 DEBUG:teuthology.orchestra.run.smithi039:> test '!' -e /home/ubuntu/cephtest 2022-04-28T14:30:41.535 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2022-04-28T14:30:41.632 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2022-04-28T14:30:41.632 DEBUG:teuthology.orchestra.run.smithi022:> test -z $(ls -A /var/lib/ceph) 2022-04-28T14:30:41.634 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2022-04-28T14:30:41.637 DEBUG:teuthology.orchestra.run.smithi039:> test -z $(ls -A /var/lib/ceph) 2022-04-28T14:30:41.743 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2022-04-28T14:30:41.820 INFO:teuthology.run_tasks:Running task kernel... 2022-04-28T14:30:41.843 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2022-04-28T14:30:41.843 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2022-04-28T14:30:41.843 DEBUG:teuthology.orchestra.run.smithi022:> test -f /run/.containerenv -o -f /.dockerenv 2022-04-28T14:30:41.844 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2022-04-28T14:30:41.844 DEBUG:teuthology.orchestra.run.smithi039:> test -f /run/.containerenv -o -f /.dockerenv 2022-04-28T14:30:41.863 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-04-28T14:30:41.864 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2022-04-28T14:30:41.865 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-04-28T14:30:41.865 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-04-28T14:30:41.866 DEBUG:teuthology.orchestra.run.smithi039:> uname -r 2022-04-28T14:30:41.867 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2022-04-28T14:30:41.924 INFO:teuthology.orchestra.run.smithi039.stdout:4.18.0-383.el8.x86_64 2022-04-28T14:30:41.924 INFO:teuthology.task.kernel:Running kernel on smithi039: 4.18.0-383.el8.x86_64 2022-04-28T14:30:41.925 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum install -y kernel 2022-04-28T14:30:41.926 INFO:teuthology.orchestra.run.smithi022.stdout:4.18.0-383.el8.x86_64 2022-04-28T14:30:41.926 INFO:teuthology.task.kernel:Running kernel on smithi022: 4.18.0-383.el8.x86_64 2022-04-28T14:30:41.926 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum install -y kernel 2022-04-28T14:30:41.927 INFO:teuthology.orchestra.run.smithi037.stdout:4.18.0-383.el8.x86_64 2022-04-28T14:30:41.927 INFO:teuthology.task.kernel:Running kernel on smithi037: 4.18.0-383.el8.x86_64 2022-04-28T14:30:41.928 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum install -y kernel 2022-04-28T14:30:44.986 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS-8 - AppStream 26 MB/s | 21 MB 00:00 2022-04-28T14:30:45.128 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-8 - AppStream 21 MB/s | 21 MB 00:01 2022-04-28T14:30:45.262 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-8 - AppStream 19 MB/s | 21 MB 00:01 2022-04-28T14:30:49.803 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS-8 - Base 26 MB/s | 22 MB 00:00 2022-04-28T14:30:49.888 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-8 - Base 28 MB/s | 22 MB 00:00 2022-04-28T14:30:50.412 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-8 - Base 19 MB/s | 22 MB 00:01 2022-04-28T14:30:53.244 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS-8 - Extras 152 kB/s | 18 kB 00:00 2022-04-28T14:30:53.328 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-8 - Extras 154 kB/s | 18 kB 00:00 2022-04-28T14:30:53.663 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS-8 - PowerTools 16 MB/s | 4.5 MB 00:00 2022-04-28T14:30:53.813 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-8 - PowerTools 13 MB/s | 4.5 MB 00:00 2022-04-28T14:30:53.886 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-8 - Extras 120 kB/s | 18 kB 00:00 2022-04-28T14:30:54.289 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-8 - PowerTools 17 MB/s | 4.5 MB 00:00 2022-04-28T14:30:54.746 INFO:teuthology.orchestra.run.smithi039.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2022-04-28T14:30:54.854 INFO:teuthology.orchestra.run.smithi022.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2022-04-28T14:30:55.330 INFO:teuthology.orchestra.run.smithi037.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2022-04-28T14:30:58.405 INFO:teuthology.orchestra.run.smithi039.stdout:Extra Packages for Enterprise Linux 3.1 MB/s | 11 MB 00:03 2022-04-28T14:30:59.638 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 2.6 MB/s | 11 MB 00:04 2022-04-28T14:31:00.078 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 2.2 MB/s | 11 MB 00:05 2022-04-28T14:31:01.171 INFO:teuthology.orchestra.run.smithi039.stdout:lab-extras 412 kB/s | 24 kB 00:00 2022-04-28T14:31:02.446 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 383 kB/s | 24 kB 00:00 2022-04-28T14:31:02.987 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 133 kB/s | 24 kB 00:00 2022-04-28T14:31:03.927 INFO:teuthology.orchestra.run.smithi039.stdout:Package kernel-4.18.0-305.3.1.el8.x86_64 is already installed. 2022-04-28T14:31:03.927 INFO:teuthology.orchestra.run.smithi039.stdout:Package kernel-4.18.0-383.el8.x86_64 is already installed. 2022-04-28T14:31:04.033 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2022-04-28T14:31:04.035 INFO:teuthology.orchestra.run.smithi039.stdout:Nothing to do. 2022-04-28T14:31:04.035 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2022-04-28T14:31:04.158 DEBUG:teuthology.orchestra.run.smithi039:> echo no | sudo yum reinstall kernel || true 2022-04-28T14:31:04.749 INFO:teuthology.orchestra.run.smithi039.stdout:Last metadata expiration check: 0:00:03 ago on Thu 28 Apr 2022 02:31:01 PM UTC. 2022-04-28T14:31:05.410 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-4.18.0-305.3.1.el8.x86_64 is already installed. 2022-04-28T14:31:05.410 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-4.18.0-383.el8.x86_64 is already installed. 2022-04-28T14:31:05.520 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-04-28T14:31:05.522 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2022-04-28T14:31:05.522 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-04-28T14:31:05.655 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2022-04-28T14:31:05.656 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:31:05.656 INFO:teuthology.orchestra.run.smithi039.stdout: Package Architecture Version Repository Size 2022-04-28T14:31:05.656 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:31:05.657 INFO:teuthology.orchestra.run.smithi039.stdout:Reinstalling: 2022-04-28T14:31:05.657 INFO:teuthology.orchestra.run.smithi039.stdout: kernel x86_64 4.18.0-383.el8 CentOS-Base 8.1 M 2022-04-28T14:31:05.657 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:31:05.657 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2022-04-28T14:31:05.657 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:31:05.657 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:31:05.658 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 8.1 M 2022-04-28T14:31:05.658 INFO:teuthology.orchestra.run.smithi039.stdout:Installed size: 0 2022-04-28T14:31:05.658 INFO:teuthology.orchestra.run.smithi039.stderr:Operation aborted. 2022-04-28T14:31:05.666 DEBUG:teuthology.orchestra.run.smithi037:> echo no | sudo yum reinstall kernel || true 2022-04-28T14:31:05.676 INFO:teuthology.orchestra.run.smithi022.stdout:Package kernel-4.18.0-305.3.1.el8.x86_64 is already installed. 2022-04-28T14:31:05.676 INFO:teuthology.orchestra.run.smithi022.stdout:Package kernel-4.18.0-383.el8.x86_64 is already installed. 2022-04-28T14:31:05.729 INFO:teuthology.orchestra.run.smithi039.stdout:Is this ok [y/N]: 2022-04-28T14:31:05.729 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum reinstall -y kernel || true 2022-04-28T14:31:05.781 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2022-04-28T14:31:05.782 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2022-04-28T14:31:05.782 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2022-04-28T14:31:05.906 DEBUG:teuthology.orchestra.run.smithi022:> echo no | sudo yum reinstall kernel || true 2022-04-28T14:31:06.299 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:04 ago on Thu 28 Apr 2022 02:31:02 PM UTC. 2022-04-28T14:31:06.310 INFO:teuthology.orchestra.run.smithi039.stdout:Last metadata expiration check: 0:00:05 ago on Thu 28 Apr 2022 02:31:01 PM UTC. 2022-04-28T14:31:06.494 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:00:04 ago on Thu 28 Apr 2022 02:31:02 PM UTC. 2022-04-28T14:31:07.193 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2022-04-28T14:31:07.194 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:31:07.194 INFO:teuthology.orchestra.run.smithi039.stdout: Package Architecture Version Repository Size 2022-04-28T14:31:07.194 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:31:07.194 INFO:teuthology.orchestra.run.smithi039.stdout:Reinstalling: 2022-04-28T14:31:07.194 INFO:teuthology.orchestra.run.smithi039.stdout: kernel x86_64 4.18.0-383.el8 CentOS-Base 8.1 M 2022-04-28T14:31:07.195 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:31:07.195 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2022-04-28T14:31:07.195 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:31:07.195 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:31:07.195 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 8.1 M 2022-04-28T14:31:07.195 INFO:teuthology.orchestra.run.smithi039.stdout:Installed size: 0 2022-04-28T14:31:07.195 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2022-04-28T14:31:07.204 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-04-28T14:31:07.205 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:31:07.205 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2022-04-28T14:31:07.205 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:31:07.205 INFO:teuthology.orchestra.run.smithi037.stdout:Reinstalling: 2022-04-28T14:31:07.205 INFO:teuthology.orchestra.run.smithi037.stdout: kernel x86_64 4.18.0-383.el8 CentOS-Base 8.1 M 2022-04-28T14:31:07.205 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:31:07.205 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-04-28T14:31:07.205 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:31:07.206 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:31:07.206 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 8.1 M 2022-04-28T14:31:07.206 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 0 2022-04-28T14:31:07.207 INFO:teuthology.orchestra.run.smithi037.stderr:Operation aborted. 2022-04-28T14:31:07.271 INFO:teuthology.orchestra.run.smithi037.stdout:Is this ok [y/N]: 2022-04-28T14:31:07.271 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum reinstall -y kernel || true 2022-04-28T14:31:07.381 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2022-04-28T14:31:07.382 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:31:07.382 INFO:teuthology.orchestra.run.smithi022.stdout: Package Architecture Version Repository Size 2022-04-28T14:31:07.382 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:31:07.382 INFO:teuthology.orchestra.run.smithi022.stdout:Reinstalling: 2022-04-28T14:31:07.382 INFO:teuthology.orchestra.run.smithi022.stdout: kernel x86_64 4.18.0-383.el8 CentOS-Base 8.1 M 2022-04-28T14:31:07.382 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:31:07.383 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2022-04-28T14:31:07.383 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:31:07.383 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:31:07.384 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 8.1 M 2022-04-28T14:31:07.384 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 0 2022-04-28T14:31:07.384 INFO:teuthology.orchestra.run.smithi022.stderr:Operation aborted. 2022-04-28T14:31:07.452 INFO:teuthology.orchestra.run.smithi022.stdout:Is this ok [y/N]: 2022-04-28T14:31:07.452 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum reinstall -y kernel || true 2022-04-28T14:31:07.465 INFO:teuthology.orchestra.run.smithi039.stdout:kernel-4.18.0-383.el8.x86_64.rpm 30 MB/s | 8.1 MB 00:00 2022-04-28T14:31:07.466 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:31:07.466 INFO:teuthology.orchestra.run.smithi039.stdout:Total 30 MB/s | 8.1 MB 00:00 2022-04-28T14:31:07.566 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2022-04-28T14:31:07.853 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:05 ago on Thu 28 Apr 2022 02:31:02 PM UTC. 2022-04-28T14:31:07.959 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2022-04-28T14:31:07.959 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2022-04-28T14:31:08.036 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:00:06 ago on Thu 28 Apr 2022 02:31:02 PM UTC. 2022-04-28T14:31:08.144 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2022-04-28T14:31:08.150 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2022-04-28T14:31:08.456 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2022-04-28T14:31:08.729 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-04-28T14:31:08.730 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:31:08.730 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2022-04-28T14:31:08.730 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:31:08.731 INFO:teuthology.orchestra.run.smithi037.stdout:Reinstalling: 2022-04-28T14:31:08.731 INFO:teuthology.orchestra.run.smithi037.stdout: kernel x86_64 4.18.0-383.el8 CentOS-Base 8.1 M 2022-04-28T14:31:08.731 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:31:08.731 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-04-28T14:31:08.731 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:31:08.731 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:31:08.731 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 8.1 M 2022-04-28T14:31:08.731 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 0 2022-04-28T14:31:08.731 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2022-04-28T14:31:08.779 INFO:teuthology.orchestra.run.smithi039.stdout: Reinstalling : kernel-4.18.0-383.el8.x86_64 1/2 2022-04-28T14:31:08.789 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : kernel-4.18.0-383.el8.x86_64 2/2 2022-04-28T14:31:08.977 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2022-04-28T14:31:08.978 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:31:08.978 INFO:teuthology.orchestra.run.smithi022.stdout: Package Architecture Version Repository Size 2022-04-28T14:31:08.978 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:31:08.978 INFO:teuthology.orchestra.run.smithi022.stdout:Reinstalling: 2022-04-28T14:31:08.979 INFO:teuthology.orchestra.run.smithi022.stdout: kernel x86_64 4.18.0-383.el8 CentOS-Base 8.1 M 2022-04-28T14:31:08.979 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:31:08.979 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2022-04-28T14:31:08.979 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:31:08.979 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:31:08.980 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 8.1 M 2022-04-28T14:31:08.980 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 0 2022-04-28T14:31:08.980 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2022-04-28T14:31:08.981 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-4.18.0-383.el8.x86_64.rpm 32 MB/s | 8.1 MB 00:00 2022-04-28T14:31:08.982 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:31:08.982 INFO:teuthology.orchestra.run.smithi037.stdout:Total 32 MB/s | 8.1 MB 00:00 2022-04-28T14:31:09.079 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2022-04-28T14:31:09.184 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-4.18.0-383.el8.x86_64 2/2 2022-04-28T14:31:09.185 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-4.18.0-383.el8.x86_64 1/2 2022-04-28T14:31:09.213 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-4.18.0-383.el8.x86_64.rpm 35 MB/s | 8.1 MB 00:00 2022-04-28T14:31:09.214 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:31:09.214 INFO:teuthology.orchestra.run.smithi022.stdout:Total 34 MB/s | 8.1 MB 00:00 2022-04-28T14:31:09.305 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2022-04-28T14:31:09.473 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2022-04-28T14:31:09.473 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2022-04-28T14:31:09.648 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-4.18.0-383.el8.x86_64 2/2 2022-04-28T14:31:09.648 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:31:09.648 INFO:teuthology.orchestra.run.smithi039.stdout:Reinstalled: 2022-04-28T14:31:09.648 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-4.18.0-383.el8.x86_64 2022-04-28T14:31:09.648 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:31:09.649 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2022-04-28T14:31:09.650 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2022-04-28T14:31:09.657 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2022-04-28T14:31:09.684 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2022-04-28T14:31:09.684 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2022-04-28T14:31:09.733 DEBUG:teuthology.orchestra.run.smithi039:> rpm -q kernel --last | head -n 1 2022-04-28T14:31:09.857 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2022-04-28T14:31:09.860 INFO:teuthology.orchestra.run.smithi039.stdout:kernel-4.18.0-383.el8.x86_64 Thu 28 Apr 2022 02:31:08 PM UTC 2022-04-28T14:31:09.862 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-383.el8.x86_64 2022-04-28T14:31:09.863 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2022-04-28T14:31:09.863 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2022-04-28T14:31:09.863 DEBUG:teuthology.orchestra.run.smithi039:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2022-04-28T14:31:09.864 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2022-04-28T14:31:09.901 INFO:teuthology.orchestra.run.smithi039.stdout:ttyS1 2022-04-28T14:31:09.919 DEBUG:teuthology.parallel:result is None 2022-04-28T14:31:09.971 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2022-04-28T14:31:10.133 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2022-04-28T14:31:10.211 INFO:teuthology.orchestra.run.smithi037.stdout: Reinstalling : kernel-4.18.0-383.el8.x86_64 1/2 2022-04-28T14:31:10.211 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : kernel-4.18.0-383.el8.x86_64 2/2 2022-04-28T14:31:10.323 INFO:teuthology.orchestra.run.smithi022.stdout: Reinstalling : kernel-4.18.0-383.el8.x86_64 1/2 2022-04-28T14:31:10.323 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : kernel-4.18.0-383.el8.x86_64 2/2 2022-04-28T14:31:10.614 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-4.18.0-383.el8.x86_64 2/2 2022-04-28T14:31:10.614 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-4.18.0-383.el8.x86_64 1/2 2022-04-28T14:31:10.744 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-4.18.0-383.el8.x86_64 2/2 2022-04-28T14:31:10.745 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : kernel-4.18.0-383.el8.x86_64 1/2 2022-04-28T14:31:11.045 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-4.18.0-383.el8.x86_64 2/2 2022-04-28T14:31:11.045 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:31:11.045 INFO:teuthology.orchestra.run.smithi037.stdout:Reinstalled: 2022-04-28T14:31:11.045 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-4.18.0-383.el8.x86_64 2022-04-28T14:31:11.045 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:31:11.046 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-04-28T14:31:11.153 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel --last | head -n 1 2022-04-28T14:31:11.210 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : kernel-4.18.0-383.el8.x86_64 2/2 2022-04-28T14:31:11.211 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:31:11.211 INFO:teuthology.orchestra.run.smithi022.stdout:Reinstalled: 2022-04-28T14:31:11.211 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-4.18.0-383.el8.x86_64 2022-04-28T14:31:11.211 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:31:11.211 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2022-04-28T14:31:11.279 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-4.18.0-383.el8.x86_64 Thu 28 Apr 2022 02:31:09 PM UTC 2022-04-28T14:31:11.281 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-383.el8.x86_64 2022-04-28T14:31:11.281 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2022-04-28T14:31:11.281 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2022-04-28T14:31:11.282 DEBUG:teuthology.orchestra.run.smithi037:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2022-04-28T14:31:11.303 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q kernel --last | head -n 1 2022-04-28T14:31:11.421 INFO:teuthology.orchestra.run.smithi037.stdout:ttyS1 2022-04-28T14:31:11.430 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-4.18.0-383.el8.x86_64 Thu 28 Apr 2022 02:31:10 PM UTC 2022-04-28T14:31:11.431 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-383.el8.x86_64 2022-04-28T14:31:11.431 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2022-04-28T14:31:11.432 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2022-04-28T14:31:11.432 DEBUG:teuthology.orchestra.run.smithi022:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2022-04-28T14:31:11.433 DEBUG:teuthology.parallel:result is None 2022-04-28T14:31:11.464 INFO:teuthology.orchestra.run.smithi022.stdout:ttyS1 2022-04-28T14:31:11.475 DEBUG:teuthology.parallel:result is None 2022-04-28T14:31:11.476 INFO:teuthology.run_tasks:Running task internal.base... 2022-04-28T14:31:11.483 INFO:teuthology.task.internal:Creating test directory... 2022-04-28T14:31:11.484 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-04-28T14:31:11.518 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-04-28T14:31:11.520 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-04-28T14:31:11.541 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2022-04-28T14:31:11.549 INFO:teuthology.run_tasks:Running task internal.archive... 2022-04-28T14:31:11.614 INFO:teuthology.task.internal:Creating archive directory... 2022-04-28T14:31:11.615 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-04-28T14:31:11.617 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-04-28T14:31:11.619 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-04-28T14:31:11.653 INFO:teuthology.run_tasks:Running task internal.coredump... 2022-04-28T14:31:11.711 INFO:teuthology.task.internal:Enabling coredump saving... 2022-04-28T14:31:11.712 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-04-28T14:31:11.715 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-04-28T14:31:11.717 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-04-28T14:31:11.752 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-04-28T14:31:11.755 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-04-28T14:31:11.763 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-04-28T14:31:11.767 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-04-28T14:31:11.768 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-04-28T14:31:11.778 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-04-28T14:31:11.780 INFO:teuthology.run_tasks:Running task internal.sudo... 2022-04-28T14:31:11.835 INFO:teuthology.task.internal:Configuring sudo... 2022-04-28T14:31:11.835 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-04-28T14:31:11.838 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-04-28T14:31:11.840 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-04-28T14:31:11.871 INFO:teuthology.run_tasks:Running task internal.syslog... 2022-04-28T14:31:11.908 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2022-04-28T14:31:11.908 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-04-28T14:31:11.910 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-04-28T14:31:11.912 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-04-28T14:31:11.931 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-04-28T14:31:12.007 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-04-28T14:31:12.055 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-04-28T14:31:12.137 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-04-28T14:31:12.182 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2022-04-28T14:31:12.182 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-04-28T14:31:12.248 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-04-28T14:31:12.291 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-04-28T14:31:12.355 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-04-28T14:31:12.400 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-04-28T14:31:12.443 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2022-04-28T14:31:12.443 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-04-28T14:31:12.510 DEBUG:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-04-28T14:31:12.557 DEBUG:teuthology.orchestra.run.smithi039:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-04-28T14:31:12.617 DEBUG:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-04-28T14:31:12.706 DEBUG:teuthology.orchestra.run.smithi039:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-04-28T14:31:12.750 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2022-04-28T14:31:12.750 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-04-28T14:31:12.819 DEBUG:teuthology.orchestra.run.smithi022:> sudo service rsyslog restart 2022-04-28T14:31:12.822 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2022-04-28T14:31:12.824 DEBUG:teuthology.orchestra.run.smithi039:> sudo service rsyslog restart 2022-04-28T14:31:12.882 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-04-28T14:31:12.885 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-04-28T14:31:12.915 INFO:teuthology.orchestra.run.smithi039.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-04-28T14:31:13.341 INFO:teuthology.run_tasks:Running task internal.timer... 2022-04-28T14:31:13.351 INFO:teuthology.task.internal:Starting timer... 2022-04-28T14:31:13.352 INFO:teuthology.run_tasks:Running task pcp... 2022-04-28T14:31:13.448 INFO:teuthology.run_tasks:Running task selinux... 2022-04-28T14:31:13.543 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2022-04-28T14:31:13.544 DEBUG:teuthology.orchestra.run.smithi022:> sudo service auditd rotate 2022-04-28T14:31:13.617 INFO:teuthology.orchestra.run.smithi022.stdout:Rotating logs: 2022-04-28T14:31:13.619 DEBUG:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2022-04-28T14:31:13.695 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: 2022-04-28T14:31:13.697 DEBUG:teuthology.orchestra.run.smithi039:> sudo service auditd rotate 2022-04-28T14:31:13.760 INFO:teuthology.orchestra.run.smithi039.stdout:Rotating logs: 2022-04-28T14:31:13.762 DEBUG:teuthology.task.selinux:Getting current SELinux state 2022-04-28T14:31:13.762 DEBUG:teuthology.orchestra.run.smithi022:> /usr/sbin/getenforce 2022-04-28T14:31:13.792 INFO:teuthology.orchestra.run.smithi022.stdout:Permissive 2022-04-28T14:31:13.792 DEBUG:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2022-04-28T14:31:13.815 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2022-04-28T14:31:13.815 DEBUG:teuthology.orchestra.run.smithi039:> /usr/sbin/getenforce 2022-04-28T14:31:13.842 INFO:teuthology.orchestra.run.smithi039.stdout:Permissive 2022-04-28T14:31:13.842 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi022.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi037.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi039.front.sepia.ceph.com': 'permissive'} 2022-04-28T14:31:13.843 DEBUG:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2022-04-28T14:31:13.872 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-04-28T14:31:13.873 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2022-04-28T14:31:13.901 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-04-28T14:31:13.901 DEBUG:teuthology.orchestra.run.smithi039:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2022-04-28T14:31:13.930 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-04-28T14:31:13.930 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2022-04-28T14:31:13.931 DEBUG:teuthology.orchestra.run.smithi022:> sudo /usr/sbin/setenforce permissive 2022-04-28T14:31:13.962 DEBUG:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2022-04-28T14:31:13.991 DEBUG:teuthology.orchestra.run.smithi039:> sudo /usr/sbin/setenforce permissive 2022-04-28T14:31:14.018 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2022-04-28T14:31:14.029 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2022-04-28T14:31:14.035 INFO:teuthology.repo_utils:Fetching master from origin 2022-04-28T14:31:14.066 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2022-04-28T14:31:14.081 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2022-04-28T14:31:14.083 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi022.front.sepia.ceph.com,smithi037.front.sepia.ceph.com,smithi039.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2022-04-28T14:36:44.731 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi022.front.sepia.ceph.com'), Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi039.front.sepia.ceph.com')] 2022-04-28T14:36:44.733 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2022-04-28T14:36:44.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-04-28T14:36:44.820 DEBUG:teuthology.orchestra.run.smithi022:> true 2022-04-28T14:36:44.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2022-04-28T14:36:44.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-04-28T14:36:44.970 DEBUG:teuthology.orchestra.run.smithi037:> true 2022-04-28T14:36:45.047 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2022-04-28T14:36:45.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-04-28T14:36:45.129 DEBUG:teuthology.orchestra.run.smithi039:> true 2022-04-28T14:36:45.202 INFO:teuthology.run_tasks:Running task clock... 2022-04-28T14:36:45.219 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2022-04-28T14:36:45.220 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-04-28T14:36:45.222 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-04-28T14:36:45.224 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-04-28T14:36:45.225 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-04-28T14:36:45.227 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-04-28T14:36:45.227 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-04-28T14:36:45.259 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-04-28T14:36:45.263 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-04-28T14:36:45.275 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-04-28T14:36:45.276 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-04-28T14:36:45.279 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-04-28T14:36:45.293 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-04-28T14:36:45.340 INFO:teuthology.orchestra.run.smithi022.stderr:sudo: ntpd: command not found 2022-04-28T14:36:45.346 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: ntpd: command not found 2022-04-28T14:36:45.354 INFO:teuthology.orchestra.run.smithi022.stdout:506 Cannot talk to daemon 2022-04-28T14:36:45.359 INFO:teuthology.orchestra.run.smithi037.stdout:506 Cannot talk to daemon 2022-04-28T14:36:45.367 INFO:teuthology.orchestra.run.smithi039.stderr:sudo: ntpd: command not found 2022-04-28T14:36:45.370 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-04-28T14:36:45.374 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-04-28T14:36:45.379 INFO:teuthology.orchestra.run.smithi039.stdout:506 Cannot talk to daemon 2022-04-28T14:36:45.385 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-04-28T14:36:45.389 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-04-28T14:36:45.395 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-04-28T14:36:45.410 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-04-28T14:36:45.448 INFO:teuthology.orchestra.run.smithi022.stderr:bash: ntpq: command not found 2022-04-28T14:36:45.451 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-04-28T14:36:45.452 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2022-04-28T14:36:45.452 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-04-28T14:36:45.452 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-04-28T14:36:45.452 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-04-28T14:36:45.452 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-04-28T14:36:45.466 INFO:teuthology.orchestra.run.smithi037.stderr:bash: ntpq: command not found 2022-04-28T14:36:45.470 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-04-28T14:36:45.471 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2022-04-28T14:36:45.471 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-04-28T14:36:45.471 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-04-28T14:36:45.471 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-04-28T14:36:45.471 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-04-28T14:36:45.475 INFO:teuthology.orchestra.run.smithi039.stderr:bash: ntpq: command not found 2022-04-28T14:36:45.478 INFO:teuthology.orchestra.run.smithi039.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-04-28T14:36:45.479 INFO:teuthology.orchestra.run.smithi039.stdout:=============================================================================== 2022-04-28T14:36:45.479 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-04-28T14:36:45.479 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-04-28T14:36:45.479 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-04-28T14:36:45.479 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-04-28T14:36:45.480 INFO:teuthology.run_tasks:Running task install... 2022-04-28T14:36:45.491 DEBUG:teuthology.task.install:project ceph 2022-04-28T14:36:45.492 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4fa079ba14503defa8dc257d7c2d506ebefcfe6d'}} 2022-04-28T14:36:45.492 DEBUG:teuthology.task.install:config {'branch': 'nautilus', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs'], 'extra_packages': ['librados2'], 'flavor': 'default', 'sha1': '4fa079ba14503defa8dc257d7c2d506ebefcfe6d'} 2022-04-28T14:36:45.492 INFO:teuthology.task.install:Using flavor: default 2022-04-28T14:36:45.499 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-mgr', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2022-04-28T14:36:45.499 INFO:teuthology.task.install:extra packages: ['librados2'] 2022-04-28T14:36:45.499 DEBUG:teuthology.orchestra.run.smithi022:> sudo lsb_release -is 2022-04-28T14:36:45.537 INFO:teuthology.orchestra.run.smithi022.stdout:CentOSStream 2022-04-28T14:36:45.538 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-04-28T14:36:45.538 DEBUG:teuthology.orchestra.run.smithi037:> sudo lsb_release -is 2022-04-28T14:36:45.539 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'nautilus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4fa079ba14503defa8dc257d7c2d506ebefcfe6d', 'tag': None, 'wait_for_package': False} 2022-04-28T14:36:45.539 DEBUG:teuthology.orchestra.run.smithi022:> sudo lsb_release -is 2022-04-28T14:36:45.576 INFO:teuthology.orchestra.run.smithi037.stdout:CentOSStream 2022-04-28T14:36:45.578 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-04-28T14:36:45.578 DEBUG:teuthology.orchestra.run.smithi039:> sudo lsb_release -is 2022-04-28T14:36:45.578 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'nautilus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4fa079ba14503defa8dc257d7c2d506ebefcfe6d', 'tag': None, 'wait_for_package': False} 2022-04-28T14:36:45.579 DEBUG:teuthology.orchestra.run.smithi037:> sudo lsb_release -is 2022-04-28T14:36:45.614 INFO:teuthology.orchestra.run.smithi022.stdout:CentOSStream 2022-04-28T14:36:45.615 INFO:teuthology.orchestra.run.smithi039.stdout:CentOSStream 2022-04-28T14:36:45.616 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-04-28T14:36:45.617 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-04-28T14:36:45.617 INFO:teuthology.packaging:ref: None 2022-04-28T14:36:45.617 INFO:teuthology.packaging:tag: None 2022-04-28T14:36:45.617 INFO:teuthology.packaging:branch: nautilus 2022-04-28T14:36:45.617 INFO:teuthology.packaging:sha1: 4fa079ba14503defa8dc257d7c2d506ebefcfe6d 2022-04-28T14:36:45.618 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=nautilus 2022-04-28T14:36:45.620 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-04-28T14:36:45.621 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'nautilus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4fa079ba14503defa8dc257d7c2d506ebefcfe6d', 'tag': None, 'wait_for_package': False} 2022-04-28T14:36:45.621 DEBUG:teuthology.orchestra.run.smithi039:> sudo lsb_release -is 2022-04-28T14:36:45.658 INFO:teuthology.orchestra.run.smithi037.stdout:CentOSStream 2022-04-28T14:36:45.659 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-04-28T14:36:45.659 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-04-28T14:36:45.659 INFO:teuthology.packaging:ref: None 2022-04-28T14:36:45.660 INFO:teuthology.packaging:tag: None 2022-04-28T14:36:45.660 INFO:teuthology.packaging:branch: nautilus 2022-04-28T14:36:45.660 INFO:teuthology.packaging:sha1: 4fa079ba14503defa8dc257d7c2d506ebefcfe6d 2022-04-28T14:36:45.660 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=nautilus 2022-04-28T14:36:45.694 INFO:teuthology.orchestra.run.smithi039.stdout:CentOSStream 2022-04-28T14:36:45.694 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-04-28T14:36:45.694 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-04-28T14:36:45.694 INFO:teuthology.packaging:ref: None 2022-04-28T14:36:45.695 INFO:teuthology.packaging:tag: None 2022-04-28T14:36:45.695 INFO:teuthology.packaging:branch: nautilus 2022-04-28T14:36:45.695 INFO:teuthology.packaging:sha1: 4fa079ba14503defa8dc257d7c2d506ebefcfe6d 2022-04-28T14:36:45.695 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=nautilus 2022-04-28T14:36:45.807 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/ 2022-04-28T14:36:45.808 INFO:teuthology.task.install.rpm:Package version is 14.2.22-0 2022-04-28T14:36:45.849 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/ 2022-04-28T14:36:45.849 INFO:teuthology.task.install.rpm:Package version is 14.2.22-0 2022-04-28T14:36:45.861 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-04-28T14:36:45.861 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2022-04-28T14:36:45.861 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-04-28T14:36:45.874 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/ 2022-04-28T14:36:45.875 INFO:teuthology.task.install.rpm:Package version is 14.2.22-0 2022-04-28T14:36:45.879 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-04-28T14:36:45.880 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2022-04-28T14:36:45.880 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-04-28T14:36:45.890 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64 2022-04-28T14:36:45.890 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-04-28T14:36:45.891 INFO:teuthology.packaging:ref: None 2022-04-28T14:36:45.891 INFO:teuthology.packaging:tag: None 2022-04-28T14:36:45.891 INFO:teuthology.packaging:branch: nautilus 2022-04-28T14:36:45.891 INFO:teuthology.packaging:sha1: 4fa079ba14503defa8dc257d7c2d506ebefcfe6d 2022-04-28T14:36:45.891 DEBUG:teuthology.orchestra.run.smithi022:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/nautilus/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-04-28T14:36:45.902 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/nautilus/ca74598065096e6fcbd8433c8779a2be0c889351/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-04-28T14:36:45.902 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2022-04-28T14:36:45.902 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-04-28T14:36:45.914 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64 2022-04-28T14:36:45.914 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-04-28T14:36:45.914 INFO:teuthology.packaging:ref: None 2022-04-28T14:36:45.914 INFO:teuthology.packaging:tag: None 2022-04-28T14:36:45.914 INFO:teuthology.packaging:branch: nautilus 2022-04-28T14:36:45.914 INFO:teuthology.packaging:sha1: 4fa079ba14503defa8dc257d7c2d506ebefcfe6d 2022-04-28T14:36:45.915 DEBUG:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/nautilus/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-04-28T14:36:45.930 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64 2022-04-28T14:36:45.930 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-04-28T14:36:45.930 INFO:teuthology.packaging:ref: None 2022-04-28T14:36:45.930 INFO:teuthology.packaging:tag: None 2022-04-28T14:36:45.930 INFO:teuthology.packaging:branch: nautilus 2022-04-28T14:36:45.931 INFO:teuthology.packaging:sha1: 4fa079ba14503defa8dc257d7c2d506ebefcfe6d 2022-04-28T14:36:45.931 DEBUG:teuthology.orchestra.run.smithi039:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/nautilus/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-04-28T14:36:45.959 DEBUG:teuthology.orchestra.run.smithi022:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-04-28T14:36:45.983 DEBUG:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-04-28T14:36:45.999 DEBUG:teuthology.orchestra.run.smithi039:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-04-28T14:36:46.039 DEBUG:teuthology.orchestra.run.smithi022:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-04-28T14:36:46.062 DEBUG:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-04-28T14:36:46.077 DEBUG:teuthology.orchestra.run.smithi039:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-04-28T14:36:46.106 INFO:teuthology.orchestra.run.smithi022.stdout:check_obsoletes = 1 2022-04-28T14:36:46.107 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum clean all 2022-04-28T14:36:46.129 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2022-04-28T14:36:46.131 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum clean all 2022-04-28T14:36:46.144 INFO:teuthology.orchestra.run.smithi039.stdout:check_obsoletes = 1 2022-04-28T14:36:46.145 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum clean all 2022-04-28T14:36:46.355 INFO:teuthology.orchestra.run.smithi022.stdout:55 files removed 2022-04-28T14:36:46.376 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-radosgw 2022-04-28T14:36:46.377 INFO:teuthology.orchestra.run.smithi037.stdout:55 files removed 2022-04-28T14:36:46.392 INFO:teuthology.orchestra.run.smithi039.stdout:55 files removed 2022-04-28T14:36:46.397 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw 2022-04-28T14:36:46.412 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum -y install ceph-radosgw 2022-04-28T14:36:46.808 INFO:teuthology.orchestra.run.smithi022.stdout:ceph packages for x86_64 848 kB/s | 65 kB 00:00 2022-04-28T14:36:46.811 INFO:teuthology.orchestra.run.smithi037.stdout:ceph packages for x86_64 1.0 MB/s | 65 kB 00:00 2022-04-28T14:36:46.846 INFO:teuthology.orchestra.run.smithi039.stdout:ceph packages for x86_64 796 kB/s | 65 kB 00:00 2022-04-28T14:36:46.912 INFO:teuthology.orchestra.run.smithi037.stdout:ceph noarch packages 177 kB/s | 11 kB 00:00 2022-04-28T14:36:46.941 INFO:teuthology.orchestra.run.smithi022.stdout:ceph noarch packages 119 kB/s | 11 kB 00:00 2022-04-28T14:36:46.954 INFO:teuthology.orchestra.run.smithi039.stdout:ceph noarch packages 160 kB/s | 11 kB 00:00 2022-04-28T14:36:47.030 INFO:teuthology.orchestra.run.smithi037.stdout:ceph source packages 18 kB/s | 1.7 kB 00:00 2022-04-28T14:36:47.042 INFO:teuthology.orchestra.run.smithi022.stdout:ceph source packages 23 kB/s | 1.7 kB 00:00 2022-04-28T14:36:47.064 INFO:teuthology.orchestra.run.smithi039.stdout:ceph source packages 20 kB/s | 1.7 kB 00:00 2022-04-28T14:36:47.811 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-8 - AppStream 29 MB/s | 21 MB 00:00 2022-04-28T14:36:47.940 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-8 - AppStream 24 MB/s | 21 MB 00:00 2022-04-28T14:36:48.041 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS-8 - AppStream 22 MB/s | 21 MB 00:00 2022-04-28T14:36:52.370 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-8 - Base 38 MB/s | 22 MB 00:00 2022-04-28T14:36:52.682 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-8 - Base 33 MB/s | 22 MB 00:00 2022-04-28T14:36:53.124 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS-8 - Base 22 MB/s | 22 MB 00:00 2022-04-28T14:36:55.802 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-8 - Extras 183 kB/s | 18 kB 00:00 2022-04-28T14:36:56.188 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-8 - PowerTools 18 MB/s | 4.5 MB 00:00 2022-04-28T14:36:56.314 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-8 - Extras 75 kB/s | 18 kB 00:00 2022-04-28T14:36:56.557 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS-8 - Extras 178 kB/s | 18 kB 00:00 2022-04-28T14:36:56.683 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-8 - PowerTools 19 MB/s | 4.5 MB 00:00 2022-04-28T14:36:56.951 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS-8 - PowerTools 17 MB/s | 4.5 MB 00:00 2022-04-28T14:36:57.304 INFO:teuthology.orchestra.run.smithi022.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2022-04-28T14:36:57.941 INFO:teuthology.orchestra.run.smithi037.stdout:Copr repo for python3-asyncssh owned by ceph 10 kB/s | 3.5 kB 00:00 2022-04-28T14:36:58.008 INFO:teuthology.orchestra.run.smithi039.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2022-04-28T14:36:58.445 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 11 MB/s | 11 MB 00:01 2022-04-28T14:36:59.183 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 9.9 MB/s | 11 MB 00:01 2022-04-28T14:36:59.317 INFO:teuthology.orchestra.run.smithi039.stdout:Extra Packages for Enterprise Linux 9.4 MB/s | 11 MB 00:01 2022-04-28T14:37:01.238 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 402 kB/s | 24 kB 00:00 2022-04-28T14:37:02.025 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 579 kB/s | 24 kB 00:00 2022-04-28T14:37:02.109 INFO:teuthology.orchestra.run.smithi039.stdout:lab-extras 348 kB/s | 24 kB 00:00 2022-04-28T14:37:04.140 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2022-04-28T14:37:04.142 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:37:04.143 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2022-04-28T14:37:04.143 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:37:04.143 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2022-04-28T14:37:04.143 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw x86_64 2:14.2.22-0.el8 ceph 6.0 M 2022-04-28T14:37:04.143 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrading: 2022-04-28T14:37:04.143 INFO:teuthology.orchestra.run.smithi022.stdout: librados2 x86_64 2:14.2.22-0.el8 ceph 3.5 M 2022-04-28T14:37:04.143 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1 x86_64 2:14.2.22-0.el8 ceph 1.7 M 2022-04-28T14:37:04.143 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2022-04-28T14:37:04.144 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base x86_64 2:14.2.22-0.el8 ceph 5.4 M 2022-04-28T14:37:04.144 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common x86_64 2:14.2.22-0.el8 ceph 19 M 2022-04-28T14:37:04.144 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux x86_64 2:14.2.22-0.el8 ceph 25 k 2022-04-28T14:37:04.144 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-04-28T14:37:04.144 INFO:teuthology.orchestra.run.smithi022.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2022-04-28T14:37:04.144 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2 x86_64 2:14.2.22-0.el8 ceph 520 k 2022-04-28T14:37:04.144 INFO:teuthology.orchestra.run.smithi022.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-04-28T14:37:04.144 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-Base 47 k 2022-04-28T14:37:04.144 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1 x86_64 2:14.2.22-0.el8 ceph 376 k 2022-04-28T14:37:04.144 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2022-04-28T14:37:04.144 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2 x86_64 2:14.2.22-0.el8 ceph 5.3 M 2022-04-28T14:37:04.145 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-04-28T14:37:04.145 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2022-04-28T14:37:04.145 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse x86_64 2:14.2.22-0.el8 ceph 39 k 2022-04-28T14:37:04.145 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs x86_64 2:14.2.22-0.el8 ceph 159 k 2022-04-28T14:37:04.145 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2022-04-28T14:37:04.145 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados x86_64 2:14.2.22-0.el8 ceph 323 k 2022-04-28T14:37:04.145 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd x86_64 2:14.2.22-0.el8 ceph 291 k 2022-04-28T14:37:04.145 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw x86_64 2:14.2.22-0.el8 ceph 113 k 2022-04-28T14:37:04.145 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:37:04.145 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2022-04-28T14:37:04.146 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:37:04.146 INFO:teuthology.orchestra.run.smithi022.stdout:Install 20 Packages 2022-04-28T14:37:04.146 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrade 2 Packages 2022-04-28T14:37:04.146 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:37:04.146 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 44 M 2022-04-28T14:37:04.147 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2022-04-28T14:37:04.522 INFO:teuthology.orchestra.run.smithi022.stdout:(1/22): ceph-base-14.2.22-0.el8.x86_64.rpm 14 MB/s | 5.4 MB 00:00 2022-04-28T14:37:04.564 INFO:teuthology.orchestra.run.smithi022.stdout:(2/22): ceph-selinux-14.2.22-0.el8.x86_64.rpm 597 kB/s | 25 kB 00:00 2022-04-28T14:37:04.690 INFO:teuthology.orchestra.run.smithi022.stdout:(3/22): ceph-radosgw-14.2.22-0.el8.x86_64.rpm 11 MB/s | 6.0 MB 00:00 2022-04-28T14:37:04.731 INFO:teuthology.orchestra.run.smithi022.stdout:(4/22): libcephfs2-14.2.22-0.el8.x86_64.rpm 3.0 MB/s | 520 kB 00:00 2022-04-28T14:37:04.757 INFO:teuthology.orchestra.run.smithi022.stdout:(5/22): libradosstriper1-14.2.22-0.el8.x86_64.r 5.5 MB/s | 376 kB 00:00 2022-04-28T14:37:04.807 INFO:teuthology.orchestra.run.smithi022.stdout:(6/22): python3-ceph-argparse-14.2.22-0.el8.x86 787 kB/s | 39 kB 00:00 2022-04-28T14:37:04.865 INFO:teuthology.orchestra.run.smithi022.stdout:(7/22): python3-cephfs-14.2.22-0.el8.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2022-04-28T14:37:04.924 INFO:teuthology.orchestra.run.smithi022.stdout:(8/22): python3-rados-14.2.22-0.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2022-04-28T14:37:04.925 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-04-28T14:37:04.928 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:37:04.928 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2022-04-28T14:37:04.928 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:37:04.929 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2022-04-28T14:37:04.929 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:14.2.22-0.el8 ceph 6.0 M 2022-04-28T14:37:04.929 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2022-04-28T14:37:04.929 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:14.2.22-0.el8 ceph 3.5 M 2022-04-28T14:37:04.929 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:14.2.22-0.el8 ceph 1.7 M 2022-04-28T14:37:04.929 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2022-04-28T14:37:04.929 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:14.2.22-0.el8 ceph 5.4 M 2022-04-28T14:37:04.929 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:14.2.22-0.el8 ceph 19 M 2022-04-28T14:37:04.929 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:14.2.22-0.el8 ceph 25 k 2022-04-28T14:37:04.929 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-04-28T14:37:04.930 INFO:teuthology.orchestra.run.smithi037.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2022-04-28T14:37:04.930 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:14.2.22-0.el8 ceph 520 k 2022-04-28T14:37:04.930 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-04-28T14:37:04.930 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-Base 47 k 2022-04-28T14:37:04.930 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:14.2.22-0.el8 ceph 376 k 2022-04-28T14:37:04.930 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2022-04-28T14:37:04.930 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:14.2.22-0.el8 ceph 5.3 M 2022-04-28T14:37:04.930 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-04-28T14:37:04.930 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2022-04-28T14:37:04.931 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse x86_64 2:14.2.22-0.el8 ceph 39 k 2022-04-28T14:37:04.931 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs x86_64 2:14.2.22-0.el8 ceph 159 k 2022-04-28T14:37:04.931 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2022-04-28T14:37:04.931 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados x86_64 2:14.2.22-0.el8 ceph 323 k 2022-04-28T14:37:04.931 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd x86_64 2:14.2.22-0.el8 ceph 291 k 2022-04-28T14:37:04.931 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw x86_64 2:14.2.22-0.el8 ceph 113 k 2022-04-28T14:37:04.931 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:37:04.931 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-04-28T14:37:04.931 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:37:04.931 INFO:teuthology.orchestra.run.smithi037.stdout:Install 20 Packages 2022-04-28T14:37:04.932 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 2 Packages 2022-04-28T14:37:04.932 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:37:04.932 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 44 M 2022-04-28T14:37:04.932 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2022-04-28T14:37:04.991 INFO:teuthology.orchestra.run.smithi022.stdout:(9/22): python3-rbd-14.2.22-0.el8.x86_64.rpm 4.3 MB/s | 291 kB 00:00 2022-04-28T14:37:05.058 INFO:teuthology.orchestra.run.smithi022.stdout:(10/22): librgw2-14.2.22-0.el8.x86_64.rpm 16 MB/s | 5.3 MB 00:00 2022-04-28T14:37:05.083 INFO:teuthology.orchestra.run.smithi022.stdout:(11/22): python3-rgw-14.2.22-0.el8.x86_64.rpm 1.2 MB/s | 113 kB 00:00 2022-04-28T14:37:05.180 INFO:teuthology.orchestra.run.smithi037.stdout:(1/22): ceph-base-14.2.22-0.el8.x86_64.rpm 22 MB/s | 5.4 MB 00:00 2022-04-28T14:37:05.187 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2022-04-28T14:37:05.190 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:37:05.190 INFO:teuthology.orchestra.run.smithi039.stdout: Package Arch Version Repository Size 2022-04-28T14:37:05.190 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:37:05.190 INFO:teuthology.orchestra.run.smithi039.stdout:Installing: 2022-04-28T14:37:05.190 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-radosgw x86_64 2:14.2.22-0.el8 ceph 6.0 M 2022-04-28T14:37:05.190 INFO:teuthology.orchestra.run.smithi039.stdout:Upgrading: 2022-04-28T14:37:05.190 INFO:teuthology.orchestra.run.smithi039.stdout: librados2 x86_64 2:14.2.22-0.el8 ceph 3.5 M 2022-04-28T14:37:05.191 INFO:teuthology.orchestra.run.smithi039.stdout: librbd1 x86_64 2:14.2.22-0.el8 ceph 1.7 M 2022-04-28T14:37:05.191 INFO:teuthology.orchestra.run.smithi039.stdout:Installing dependencies: 2022-04-28T14:37:05.191 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-base x86_64 2:14.2.22-0.el8 ceph 5.4 M 2022-04-28T14:37:05.191 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-common x86_64 2:14.2.22-0.el8 ceph 19 M 2022-04-28T14:37:05.191 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-selinux x86_64 2:14.2.22-0.el8 ceph 25 k 2022-04-28T14:37:05.191 INFO:teuthology.orchestra.run.smithi039.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-04-28T14:37:05.191 INFO:teuthology.orchestra.run.smithi039.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2022-04-28T14:37:05.191 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs2 x86_64 2:14.2.22-0.el8 ceph 520 k 2022-04-28T14:37:05.191 INFO:teuthology.orchestra.run.smithi039.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-04-28T14:37:05.192 INFO:teuthology.orchestra.run.smithi039.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-Base 47 k 2022-04-28T14:37:05.192 INFO:teuthology.orchestra.run.smithi039.stdout: libradosstriper1 x86_64 2:14.2.22-0.el8 ceph 376 k 2022-04-28T14:37:05.192 INFO:teuthology.orchestra.run.smithi039.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2022-04-28T14:37:05.192 INFO:teuthology.orchestra.run.smithi039.stdout: librgw2 x86_64 2:14.2.22-0.el8 ceph 5.3 M 2022-04-28T14:37:05.192 INFO:teuthology.orchestra.run.smithi039.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-04-28T14:37:05.192 INFO:teuthology.orchestra.run.smithi039.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2022-04-28T14:37:05.192 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-argparse x86_64 2:14.2.22-0.el8 ceph 39 k 2022-04-28T14:37:05.192 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cephfs x86_64 2:14.2.22-0.el8 ceph 159 k 2022-04-28T14:37:05.192 INFO:teuthology.orchestra.run.smithi039.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2022-04-28T14:37:05.192 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rados x86_64 2:14.2.22-0.el8 ceph 323 k 2022-04-28T14:37:05.193 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rbd x86_64 2:14.2.22-0.el8 ceph 291 k 2022-04-28T14:37:05.193 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rgw x86_64 2:14.2.22-0.el8 ceph 113 k 2022-04-28T14:37:05.193 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:37:05.193 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2022-04-28T14:37:05.193 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:37:05.193 INFO:teuthology.orchestra.run.smithi039.stdout:Install 20 Packages 2022-04-28T14:37:05.193 INFO:teuthology.orchestra.run.smithi039.stdout:Upgrade 2 Packages 2022-04-28T14:37:05.193 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:37:05.194 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 44 M 2022-04-28T14:37:05.194 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2022-04-28T14:37:05.210 INFO:teuthology.orchestra.run.smithi037.stdout:(2/22): ceph-selinux-14.2.22-0.el8.x86_64.rpm 854 kB/s | 25 kB 00:00 2022-04-28T14:37:05.251 INFO:teuthology.orchestra.run.smithi037.stdout:(3/22): libcephfs2-14.2.22-0.el8.x86_64.rpm 12 MB/s | 520 kB 00:00 2022-04-28T14:37:05.293 INFO:teuthology.orchestra.run.smithi037.stdout:(4/22): libradosstriper1-14.2.22-0.el8.x86_64.r 8.8 MB/s | 376 kB 00:00 2022-04-28T14:37:05.317 INFO:teuthology.orchestra.run.smithi022.stdout:(12/22): ceph-common-14.2.22-0.el8.x86_64.rpm 17 MB/s | 19 MB 00:01 2022-04-28T14:37:05.376 INFO:teuthology.orchestra.run.smithi022.stdout:(13/22): librdkafka-0.11.4-3.el8.x86_64.rpm 1.1 MB/s | 354 kB 00:00 2022-04-28T14:37:05.377 INFO:teuthology.orchestra.run.smithi037.stdout:(5/22): ceph-radosgw-14.2.22-0.el8.x86_64.rpm 14 MB/s | 6.0 MB 00:00 2022-04-28T14:37:05.409 INFO:teuthology.orchestra.run.smithi022.stdout:(14/22): lttng-ust-2.8.1-11.el8.x86_64.rpm 808 kB/s | 259 kB 00:00 2022-04-28T14:37:05.426 INFO:teuthology.orchestra.run.smithi022.stdout:(15/22): python3-prettytable-0.7.2-14.el8.noarc 405 kB/s | 44 kB 00:00 2022-04-28T14:37:05.436 INFO:teuthology.orchestra.run.smithi037.stdout:(6/22): python3-ceph-argparse-14.2.22-0.el8.x86 674 kB/s | 39 kB 00:00 2022-04-28T14:37:05.443 INFO:teuthology.orchestra.run.smithi022.stdout:(16/22): librabbitmq-0.9.0-3.el8.x86_64.rpm 713 kB/s | 47 kB 00:00 2022-04-28T14:37:05.469 INFO:teuthology.orchestra.run.smithi037.stdout:(7/22): python3-cephfs-14.2.22-0.el8.x86_64.rpm 4.7 MB/s | 159 kB 00:00 2022-04-28T14:37:05.476 INFO:teuthology.orchestra.run.smithi039.stdout:(1/22): ceph-radosgw-14.2.22-0.el8.x86_64.rpm 21 MB/s | 6.0 MB 00:00 2022-04-28T14:37:05.502 INFO:teuthology.orchestra.run.smithi039.stdout:(2/22): ceph-selinux-14.2.22-0.el8.x86_64.rpm 997 kB/s | 25 kB 00:00 2022-04-28T14:37:05.520 INFO:teuthology.orchestra.run.smithi037.stdout:(8/22): python3-rados-14.2.22-0.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2022-04-28T14:37:05.544 INFO:teuthology.orchestra.run.smithi039.stdout:(3/22): libcephfs2-14.2.22-0.el8.x86_64.rpm 12 MB/s | 520 kB 00:00 2022-04-28T14:37:05.561 INFO:teuthology.orchestra.run.smithi037.stdout:(9/22): python3-rbd-14.2.22-0.el8.x86_64.rpm 6.8 MB/s | 291 kB 00:00 2022-04-28T14:37:05.577 INFO:teuthology.orchestra.run.smithi039.stdout:(4/22): libradosstriper1-14.2.22-0.el8.x86_64.r 11 MB/s | 376 kB 00:00 2022-04-28T14:37:05.585 INFO:teuthology.orchestra.run.smithi022.stdout:(17/22): liboath-2.6.2-3.el8.x86_64.rpm 415 kB/s | 59 kB 00:00 2022-04-28T14:37:05.635 INFO:teuthology.orchestra.run.smithi022.stdout:(18/22): leveldb-1.22-1.el8.x86_64.rpm 943 kB/s | 181 kB 00:00 2022-04-28T14:37:05.669 INFO:teuthology.orchestra.run.smithi022.stdout:(19/22): libunwind-1.3.1-3.el8.x86_64.rpm 898 kB/s | 75 kB 00:00 2022-04-28T14:37:05.670 INFO:teuthology.orchestra.run.smithi037.stdout:(10/22): librgw2-14.2.22-0.el8.x86_64.rpm 14 MB/s | 5.3 MB 00:00 2022-04-28T14:37:05.694 INFO:teuthology.orchestra.run.smithi039.stdout:(5/22): ceph-base-14.2.22-0.el8.x86_64.rpm 11 MB/s | 5.4 MB 00:00 2022-04-28T14:37:05.695 INFO:teuthology.orchestra.run.smithi037.stdout:(11/22): python3-rgw-14.2.22-0.el8.x86_64.rpm 848 kB/s | 113 kB 00:00 2022-04-28T14:37:05.702 INFO:teuthology.orchestra.run.smithi022.stdout:(20/22): gperftools-libs-2.7-9.el8.x86_64.rpm 1.0 MB/s | 306 kB 00:00 2022-04-28T14:37:05.753 INFO:teuthology.orchestra.run.smithi039.stdout:(6/22): python3-ceph-argparse-14.2.22-0.el8.x86 675 kB/s | 39 kB 00:00 2022-04-28T14:37:05.754 INFO:teuthology.orchestra.run.smithi037.stdout:(12/22): librdkafka-0.11.4-3.el8.x86_64.rpm 4.1 MB/s | 354 kB 00:00 2022-04-28T14:37:05.786 INFO:teuthology.orchestra.run.smithi039.stdout:(7/22): python3-cephfs-14.2.22-0.el8.x86_64.rpm 4.7 MB/s | 159 kB 00:00 2022-04-28T14:37:05.803 INFO:teuthology.orchestra.run.smithi022.stdout:(21/22): librbd1-14.2.22-0.el8.x86_64.rpm 13 MB/s | 1.7 MB 00:00 2022-04-28T14:37:05.820 INFO:teuthology.orchestra.run.smithi039.stdout:(8/22): python3-rados-14.2.22-0.el8.x86_64.rpm 9.5 MB/s | 323 kB 00:00 2022-04-28T14:37:05.869 INFO:teuthology.orchestra.run.smithi022.stdout:(22/22): librados2-14.2.22-0.el8.x86_64.rpm 15 MB/s | 3.5 MB 00:00 2022-04-28T14:37:05.873 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:37:05.873 INFO:teuthology.orchestra.run.smithi022.stdout:Total 26 MB/s | 44 MB 00:01 2022-04-28T14:37:05.879 INFO:teuthology.orchestra.run.smithi039.stdout:(9/22): python3-rbd-14.2.22-0.el8.x86_64.rpm 4.9 MB/s | 291 kB 00:00 2022-04-28T14:37:05.904 INFO:teuthology.orchestra.run.smithi039.stdout:(10/22): python3-rgw-14.2.22-0.el8.x86_64.rpm 4.5 MB/s | 113 kB 00:00 2022-04-28T14:37:05.913 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2022-04-28T14:37:05.963 INFO:teuthology.orchestra.run.smithi037.stdout:(13/22): ceph-common-14.2.22-0.el8.x86_64.rpm 19 MB/s | 19 MB 00:01 2022-04-28T14:37:05.963 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2022-04-28T14:37:05.963 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2022-04-28T14:37:05.987 INFO:teuthology.orchestra.run.smithi037.stdout:(14/22): python3-prettytable-0.7.2-14.el8.noarc 188 kB/s | 44 kB 00:00 2022-04-28T14:37:05.996 INFO:teuthology.orchestra.run.smithi039.stdout:(11/22): librgw2-14.2.22-0.el8.x86_64.rpm 13 MB/s | 5.3 MB 00:00 2022-04-28T14:37:06.021 INFO:teuthology.orchestra.run.smithi037.stdout:(15/22): lttng-ust-2.8.1-11.el8.x86_64.rpm 808 kB/s | 259 kB 00:00 2022-04-28T14:37:06.029 INFO:teuthology.orchestra.run.smithi039.stdout:(12/22): librdkafka-0.11.4-3.el8.x86_64.rpm 2.8 MB/s | 354 kB 00:00 2022-04-28T14:37:06.046 INFO:teuthology.orchestra.run.smithi037.stdout:(16/22): librabbitmq-0.9.0-3.el8.x86_64.rpm 561 kB/s | 47 kB 00:00 2022-04-28T14:37:06.055 INFO:teuthology.orchestra.run.smithi039.stdout:(13/22): python3-prettytable-0.7.2-14.el8.noarc 1.8 MB/s | 44 kB 00:00 2022-04-28T14:37:06.106 INFO:teuthology.orchestra.run.smithi039.stdout:(14/22): librabbitmq-0.9.0-3.el8.x86_64.rpm 919 kB/s | 47 kB 00:00 2022-04-28T14:37:06.139 INFO:teuthology.orchestra.run.smithi039.stdout:(15/22): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.8 MB/s | 259 kB 00:00 2022-04-28T14:37:06.197 INFO:teuthology.orchestra.run.smithi037.stdout:(17/22): liboath-2.6.2-3.el8.x86_64.rpm 391 kB/s | 59 kB 00:00 2022-04-28T14:37:06.222 INFO:teuthology.orchestra.run.smithi037.stdout:(18/22): leveldb-1.22-1.el8.x86_64.rpm 903 kB/s | 181 kB 00:00 2022-04-28T14:37:06.256 INFO:teuthology.orchestra.run.smithi037.stdout:(19/22): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2022-04-28T14:37:06.281 INFO:teuthology.orchestra.run.smithi037.stdout:(20/22): libunwind-1.3.1-3.el8.x86_64.rpm 896 kB/s | 75 kB 00:00 2022-04-28T14:37:06.340 INFO:teuthology.orchestra.run.smithi037.stdout:(21/22): librbd1-14.2.22-0.el8.x86_64.rpm 21 MB/s | 1.7 MB 00:00 2022-04-28T14:37:06.440 INFO:teuthology.orchestra.run.smithi037.stdout:(22/22): librados2-14.2.22-0.el8.x86_64.rpm 16 MB/s | 3.5 MB 00:00 2022-04-28T14:37:06.443 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:37:06.443 INFO:teuthology.orchestra.run.smithi037.stdout:Total 29 MB/s | 44 MB 00:01 2022-04-28T14:37:06.484 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2022-04-28T14:37:06.497 INFO:teuthology.orchestra.run.smithi039.stdout:(16/22): ceph-common-14.2.22-0.el8.x86_64.rpm 15 MB/s | 19 MB 00:01 2022-04-28T14:37:06.523 INFO:teuthology.orchestra.run.smithi039.stdout:(17/22): leveldb-1.22-1.el8.x86_64.rpm 472 kB/s | 181 kB 00:00 2022-04-28T14:37:06.534 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2022-04-28T14:37:06.535 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2022-04-28T14:37:06.552 INFO:teuthology.orchestra.run.smithi039.stdout:(18/22): gperftools-libs-2.7-9.el8.x86_64.rpm 693 kB/s | 306 kB 00:00 2022-04-28T14:37:06.565 INFO:teuthology.orchestra.run.smithi039.stdout:(19/22): libunwind-1.3.1-3.el8.x86_64.rpm 1.7 MB/s | 75 kB 00:00 2022-04-28T14:37:06.587 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2022-04-28T14:37:06.590 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2022-04-28T14:37:06.665 INFO:teuthology.orchestra.run.smithi039.stdout:(20/22): librados2-14.2.22-0.el8.x86_64.rpm 30 MB/s | 3.5 MB 00:00 2022-04-28T14:37:06.690 INFO:teuthology.orchestra.run.smithi039.stdout:(21/22): liboath-2.6.2-3.el8.x86_64.rpm 306 kB/s | 59 kB 00:00 2022-04-28T14:37:06.757 INFO:teuthology.orchestra.run.smithi039.stdout:(22/22): librbd1-14.2.22-0.el8.x86_64.rpm 9.0 MB/s | 1.7 MB 00:00 2022-04-28T14:37:06.760 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:37:06.760 INFO:teuthology.orchestra.run.smithi039.stdout:Total 28 MB/s | 44 MB 00:01 2022-04-28T14:37:06.801 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2022-04-28T14:37:06.850 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2022-04-28T14:37:06.850 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2022-04-28T14:37:07.118 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2022-04-28T14:37:07.121 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2022-04-28T14:37:07.469 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2022-04-28T14:37:07.472 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2022-04-28T14:37:07.512 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2022-04-28T14:37:07.782 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/24 2022-04-28T14:37:07.978 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/24 2022-04-28T14:37:08.144 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2022-04-28T14:37:08.368 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/24 2022-04-28T14:37:08.438 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/24 2022-04-28T14:37:08.487 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2022-04-28T14:37:08.660 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/24 2022-04-28T14:37:08.728 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librados2-2:14.2.22-0.el8.x86_64 3/24 2022-04-28T14:37:08.777 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/24 2022-04-28T14:37:08.825 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:14.2.22-0.el8.x86_64 3/24 2022-04-28T14:37:09.003 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/24 2022-04-28T14:37:09.019 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rados-2:14.2.22-0.el8.x86_64 4/24 2022-04-28T14:37:09.095 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/24 2022-04-28T14:37:09.187 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs2-2:14.2.22-0.el8.x86_64 5/24 2022-04-28T14:37:09.411 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephfs2-2:14.2.22-0.el8.x86_64 5/24 2022-04-28T14:37:09.417 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/24 2022-04-28T14:37:09.586 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librbd1-2:14.2.22-0.el8.x86_64 6/24 2022-04-28T14:37:09.593 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librados2-2:14.2.22-0.el8.x86_64 3/24 2022-04-28T14:37:09.651 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:14.2.22-0.el8.x86_64 6/24 2022-04-28T14:37:09.669 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : librados2-2:14.2.22-0.el8.x86_64 3/24 2022-04-28T14:37:09.687 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:14.2.22-0.el8.x86_64 3/24 2022-04-28T14:37:09.785 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librados2-2:14.2.22-0.el8.x86_64 3/24 2022-04-28T14:37:09.930 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-2:14.2.22-0.el8.x86_64 4/24 2022-04-28T14:37:10.001 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rados-2:14.2.22-0.el8.x86_64 4/24 2022-04-28T14:37:10.135 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-2:14.2.22-0.el8.x86_64 5/24 2022-04-28T14:37:10.253 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephfs2-2:14.2.22-0.el8.x86_64 5/24 2022-04-28T14:37:10.270 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/24 2022-04-28T14:37:10.389 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs2-2:14.2.22-0.el8.x86_64 5/24 2022-04-28T14:37:10.453 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librgw2-2:14.2.22-0.el8.x86_64 8/24 2022-04-28T14:37:10.473 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libcephfs2-2:14.2.22-0.el8.x86_64 5/24 2022-04-28T14:37:10.516 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librgw2-2:14.2.22-0.el8.x86_64 8/24 2022-04-28T14:37:10.643 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librbd1-2:14.2.22-0.el8.x86_64 6/24 2022-04-28T14:37:10.691 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : leveldb-1.22-1.el8.x86_64 9/24 2022-04-28T14:37:10.711 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : librbd1-2:14.2.22-0.el8.x86_64 6/24 2022-04-28T14:37:10.738 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:14.2.22-0.el8.x86_64 6/24 2022-04-28T14:37:10.792 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librbd1-2:14.2.22-0.el8.x86_64 6/24 2022-04-28T14:37:10.813 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 10/24 2022-04-28T14:37:11.049 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cephfs-2:14.2.22-0.el8.x86_64 11/24 2022-04-28T14:37:11.232 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rgw-2:14.2.22-0.el8.x86_64 12/24 2022-04-28T14:37:11.401 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/24 2022-04-28T14:37:11.412 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rbd-2:14.2.22-0.el8.x86_64 13/24 2022-04-28T14:37:11.434 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/24 2022-04-28T14:37:11.553 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libradosstriper1-2:14.2.22-0.el8.x86_64 14/24 2022-04-28T14:37:11.585 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librgw2-2:14.2.22-0.el8.x86_64 8/24 2022-04-28T14:37:11.650 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libradosstriper1-2:14.2.22-0.el8.x86_64 14/24 2022-04-28T14:37:11.661 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librgw2-2:14.2.22-0.el8.x86_64 8/24 2022-04-28T14:37:11.685 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librgw2-2:14.2.22-0.el8.x86_64 8/24 2022-04-28T14:37:11.737 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librgw2-2:14.2.22-0.el8.x86_64 8/24 2022-04-28T14:37:11.915 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : leveldb-1.22-1.el8.x86_64 9/24 2022-04-28T14:37:11.949 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : leveldb-1.22-1.el8.x86_64 9/24 2022-04-28T14:37:11.992 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 15/24 2022-04-28T14:37:12.053 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 10/24 2022-04-28T14:37:12.112 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 10/24 2022-04-28T14:37:12.204 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 16/24 2022-04-28T14:37:12.331 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-2:14.2.22-0.el8.x86_64 11/24 2022-04-28T14:37:12.348 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cephfs-2:14.2.22-0.el8.x86_64 11/24 2022-04-28T14:37:12.396 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 17/24 2022-04-28T14:37:12.543 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-2:14.2.22-0.el8.x86_64 12/24 2022-04-28T14:37:12.569 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 18/24 2022-04-28T14:37:12.607 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rgw-2:14.2.22-0.el8.x86_64 12/24 2022-04-28T14:37:12.631 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 18/24 2022-04-28T14:37:12.754 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-2:14.2.22-0.el8.x86_64 13/24 2022-04-28T14:37:12.837 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rbd-2:14.2.22-0.el8.x86_64 13/24 2022-04-28T14:37:12.943 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libradosstriper1-2:14.2.22-0.el8.x86_64 14/24 2022-04-28T14:37:12.986 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libradosstriper1-2:14.2.22-0.el8.x86_64 14/24 2022-04-28T14:37:13.049 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libradosstriper1-2:14.2.22-0.el8.x86_64 14/24 2022-04-28T14:37:13.083 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libradosstriper1-2:14.2.22-0.el8.x86_64 14/24 2022-04-28T14:37:13.326 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 15/24 2022-04-28T14:37:13.330 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 15/24 2022-04-28T14:37:13.554 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 16/24 2022-04-28T14:37:13.586 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 16/24 2022-04-28T14:37:13.771 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 17/24 2022-04-28T14:37:13.803 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 17/24 2022-04-28T14:37:13.910 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 18/24 2022-04-28T14:37:13.993 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 18/24 2022-04-28T14:37:14.018 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 18/24 2022-04-28T14:37:14.084 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 18/24 2022-04-28T14:37:15.958 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:14.2.22-0.el8.x86_64 19/24 2022-04-28T14:37:16.178 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-common-2:14.2.22-0.el8.x86_64 19/24 2022-04-28T14:37:16.837 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:14.2.22-0.el8.x86_64 19/24 2022-04-28T14:37:17.155 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-base-2:14.2.22-0.el8.x86_64 20/24 2022-04-28T14:37:17.240 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-base-2:14.2.22-0.el8.x86_64 20/24 2022-04-28T14:37:17.368 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-selinux-2:14.2.22-0.el8.x86_64 21/24 2022-04-28T14:37:17.447 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:14.2.22-0.el8.x86_64 19/24 2022-04-28T14:37:17.642 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-common-2:14.2.22-0.el8.x86_64 19/24 2022-04-28T14:37:17.743 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-2:14.2.22-0.el8.x86_64 19/24 2022-04-28T14:37:17.910 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-common-2:14.2.22-0.el8.x86_64 19/24 2022-04-28T14:37:18.406 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:14.2.22-0.el8.x86_64 19/24 2022-04-28T14:37:18.573 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-common-2:14.2.22-0.el8.x86_64 19/24 2022-04-28T14:37:18.734 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-2:14.2.22-0.el8.x86_64 20/24 2022-04-28T14:37:18.822 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-base-2:14.2.22-0.el8.x86_64 20/24 2022-04-28T14:37:18.910 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-base-2:14.2.22-0.el8.x86_64 20/24 2022-04-28T14:37:18.975 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-selinux-2:14.2.22-0.el8.x86_64 21/24 2022-04-28T14:37:18.992 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-base-2:14.2.22-0.el8.x86_64 20/24 2022-04-28T14:37:19.168 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-selinux-2:14.2.22-0.el8.x86_64 21/24 2022-04-28T14:37:36.269 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-selinux-2:14.2.22-0.el8.x86_64 21/24 2022-04-28T14:37:36.269 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /sys 2022-04-28T14:37:36.269 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /proc 2022-04-28T14:37:36.270 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /dev 2022-04-28T14:37:36.270 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /run 2022-04-28T14:37:36.270 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /mnt 2022-04-28T14:37:36.270 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /var/tmp 2022-04-28T14:37:36.270 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /home 2022-04-28T14:37:36.270 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /tmp 2022-04-28T14:37:36.270 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /dev 2022-04-28T14:37:36.270 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:37:37.027 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-radosgw-2:14.2.22-0.el8.x86_64 22/24 2022-04-28T14:37:37.047 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-radosgw-2:14.2.22-0.el8.x86_64 22/24 2022-04-28T14:37:37.048 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 23/24 2022-04-28T14:37:37.242 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 23/24 2022-04-28T14:37:37.242 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 24/24 2022-04-28T14:37:37.862 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 24/24 2022-04-28T14:37:37.862 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-base-2:14.2.22-0.el8.x86_64 1/24 2022-04-28T14:37:37.863 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-common-2:14.2.22-0.el8.x86_64 2/24 2022-04-28T14:37:37.863 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-radosgw-2:14.2.22-0.el8.x86_64 3/24 2022-04-28T14:37:37.863 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-selinux-2:14.2.22-0.el8.x86_64 4/24 2022-04-28T14:37:37.863 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs2-2:14.2.22-0.el8.x86_64 5/24 2022-04-28T14:37:37.863 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libradosstriper1-2:14.2.22-0.el8.x86_64 6/24 2022-04-28T14:37:37.863 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librgw2-2:14.2.22-0.el8.x86_64 7/24 2022-04-28T14:37:37.863 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 8/24 2022-04-28T14:37:37.863 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cephfs-2:14.2.22-0.el8.x86_64 9/24 2022-04-28T14:37:37.863 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rados-2:14.2.22-0.el8.x86_64 10/24 2022-04-28T14:37:37.864 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rbd-2:14.2.22-0.el8.x86_64 11/24 2022-04-28T14:37:37.864 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rgw-2:14.2.22-0.el8.x86_64 12/24 2022-04-28T14:37:37.864 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 13/24 2022-04-28T14:37:37.864 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 14/24 2022-04-28T14:37:37.864 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 15/24 2022-04-28T14:37:37.864 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 16/24 2022-04-28T14:37:37.864 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 17/24 2022-04-28T14:37:37.864 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : leveldb-1.22-1.el8.x86_64 18/24 2022-04-28T14:37:37.864 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/24 2022-04-28T14:37:37.865 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/24 2022-04-28T14:37:37.865 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:14.2.22-0.el8.x86_64 21/24 2022-04-28T14:37:37.865 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 22/24 2022-04-28T14:37:37.865 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:14.2.22-0.el8.x86_64 23/24 2022-04-28T14:37:38.030 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-selinux-2:14.2.22-0.el8.x86_64 21/24 2022-04-28T14:37:38.030 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /sys 2022-04-28T14:37:38.031 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /proc 2022-04-28T14:37:38.031 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /dev 2022-04-28T14:37:38.031 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /run 2022-04-28T14:37:38.031 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /mnt 2022-04-28T14:37:38.031 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /var/tmp 2022-04-28T14:37:38.031 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /home 2022-04-28T14:37:38.031 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /tmp 2022-04-28T14:37:38.031 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /dev 2022-04-28T14:37:38.032 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:37:38.218 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-selinux-2:14.2.22-0.el8.x86_64 21/24 2022-04-28T14:37:38.218 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /sys 2022-04-28T14:37:38.218 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /proc 2022-04-28T14:37:38.218 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /dev 2022-04-28T14:37:38.219 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /run 2022-04-28T14:37:38.219 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /mnt 2022-04-28T14:37:38.219 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /var/tmp 2022-04-28T14:37:38.219 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /home 2022-04-28T14:37:38.219 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /tmp 2022-04-28T14:37:38.219 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /dev 2022-04-28T14:37:38.220 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:37:38.594 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 24/24 2022-04-28T14:37:38.594 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:37:38.594 INFO:teuthology.orchestra.run.smithi022.stdout:Upgraded: 2022-04-28T14:37:38.594 INFO:teuthology.orchestra.run.smithi022.stdout: librados2-2:14.2.22-0.el8.x86_64 librbd1-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:38.594 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2022-04-28T14:37:38.594 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:38.594 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:38.595 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:38.595 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:38.595 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-04-28T14:37:38.595 INFO:teuthology.orchestra.run.smithi022.stdout: leveldb-1.22-1.el8.x86_64 2022-04-28T14:37:38.595 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:38.595 INFO:teuthology.orchestra.run.smithi022.stdout: liboath-2.6.2-3.el8.x86_64 2022-04-28T14:37:38.595 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-04-28T14:37:38.595 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:38.595 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-04-28T14:37:38.595 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:38.596 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind-1.3.1-3.el8.x86_64 2022-04-28T14:37:38.596 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-04-28T14:37:38.596 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:38.596 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:38.596 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-04-28T14:37:38.596 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:38.596 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:38.596 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:38.596 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:37:38.597 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2022-04-28T14:37:38.741 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-test 2022-04-28T14:37:38.798 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-radosgw-2:14.2.22-0.el8.x86_64 22/24 2022-04-28T14:37:38.818 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-radosgw-2:14.2.22-0.el8.x86_64 22/24 2022-04-28T14:37:38.819 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 23/24 2022-04-28T14:37:38.982 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-2:14.2.22-0.el8.x86_64 22/24 2022-04-28T14:37:39.002 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-radosgw-2:14.2.22-0.el8.x86_64 22/24 2022-04-28T14:37:39.002 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 23/24 2022-04-28T14:37:39.066 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 23/24 2022-04-28T14:37:39.067 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 24/24 2022-04-28T14:37:39.233 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 23/24 2022-04-28T14:37:39.233 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 24/24 2022-04-28T14:37:39.347 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:00:38 ago on Thu 28 Apr 2022 02:37:01 PM UTC. 2022-04-28T14:37:39.742 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 24/24 2022-04-28T14:37:39.742 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-base-2:14.2.22-0.el8.x86_64 1/24 2022-04-28T14:37:39.742 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-common-2:14.2.22-0.el8.x86_64 2/24 2022-04-28T14:37:39.742 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-radosgw-2:14.2.22-0.el8.x86_64 3/24 2022-04-28T14:37:39.742 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-selinux-2:14.2.22-0.el8.x86_64 4/24 2022-04-28T14:37:39.743 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephfs2-2:14.2.22-0.el8.x86_64 5/24 2022-04-28T14:37:39.743 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libradosstriper1-2:14.2.22-0.el8.x86_64 6/24 2022-04-28T14:37:39.743 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librgw2-2:14.2.22-0.el8.x86_64 7/24 2022-04-28T14:37:39.743 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 8/24 2022-04-28T14:37:39.743 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cephfs-2:14.2.22-0.el8.x86_64 9/24 2022-04-28T14:37:39.743 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rados-2:14.2.22-0.el8.x86_64 10/24 2022-04-28T14:37:39.743 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rbd-2:14.2.22-0.el8.x86_64 11/24 2022-04-28T14:37:39.743 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rgw-2:14.2.22-0.el8.x86_64 12/24 2022-04-28T14:37:39.743 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 13/24 2022-04-28T14:37:39.744 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 14/24 2022-04-28T14:37:39.744 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 15/24 2022-04-28T14:37:39.744 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 16/24 2022-04-28T14:37:39.744 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 17/24 2022-04-28T14:37:39.744 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : leveldb-1.22-1.el8.x86_64 18/24 2022-04-28T14:37:39.744 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/24 2022-04-28T14:37:39.744 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/24 2022-04-28T14:37:39.744 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados2-2:14.2.22-0.el8.x86_64 21/24 2022-04-28T14:37:39.744 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 22/24 2022-04-28T14:37:39.744 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librbd1-2:14.2.22-0.el8.x86_64 23/24 2022-04-28T14:37:39.901 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 24/24 2022-04-28T14:37:39.902 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-2:14.2.22-0.el8.x86_64 1/24 2022-04-28T14:37:39.902 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-2:14.2.22-0.el8.x86_64 2/24 2022-04-28T14:37:39.902 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-2:14.2.22-0.el8.x86_64 3/24 2022-04-28T14:37:39.902 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-selinux-2:14.2.22-0.el8.x86_64 4/24 2022-04-28T14:37:39.902 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-2:14.2.22-0.el8.x86_64 5/24 2022-04-28T14:37:39.902 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libradosstriper1-2:14.2.22-0.el8.x86_64 6/24 2022-04-28T14:37:39.902 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librgw2-2:14.2.22-0.el8.x86_64 7/24 2022-04-28T14:37:39.903 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 8/24 2022-04-28T14:37:39.903 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-2:14.2.22-0.el8.x86_64 9/24 2022-04-28T14:37:39.903 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-2:14.2.22-0.el8.x86_64 10/24 2022-04-28T14:37:39.903 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-2:14.2.22-0.el8.x86_64 11/24 2022-04-28T14:37:39.903 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-2:14.2.22-0.el8.x86_64 12/24 2022-04-28T14:37:39.903 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 13/24 2022-04-28T14:37:39.903 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 14/24 2022-04-28T14:37:39.903 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 15/24 2022-04-28T14:37:39.904 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 16/24 2022-04-28T14:37:39.904 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 17/24 2022-04-28T14:37:39.904 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : leveldb-1.22-1.el8.x86_64 18/24 2022-04-28T14:37:39.904 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/24 2022-04-28T14:37:39.904 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/24 2022-04-28T14:37:39.904 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:14.2.22-0.el8.x86_64 21/24 2022-04-28T14:37:39.904 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 22/24 2022-04-28T14:37:39.904 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:14.2.22-0.el8.x86_64 23/24 2022-04-28T14:37:40.265 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2022-04-28T14:37:40.266 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:37:40.266 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2022-04-28T14:37:40.266 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:37:40.266 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2022-04-28T14:37:40.266 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test x86_64 2:14.2.22-0.el8 ceph 35 M 2022-04-28T14:37:40.266 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2022-04-28T14:37:40.266 INFO:teuthology.orchestra.run.smithi022.stdout: jq x86_64 1.6-3.el8 CentOS-AppStream 202 k 2022-04-28T14:37:40.267 INFO:teuthology.orchestra.run.smithi022.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2022-04-28T14:37:40.267 INFO:teuthology.orchestra.run.smithi022.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2022-04-28T14:37:40.267 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2022-04-28T14:37:40.267 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:37:40.267 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2022-04-28T14:37:40.267 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:37:40.267 INFO:teuthology.orchestra.run.smithi022.stdout:Install 5 Packages 2022-04-28T14:37:40.267 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:37:40.268 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 36 M 2022-04-28T14:37:40.268 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 127 M 2022-04-28T14:37:40.268 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2022-04-28T14:37:40.364 INFO:teuthology.orchestra.run.smithi022.stdout:(1/5): oniguruma-6.8.2-2.el8.x86_64.rpm 1.9 MB/s | 187 kB 00:00 2022-04-28T14:37:40.389 INFO:teuthology.orchestra.run.smithi022.stdout:(2/5): jq-1.6-3.el8.x86_64.rpm 1.6 MB/s | 202 kB 00:00 2022-04-28T14:37:40.432 INFO:teuthology.orchestra.run.smithi022.stdout:(3/5): socat-1.7.4.1-1.el8.x86_64.rpm 4.7 MB/s | 323 kB 00:00 2022-04-28T14:37:40.457 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 24/24 2022-04-28T14:37:40.457 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:37:40.457 INFO:teuthology.orchestra.run.smithi039.stdout:Upgraded: 2022-04-28T14:37:40.457 INFO:teuthology.orchestra.run.smithi039.stdout: librados2-2:14.2.22-0.el8.x86_64 librbd1-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:40.457 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2022-04-28T14:37:40.457 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-base-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:40.457 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-common-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:40.458 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-radosgw-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:40.458 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-selinux-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:40.458 INFO:teuthology.orchestra.run.smithi039.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-04-28T14:37:40.458 INFO:teuthology.orchestra.run.smithi039.stdout: leveldb-1.22-1.el8.x86_64 2022-04-28T14:37:40.458 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs2-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:40.458 INFO:teuthology.orchestra.run.smithi039.stdout: liboath-2.6.2-3.el8.x86_64 2022-04-28T14:37:40.458 INFO:teuthology.orchestra.run.smithi039.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-04-28T14:37:40.458 INFO:teuthology.orchestra.run.smithi039.stdout: libradosstriper1-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:40.459 INFO:teuthology.orchestra.run.smithi039.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-04-28T14:37:40.459 INFO:teuthology.orchestra.run.smithi039.stdout: librgw2-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:40.459 INFO:teuthology.orchestra.run.smithi039.stdout: libunwind-1.3.1-3.el8.x86_64 2022-04-28T14:37:40.459 INFO:teuthology.orchestra.run.smithi039.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-04-28T14:37:40.459 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-argparse-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:40.459 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cephfs-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:40.459 INFO:teuthology.orchestra.run.smithi039.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-04-28T14:37:40.459 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rados-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:40.460 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rbd-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:40.460 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rgw-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:40.460 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:37:40.460 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2022-04-28T14:37:40.585 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 24/24 2022-04-28T14:37:40.586 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:37:40.586 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2022-04-28T14:37:40.586 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-2:14.2.22-0.el8.x86_64 librbd1-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:40.586 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2022-04-28T14:37:40.586 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:40.586 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:40.586 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:40.586 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:40.587 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-04-28T14:37:40.587 INFO:teuthology.orchestra.run.smithi037.stdout: leveldb-1.22-1.el8.x86_64 2022-04-28T14:37:40.587 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:40.587 INFO:teuthology.orchestra.run.smithi037.stdout: liboath-2.6.2-3.el8.x86_64 2022-04-28T14:37:40.587 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-04-28T14:37:40.587 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:40.587 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-04-28T14:37:40.587 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:40.587 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind-1.3.1-3.el8.x86_64 2022-04-28T14:37:40.588 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-04-28T14:37:40.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:40.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:40.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-04-28T14:37:40.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:40.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:40.588 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-2:14.2.22-0.el8.x86_64 2022-04-28T14:37:40.588 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:37:40.588 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-04-28T14:37:40.636 INFO:teuthology.orchestra.run.smithi022.stdout:(4/5): xmlstarlet-1.6.1-11.el8.x86_64.rpm 280 kB/s | 69 kB 00:00 2022-04-28T14:37:40.640 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum -y install ceph-test 2022-04-28T14:37:40.780 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-test 2022-04-28T14:37:41.169 INFO:teuthology.orchestra.run.smithi022.stdout:(5/5): ceph-test-14.2.22-0.el8.x86_64.rpm 39 MB/s | 35 MB 00:00 2022-04-28T14:37:41.171 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:37:41.172 INFO:teuthology.orchestra.run.smithi022.stdout:Total 39 MB/s | 36 MB 00:00 2022-04-28T14:37:41.205 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2022-04-28T14:37:41.227 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2022-04-28T14:37:41.227 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2022-04-28T14:37:41.265 INFO:teuthology.orchestra.run.smithi039.stdout:Last metadata expiration check: 0:00:39 ago on Thu 28 Apr 2022 02:37:02 PM UTC. 2022-04-28T14:37:41.413 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:40 ago on Thu 28 Apr 2022 02:37:01 PM UTC. 2022-04-28T14:37:41.504 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2022-04-28T14:37:41.507 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2022-04-28T14:37:42.023 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2022-04-28T14:37:42.153 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2022-04-28T14:37:42.154 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:37:42.154 INFO:teuthology.orchestra.run.smithi039.stdout: Package Arch Version Repository Size 2022-04-28T14:37:42.155 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:37:42.155 INFO:teuthology.orchestra.run.smithi039.stdout:Installing: 2022-04-28T14:37:42.155 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-test x86_64 2:14.2.22-0.el8 ceph 35 M 2022-04-28T14:37:42.155 INFO:teuthology.orchestra.run.smithi039.stdout:Installing dependencies: 2022-04-28T14:37:42.155 INFO:teuthology.orchestra.run.smithi039.stdout: jq x86_64 1.6-3.el8 CentOS-AppStream 202 k 2022-04-28T14:37:42.155 INFO:teuthology.orchestra.run.smithi039.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2022-04-28T14:37:42.155 INFO:teuthology.orchestra.run.smithi039.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2022-04-28T14:37:42.155 INFO:teuthology.orchestra.run.smithi039.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2022-04-28T14:37:42.156 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:37:42.156 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2022-04-28T14:37:42.156 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:37:42.156 INFO:teuthology.orchestra.run.smithi039.stdout:Install 5 Packages 2022-04-28T14:37:42.156 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:37:42.157 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 36 M 2022-04-28T14:37:42.157 INFO:teuthology.orchestra.run.smithi039.stdout:Installed size: 127 M 2022-04-28T14:37:42.158 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2022-04-28T14:37:42.212 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 1/5 2022-04-28T14:37:42.221 INFO:teuthology.orchestra.run.smithi039.stdout:(1/5): jq-1.6-3.el8.x86_64.rpm 3.1 MB/s | 202 kB 00:00 2022-04-28T14:37:42.258 INFO:teuthology.orchestra.run.smithi039.stdout:(2/5): oniguruma-6.8.2-2.el8.x86_64.rpm 1.9 MB/s | 187 kB 00:00 2022-04-28T14:37:42.309 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-04-28T14:37:42.310 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:37:42.310 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2022-04-28T14:37:42.310 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:37:42.310 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2022-04-28T14:37:42.310 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:14.2.22-0.el8 ceph 35 M 2022-04-28T14:37:42.310 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2022-04-28T14:37:42.310 INFO:teuthology.orchestra.run.smithi037.stdout: jq x86_64 1.6-3.el8 CentOS-AppStream 202 k 2022-04-28T14:37:42.310 INFO:teuthology.orchestra.run.smithi037.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2022-04-28T14:37:42.310 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2022-04-28T14:37:42.311 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2022-04-28T14:37:42.311 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:37:42.311 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-04-28T14:37:42.311 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:37:42.311 INFO:teuthology.orchestra.run.smithi037.stdout:Install 5 Packages 2022-04-28T14:37:42.311 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:37:42.312 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 36 M 2022-04-28T14:37:42.312 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 127 M 2022-04-28T14:37:42.312 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2022-04-28T14:37:42.322 INFO:teuthology.orchestra.run.smithi039.stdout:(3/5): socat-1.7.4.1-1.el8.x86_64.rpm 3.1 MB/s | 323 kB 00:00 2022-04-28T14:37:42.394 INFO:teuthology.orchestra.run.smithi037.stdout:(1/5): jq-1.6-3.el8.x86_64.rpm 2.4 MB/s | 202 kB 00:00 2022-04-28T14:37:42.420 INFO:teuthology.orchestra.run.smithi037.stdout:(2/5): oniguruma-6.8.2-2.el8.x86_64.rpm 1.7 MB/s | 187 kB 00:00 2022-04-28T14:37:42.423 INFO:teuthology.orchestra.run.smithi039.stdout:(4/5): xmlstarlet-1.6.1-11.el8.x86_64.rpm 414 kB/s | 69 kB 00:00 2022-04-28T14:37:42.427 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/5 2022-04-28T14:37:42.480 INFO:teuthology.orchestra.run.smithi037.stdout:(3/5): socat-1.7.4.1-1.el8.x86_64.rpm 3.7 MB/s | 323 kB 00:00 2022-04-28T14:37:42.556 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/5 2022-04-28T14:37:42.628 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/5 2022-04-28T14:37:42.697 INFO:teuthology.orchestra.run.smithi037.stdout:(4/5): xmlstarlet-1.6.1-11.el8.x86_64.rpm 250 kB/s | 69 kB 00:00 2022-04-28T14:37:43.061 INFO:teuthology.orchestra.run.smithi039.stdout:(5/5): ceph-test-14.2.22-0.el8.x86_64.rpm 38 MB/s | 35 MB 00:00 2022-04-28T14:37:43.064 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:37:43.064 INFO:teuthology.orchestra.run.smithi039.stdout:Total 39 MB/s | 36 MB 00:00 2022-04-28T14:37:43.099 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2022-04-28T14:37:43.121 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2022-04-28T14:37:43.121 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2022-04-28T14:37:43.357 INFO:teuthology.orchestra.run.smithi037.stdout:(5/5): ceph-test-14.2.22-0.el8.x86_64.rpm 33 MB/s | 35 MB 00:01 2022-04-28T14:37:43.360 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:37:43.360 INFO:teuthology.orchestra.run.smithi037.stdout:Total 34 MB/s | 36 MB 00:01 2022-04-28T14:37:43.396 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2022-04-28T14:37:43.397 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2022-04-28T14:37:43.400 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2022-04-28T14:37:43.418 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2022-04-28T14:37:43.419 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2022-04-28T14:37:43.704 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2022-04-28T14:37:43.734 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2022-04-28T14:37:43.874 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2022-04-28T14:37:44.096 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 1/5 2022-04-28T14:37:44.159 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2022-04-28T14:37:44.284 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/5 2022-04-28T14:37:44.379 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 1/5 2022-04-28T14:37:44.464 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/5 2022-04-28T14:37:44.556 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/5 2022-04-28T14:37:44.584 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/5 2022-04-28T14:37:44.755 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/5 2022-04-28T14:37:44.826 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/5 2022-04-28T14:37:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : jq-1.6-3.el8.x86_64 4/5 2022-04-28T14:37:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-test-2:14.2.22-0.el8.x86_64 5/5 2022-04-28T14:37:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-test-2:14.2.22-0.el8.x86_64 5/5 2022-04-28T14:37:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-test-2:14.2.22-0.el8.x86_64 1/5 2022-04-28T14:37:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : jq-1.6-3.el8.x86_64 2/5 2022-04-28T14:37:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 3/5 2022-04-28T14:37:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/5 2022-04-28T14:37:46.884 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 5/5 2022-04-28T14:37:46.884 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:37:46.885 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2022-04-28T14:37:46.885 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test-2:14.2.22-0.el8.x86_64 jq-1.6-3.el8.x86_64 2022-04-28T14:37:46.885 INFO:teuthology.orchestra.run.smithi022.stdout: oniguruma-6.8.2-2.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2022-04-28T14:37:46.885 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2022-04-28T14:37:46.886 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:37:46.886 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2022-04-28T14:37:47.119 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph 2022-04-28T14:37:47.727 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:00:46 ago on Thu 28 Apr 2022 02:37:01 PM UTC. 2022-04-28T14:37:47.963 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : jq-1.6-3.el8.x86_64 4/5 2022-04-28T14:37:48.223 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : jq-1.6-3.el8.x86_64 4/5 2022-04-28T14:37:48.245 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-test-2:14.2.22-0.el8.x86_64 5/5 2022-04-28T14:37:48.486 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-2:14.2.22-0.el8.x86_64 5/5 2022-04-28T14:37:48.504 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-test-2:14.2.22-0.el8.x86_64 5/5 2022-04-28T14:37:48.504 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-test-2:14.2.22-0.el8.x86_64 1/5 2022-04-28T14:37:48.504 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : jq-1.6-3.el8.x86_64 2/5 2022-04-28T14:37:48.504 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 3/5 2022-04-28T14:37:48.504 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/5 2022-04-28T14:37:48.634 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2022-04-28T14:37:48.638 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:37:48.638 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2022-04-28T14:37:48.638 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:37:48.638 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2022-04-28T14:37:48.638 INFO:teuthology.orchestra.run.smithi022.stdout: ceph x86_64 2:14.2.22-0.el8 ceph 6.3 k 2022-04-28T14:37:48.639 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2022-04-28T14:37:48.639 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds x86_64 2:14.2.22-0.el8 ceph 2.0 M 2022-04-28T14:37:48.639 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr x86_64 2:14.2.22-0.el8 ceph 1.6 M 2022-04-28T14:37:48.639 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon x86_64 2:14.2.22-0.el8 ceph 4.5 M 2022-04-28T14:37:48.639 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd x86_64 2:14.2.22-0.el8 ceph 17 M 2022-04-28T14:37:48.640 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-04-28T14:37:48.640 INFO:teuthology.orchestra.run.smithi022.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-04-28T14:37:48.640 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-Base 237 k 2022-04-28T14:37:48.640 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-04-28T14:37:48.640 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-04-28T14:37:48.640 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-Base 559 k 2022-04-28T14:37:48.641 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-04-28T14:37:48.641 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-04-28T14:37:48.641 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-04-28T14:37:48.641 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2022-04-28T14:37:48.641 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2022-04-28T14:37:48.642 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-04-28T14:37:48.642 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-04-28T14:37:48.642 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-04-28T14:37:48.642 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2022-04-28T14:37:48.642 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-Base 109 k 2022-04-28T14:37:48.642 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2022-04-28T14:37:48.642 INFO:teuthology.orchestra.run.smithi022.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-04-28T14:37:48.642 INFO:teuthology.orchestra.run.smithi022.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-04-28T14:37:48.643 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-04-28T14:37:48.643 INFO:teuthology.orchestra.run.smithi022.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-04-28T14:37:48.643 INFO:teuthology.orchestra.run.smithi022.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-04-28T14:37:48.643 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-04-28T14:37:48.643 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-04-28T14:37:48.643 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2022-04-28T14:37:48.643 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-04-28T14:37:48.643 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:37:48.644 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2022-04-28T14:37:48.644 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:37:48.644 INFO:teuthology.orchestra.run.smithi022.stdout:Install 31 Packages 2022-04-28T14:37:48.644 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:37:48.645 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 28 M 2022-04-28T14:37:48.645 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 93 M 2022-04-28T14:37:48.645 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2022-04-28T14:37:48.691 INFO:teuthology.orchestra.run.smithi022.stdout:(1/31): ceph-14.2.22-0.el8.x86_64.rpm 135 kB/s | 6.3 kB 00:00 2022-04-28T14:37:48.741 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-test-2:14.2.22-0.el8.x86_64 5/5 2022-04-28T14:37:48.741 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-2:14.2.22-0.el8.x86_64 1/5 2022-04-28T14:37:48.741 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : jq-1.6-3.el8.x86_64 2/5 2022-04-28T14:37:48.741 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 3/5 2022-04-28T14:37:48.741 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/5 2022-04-28T14:37:48.750 INFO:teuthology.orchestra.run.smithi022.stdout:(2/31): ceph-mgr-14.2.22-0.el8.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2022-04-28T14:37:48.833 INFO:teuthology.orchestra.run.smithi022.stdout:(3/31): ceph-mds-14.2.22-0.el8.x86_64.rpm 10 MB/s | 2.0 MB 00:00 2022-04-28T14:37:48.900 INFO:teuthology.orchestra.run.smithi022.stdout:(4/31): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2022-04-28T14:37:48.925 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 5/5 2022-04-28T14:37:48.925 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:37:48.925 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2022-04-28T14:37:48.926 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-test-2:14.2.22-0.el8.x86_64 jq-1.6-3.el8.x86_64 2022-04-28T14:37:48.926 INFO:teuthology.orchestra.run.smithi039.stdout: oniguruma-6.8.2-2.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2022-04-28T14:37:48.926 INFO:teuthology.orchestra.run.smithi039.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2022-04-28T14:37:48.926 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:37:48.926 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2022-04-28T14:37:48.926 INFO:teuthology.orchestra.run.smithi022.stdout:(5/31): python3-markupsafe-0.23-19.el8.x86_64.r 1.5 MB/s | 39 kB 00:00 2022-04-28T14:37:48.967 INFO:teuthology.orchestra.run.smithi022.stdout:(6/31): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 2.4 MB/s | 103 kB 00:00 2022-04-28T14:37:48.993 INFO:teuthology.orchestra.run.smithi022.stdout:(7/31): python3-pytz-2017.2-9.el8.noarch.rpm 2.1 MB/s | 54 kB 00:00 2022-04-28T14:37:49.027 INFO:teuthology.orchestra.run.smithi022.stdout:(8/31): python3-werkzeug-0.12.2-4.el8.noarch.rp 13 MB/s | 457 kB 00:00 2022-04-28T14:37:49.068 INFO:teuthology.orchestra.run.smithi022.stdout:(9/31): python3-cffi-1.11.5-5.el8.x86_64.rpm 5.6 MB/s | 237 kB 00:00 2022-04-28T14:37:49.086 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum -y install ceph 2022-04-28T14:37:49.135 INFO:teuthology.orchestra.run.smithi022.stdout:(10/31): ceph-mon-14.2.22-0.el8.x86_64.rpm 10 MB/s | 4.5 MB 00:00 2022-04-28T14:37:49.169 INFO:teuthology.orchestra.run.smithi022.stdout:(11/31): python3-cryptography-3.2.1-5.el8.x86_6 5.5 MB/s | 559 kB 00:00 2022-04-28T14:37:49.199 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 5/5 2022-04-28T14:37:49.199 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:37:49.199 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2022-04-28T14:37:49.199 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-2:14.2.22-0.el8.x86_64 jq-1.6-3.el8.x86_64 2022-04-28T14:37:49.199 INFO:teuthology.orchestra.run.smithi037.stdout: oniguruma-6.8.2-2.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2022-04-28T14:37:49.200 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2022-04-28T14:37:49.200 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:37:49.200 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-04-28T14:37:49.369 INFO:teuthology.orchestra.run.smithi022.stdout:(12/31): ceph-osd-14.2.22-0.el8.x86_64.rpm 27 MB/s | 17 MB 00:00 2022-04-28T14:37:49.377 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph 2022-04-28T14:37:49.386 INFO:teuthology.orchestra.run.smithi022.stdout:(13/31): python3-pycparser-2.14-14.el8.noarch.r 435 kB/s | 109 kB 00:00 2022-04-28T14:37:49.561 INFO:teuthology.orchestra.run.smithi022.stdout:(14/31): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 111 kB/s | 44 kB 00:00 2022-04-28T14:37:49.612 INFO:teuthology.orchestra.run.smithi022.stdout:(15/31): python3-beautifulsoup4-4.6.3-2.el8.1.n 765 kB/s | 185 kB 00:00 2022-04-28T14:37:49.645 INFO:teuthology.orchestra.run.smithi022.stdout:(16/31): python3-cheroot-8.5.2-1.el8.noarch.rpm 667 kB/s | 173 kB 00:00 2022-04-28T14:37:49.670 INFO:teuthology.orchestra.run.smithi022.stdout:(17/31): python3-jaraco-6.2-6.el8.noarch.rpm 189 kB/s | 11 kB 00:00 2022-04-28T14:37:49.674 INFO:teuthology.orchestra.run.smithi039.stdout:Last metadata expiration check: 0:00:47 ago on Thu 28 Apr 2022 02:37:02 PM UTC. 2022-04-28T14:37:49.695 INFO:teuthology.orchestra.run.smithi022.stdout:(18/31): python3-jaraco-functools-2.0-4.el8.noa 351 kB/s | 18 kB 00:00 2022-04-28T14:37:49.721 INFO:teuthology.orchestra.run.smithi022.stdout:(19/31): python3-logutils-0.3.5-11.el8.noarch.r 969 kB/s | 49 kB 00:00 2022-04-28T14:37:49.746 INFO:teuthology.orchestra.run.smithi022.stdout:(20/31): python3-cherrypy-18.4.0-1.el8.noarch.r 2.0 MB/s | 384 kB 00:00 2022-04-28T14:37:49.772 INFO:teuthology.orchestra.run.smithi022.stdout:(21/31): python3-more-itertools-7.2.0-3.el8.noa 773 kB/s | 59 kB 00:00 2022-04-28T14:37:49.789 INFO:teuthology.orchestra.run.smithi022.stdout:(22/31): python3-portend-2.6-1.el8.noarch.rpm 369 kB/s | 16 kB 00:00 2022-04-28T14:37:49.814 INFO:teuthology.orchestra.run.smithi022.stdout:(23/31): python3-simplegeneric-0.8.1-17.el8.noa 447 kB/s | 19 kB 00:00 2022-04-28T14:37:49.848 INFO:teuthology.orchestra.run.smithi022.stdout:(24/31): python3-pecan-1.3.2-9.el8.noarch.rpm 2.2 MB/s | 283 kB 00:00 2022-04-28T14:37:49.864 INFO:teuthology.orchestra.run.smithi022.stdout:(25/31): python3-singledispatch-3.4.0.3-18.el8. 318 kB/s | 24 kB 00:00 2022-04-28T14:37:49.881 INFO:teuthology.orchestra.run.smithi022.stdout:(26/31): python3-tempora-1.14.1-5.el8.noarch.rp 436 kB/s | 29 kB 00:00 2022-04-28T14:37:49.898 INFO:teuthology.orchestra.run.smithi022.stdout:(27/31): python3-trustme-0.6.0-4.el8.noarch.rpm 549 kB/s | 27 kB 00:00 2022-04-28T14:37:49.948 INFO:teuthology.orchestra.run.smithi022.stdout:(28/31): python3-webtest-2.0.33-1.el8.noarch.rp 1.7 MB/s | 85 kB 00:00 2022-04-28T14:37:49.966 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:48 ago on Thu 28 Apr 2022 02:37:01 PM UTC. 2022-04-28T14:37:49.982 INFO:teuthology.orchestra.run.smithi022.stdout:(29/31): python3-waitress-1.2.1-2.el8.1.noarch. 2.3 MB/s | 241 kB 00:00 2022-04-28T14:37:50.007 INFO:teuthology.orchestra.run.smithi022.stdout:(30/31): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.0 MB/s | 251 kB 00:00 2022-04-28T14:37:50.033 INFO:teuthology.orchestra.run.smithi022.stdout:(31/31): python3-zc-lockfile-2.0-2.el8.noarch.r 274 kB/s | 23 kB 00:00 2022-04-28T14:37:50.036 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:37:50.037 INFO:teuthology.orchestra.run.smithi022.stdout:Total 20 MB/s | 28 MB 00:01 2022-04-28T14:37:50.122 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2022-04-28T14:37:50.164 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2022-04-28T14:37:50.164 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2022-04-28T14:37:50.485 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2022-04-28T14:37:50.488 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2022-04-28T14:37:50.586 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2022-04-28T14:37:50.589 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:37:50.589 INFO:teuthology.orchestra.run.smithi039.stdout: Package Arch Version Repository Size 2022-04-28T14:37:50.589 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:37:50.589 INFO:teuthology.orchestra.run.smithi039.stdout:Installing: 2022-04-28T14:37:50.590 INFO:teuthology.orchestra.run.smithi039.stdout: ceph x86_64 2:14.2.22-0.el8 ceph 6.3 k 2022-04-28T14:37:50.590 INFO:teuthology.orchestra.run.smithi039.stdout:Installing dependencies: 2022-04-28T14:37:50.590 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mds x86_64 2:14.2.22-0.el8 ceph 2.0 M 2022-04-28T14:37:50.590 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr x86_64 2:14.2.22-0.el8 ceph 1.6 M 2022-04-28T14:37:50.590 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mon x86_64 2:14.2.22-0.el8 ceph 4.5 M 2022-04-28T14:37:50.590 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-osd x86_64 2:14.2.22-0.el8 ceph 17 M 2022-04-28T14:37:50.590 INFO:teuthology.orchestra.run.smithi039.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-04-28T14:37:50.590 INFO:teuthology.orchestra.run.smithi039.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-04-28T14:37:50.590 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-Base 237 k 2022-04-28T14:37:50.591 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-04-28T14:37:50.591 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-04-28T14:37:50.591 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-Base 559 k 2022-04-28T14:37:50.591 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-04-28T14:37:50.591 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-04-28T14:37:50.591 INFO:teuthology.orchestra.run.smithi039.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-04-28T14:37:50.591 INFO:teuthology.orchestra.run.smithi039.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2022-04-28T14:37:50.591 INFO:teuthology.orchestra.run.smithi039.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2022-04-28T14:37:50.591 INFO:teuthology.orchestra.run.smithi039.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-04-28T14:37:50.591 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-04-28T14:37:50.592 INFO:teuthology.orchestra.run.smithi039.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-04-28T14:37:50.592 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2022-04-28T14:37:50.592 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-Base 109 k 2022-04-28T14:37:50.592 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2022-04-28T14:37:50.592 INFO:teuthology.orchestra.run.smithi039.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-04-28T14:37:50.592 INFO:teuthology.orchestra.run.smithi039.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-04-28T14:37:50.592 INFO:teuthology.orchestra.run.smithi039.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-04-28T14:37:50.592 INFO:teuthology.orchestra.run.smithi039.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-04-28T14:37:50.592 INFO:teuthology.orchestra.run.smithi039.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-04-28T14:37:50.592 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-04-28T14:37:50.593 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-04-28T14:37:50.593 INFO:teuthology.orchestra.run.smithi039.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2022-04-28T14:37:50.593 INFO:teuthology.orchestra.run.smithi039.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-04-28T14:37:50.593 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:37:50.593 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2022-04-28T14:37:50.593 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:37:50.593 INFO:teuthology.orchestra.run.smithi039.stdout:Install 31 Packages 2022-04-28T14:37:50.593 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:37:50.594 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 28 M 2022-04-28T14:37:50.594 INFO:teuthology.orchestra.run.smithi039.stdout:Installed size: 93 M 2022-04-28T14:37:50.594 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2022-04-28T14:37:50.642 INFO:teuthology.orchestra.run.smithi039.stdout:(1/31): ceph-14.2.22-0.el8.x86_64.rpm 138 kB/s | 6.3 kB 00:00 2022-04-28T14:37:50.700 INFO:teuthology.orchestra.run.smithi039.stdout:(2/31): ceph-mds-14.2.22-0.el8.x86_64.rpm 19 MB/s | 2.0 MB 00:00 2022-04-28T14:37:50.792 INFO:teuthology.orchestra.run.smithi039.stdout:(3/31): ceph-mgr-14.2.22-0.el8.x86_64.rpm 8.0 MB/s | 1.6 MB 00:00 2022-04-28T14:37:50.849 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-04-28T14:37:50.852 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:37:50.852 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2022-04-28T14:37:50.852 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:37:50.852 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2022-04-28T14:37:50.853 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:14.2.22-0.el8 ceph 6.3 k 2022-04-28T14:37:50.853 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2022-04-28T14:37:50.853 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:14.2.22-0.el8 ceph 2.0 M 2022-04-28T14:37:50.853 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:14.2.22-0.el8 ceph 1.6 M 2022-04-28T14:37:50.853 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:14.2.22-0.el8 ceph 4.5 M 2022-04-28T14:37:50.853 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:14.2.22-0.el8 ceph 17 M 2022-04-28T14:37:50.853 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-04-28T14:37:50.853 INFO:teuthology.orchestra.run.smithi037.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-04-28T14:37:50.853 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-Base 237 k 2022-04-28T14:37:50.854 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-04-28T14:37:50.854 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-04-28T14:37:50.854 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-Base 559 k 2022-04-28T14:37:50.854 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-04-28T14:37:50.854 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-04-28T14:37:50.854 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-04-28T14:37:50.854 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2022-04-28T14:37:50.854 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2022-04-28T14:37:50.854 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-04-28T14:37:50.854 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-04-28T14:37:50.855 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-04-28T14:37:50.855 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2022-04-28T14:37:50.855 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-Base 109 k 2022-04-28T14:37:50.855 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2022-04-28T14:37:50.855 INFO:teuthology.orchestra.run.smithi037.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-04-28T14:37:50.855 INFO:teuthology.orchestra.run.smithi037.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-04-28T14:37:50.855 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-04-28T14:37:50.855 INFO:teuthology.orchestra.run.smithi037.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-04-28T14:37:50.855 INFO:teuthology.orchestra.run.smithi037.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-04-28T14:37:50.855 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-04-28T14:37:50.856 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-04-28T14:37:50.856 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2022-04-28T14:37:50.856 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-04-28T14:37:50.856 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:37:50.856 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-04-28T14:37:50.856 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:37:50.856 INFO:teuthology.orchestra.run.smithi037.stdout:Install 31 Packages 2022-04-28T14:37:50.856 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:37:50.857 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 28 M 2022-04-28T14:37:50.857 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 93 M 2022-04-28T14:37:50.857 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2022-04-28T14:37:50.859 INFO:teuthology.orchestra.run.smithi039.stdout:(4/31): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2022-04-28T14:37:50.884 INFO:teuthology.orchestra.run.smithi039.stdout:(5/31): python3-markupsafe-0.23-19.el8.x86_64.r 1.5 MB/s | 39 kB 00:00 2022-04-28T14:37:50.910 INFO:teuthology.orchestra.run.smithi039.stdout:(6/31): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 4.1 MB/s | 103 kB 00:00 2022-04-28T14:37:50.920 INFO:teuthology.orchestra.run.smithi037.stdout:(1/31): ceph-14.2.22-0.el8.x86_64.rpm 104 kB/s | 6.3 kB 00:00 2022-04-28T14:37:50.935 INFO:teuthology.orchestra.run.smithi039.stdout:(7/31): python3-pytz-2017.2-9.el8.noarch.rpm 2.1 MB/s | 54 kB 00:00 2022-04-28T14:37:50.987 INFO:teuthology.orchestra.run.smithi037.stdout:(2/31): ceph-mds-14.2.22-0.el8.x86_64.rpm 15 MB/s | 2.0 MB 00:00 2022-04-28T14:37:50.993 INFO:teuthology.orchestra.run.smithi039.stdout:(8/31): python3-werkzeug-0.12.2-4.el8.noarch.rp 7.7 MB/s | 457 kB 00:00 2022-04-28T14:37:51.052 INFO:teuthology.orchestra.run.smithi039.stdout:(9/31): ceph-mon-14.2.22-0.el8.x86_64.rpm 11 MB/s | 4.5 MB 00:00 2022-04-28T14:37:51.077 INFO:teuthology.orchestra.run.smithi039.stdout:(10/31): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.8 MB/s | 237 kB 00:00 2022-04-28T14:37:51.078 INFO:teuthology.orchestra.run.smithi037.stdout:(3/31): ceph-mgr-14.2.22-0.el8.x86_64.rpm 7.1 MB/s | 1.6 MB 00:00 2022-04-28T14:37:51.111 INFO:teuthology.orchestra.run.smithi039.stdout:(11/31): python3-pycparser-2.14-14.el8.noarch.r 3.7 MB/s | 109 kB 00:00 2022-04-28T14:37:51.138 INFO:teuthology.orchestra.run.smithi037.stdout:(4/31): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2022-04-28T14:37:51.145 INFO:teuthology.orchestra.run.smithi039.stdout:(12/31): python3-cryptography-3.2.1-5.el8.x86_6 5.9 MB/s | 559 kB 00:00 2022-04-28T14:37:51.162 INFO:teuthology.orchestra.run.smithi037.stdout:(5/31): python3-markupsafe-0.23-19.el8.x86_64.r 1.5 MB/s | 39 kB 00:00 2022-04-28T14:37:51.188 INFO:teuthology.orchestra.run.smithi037.stdout:(6/31): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 4.0 MB/s | 103 kB 00:00 2022-04-28T14:37:51.213 INFO:teuthology.orchestra.run.smithi037.stdout:(7/31): python3-pytz-2017.2-9.el8.noarch.rpm 2.1 MB/s | 54 kB 00:00 2022-04-28T14:37:51.280 INFO:teuthology.orchestra.run.smithi037.stdout:(8/31): python3-werkzeug-0.12.2-4.el8.noarch.rp 6.7 MB/s | 457 kB 00:00 2022-04-28T14:37:51.347 INFO:teuthology.orchestra.run.smithi037.stdout:(9/31): ceph-mon-14.2.22-0.el8.x86_64.rpm 10 MB/s | 4.5 MB 00:00 2022-04-28T14:37:51.380 INFO:teuthology.orchestra.run.smithi037.stdout:(10/31): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.3 MB/s | 237 kB 00:00 2022-04-28T14:37:51.403 INFO:teuthology.orchestra.run.smithi039.stdout:(13/31): ceph-osd-14.2.22-0.el8.x86_64.rpm 24 MB/s | 17 MB 00:00 2022-04-28T14:37:51.414 INFO:teuthology.orchestra.run.smithi037.stdout:(11/31): python3-pycparser-2.14-14.el8.noarch.r 3.3 MB/s | 109 kB 00:00 2022-04-28T14:37:51.448 INFO:teuthology.orchestra.run.smithi037.stdout:(12/31): python3-cryptography-3.2.1-5.el8.x86_6 5.4 MB/s | 559 kB 00:00 2022-04-28T14:37:51.452 INFO:teuthology.orchestra.run.smithi039.stdout:(14/31): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 128 kB/s | 44 kB 00:00 2022-04-28T14:37:51.487 INFO:teuthology.orchestra.run.smithi039.stdout:(15/31): python3-beautifulsoup4-4.6.3-2.el8.1.n 541 kB/s | 185 kB 00:00 2022-04-28T14:37:51.540 INFO:teuthology.orchestra.run.smithi039.stdout:(16/31): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.3 MB/s | 173 kB 00:00 2022-04-28T14:37:51.563 INFO:teuthology.orchestra.run.smithi039.stdout:(17/31): python3-jaraco-6.2-6.el8.noarch.rpm 148 kB/s | 11 kB 00:00 2022-04-28T14:37:51.565 INFO:teuthology.orchestra.run.smithi037.stdout:(13/31): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 290 kB/s | 44 kB 00:00 2022-04-28T14:37:51.588 INFO:teuthology.orchestra.run.smithi039.stdout:(18/31): python3-jaraco-functools-2.0-4.el8.noa 350 kB/s | 18 kB 00:00 2022-04-28T14:37:51.613 INFO:teuthology.orchestra.run.smithi039.stdout:(19/31): python3-logutils-0.3.5-11.el8.noarch.r 972 kB/s | 49 kB 00:00 2022-04-28T14:37:51.638 INFO:teuthology.orchestra.run.smithi039.stdout:(20/31): python3-more-itertools-7.2.0-3.el8.noa 1.1 MB/s | 59 kB 00:00 2022-04-28T14:37:51.651 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2022-04-28T14:37:51.705 INFO:teuthology.orchestra.run.smithi039.stdout:(21/31): python3-portend-2.6-1.el8.noarch.rpm 233 kB/s | 16 kB 00:00 2022-04-28T14:37:51.731 INFO:teuthology.orchestra.run.smithi039.stdout:(22/31): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2022-04-28T14:37:51.756 INFO:teuthology.orchestra.run.smithi039.stdout:(23/31): python3-simplegeneric-0.8.1-17.el8.noa 373 kB/s | 19 kB 00:00 2022-04-28T14:37:51.757 INFO:teuthology.orchestra.run.smithi037.stdout:(14/31): ceph-osd-14.2.22-0.el8.x86_64.rpm 22 MB/s | 17 MB 00:00 2022-04-28T14:37:51.782 INFO:teuthology.orchestra.run.smithi039.stdout:(24/31): python3-cherrypy-18.4.0-1.el8.noarch.r 1.1 MB/s | 384 kB 00:00 2022-04-28T14:37:51.782 INFO:teuthology.orchestra.run.smithi037.stdout:(15/31): python3-beautifulsoup4-4.6.3-2.el8.1.n 555 kB/s | 185 kB 00:00 2022-04-28T14:37:51.807 INFO:teuthology.orchestra.run.smithi039.stdout:(25/31): python3-singledispatch-3.4.0.3-18.el8. 316 kB/s | 24 kB 00:00 2022-04-28T14:37:51.807 INFO:teuthology.orchestra.run.smithi037.stdout:(16/31): python3-cheroot-8.5.2-1.el8.noarch.rpm 713 kB/s | 173 kB 00:00 2022-04-28T14:37:51.832 INFO:teuthology.orchestra.run.smithi039.stdout:(26/31): python3-tempora-1.14.1-5.el8.noarch.rp 387 kB/s | 29 kB 00:00 2022-04-28T14:37:51.841 INFO:teuthology.orchestra.run.smithi037.stdout:(17/31): python3-jaraco-6.2-6.el8.noarch.rpm 188 kB/s | 11 kB 00:00 2022-04-28T14:37:51.857 INFO:teuthology.orchestra.run.smithi039.stdout:(27/31): python3-trustme-0.6.0-4.el8.noarch.rpm 364 kB/s | 27 kB 00:00 2022-04-28T14:37:51.866 INFO:teuthology.orchestra.run.smithi037.stdout:(18/31): python3-jaraco-functools-2.0-4.el8.noa 298 kB/s | 18 kB 00:00 2022-04-28T14:37:51.881 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/31 2022-04-28T14:37:51.891 INFO:teuthology.orchestra.run.smithi039.stdout:(28/31): python3-waitress-1.2.1-2.el8.1.noarch. 2.8 MB/s | 241 kB 00:00 2022-04-28T14:37:51.891 INFO:teuthology.orchestra.run.smithi037.stdout:(19/31): python3-logutils-0.3.5-11.el8.noarch.r 971 kB/s | 49 kB 00:00 2022-04-28T14:37:51.917 INFO:teuthology.orchestra.run.smithi037.stdout:(20/31): python3-more-itertools-7.2.0-3.el8.noa 1.1 MB/s | 59 kB 00:00 2022-04-28T14:37:51.950 INFO:teuthology.orchestra.run.smithi039.stdout:(29/31): python3-webtest-2.0.33-1.el8.noarch.rp 928 kB/s | 85 kB 00:00 2022-04-28T14:37:51.974 INFO:teuthology.orchestra.run.smithi039.stdout:(30/31): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.7 MB/s | 251 kB 00:00 2022-04-28T14:37:51.992 INFO:teuthology.orchestra.run.smithi037.stdout:(21/31): python3-portend-2.6-1.el8.noarch.rpm 207 kB/s | 16 kB 00:00 2022-04-28T14:37:51.999 INFO:teuthology.orchestra.run.smithi039.stdout:(31/31): python3-zc-lockfile-2.0-2.el8.noarch.r 211 kB/s | 23 kB 00:00 2022-04-28T14:37:52.004 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:37:52.004 INFO:teuthology.orchestra.run.smithi039.stdout:Total 20 MB/s | 28 MB 00:01 2022-04-28T14:37:52.026 INFO:teuthology.orchestra.run.smithi037.stdout:(22/31): python3-pecan-1.3.2-9.el8.noarch.rpm 2.1 MB/s | 283 kB 00:00 2022-04-28T14:37:52.051 INFO:teuthology.orchestra.run.smithi037.stdout:(23/31): python3-simplegeneric-0.8.1-17.el8.noa 320 kB/s | 19 kB 00:00 2022-04-28T14:37:52.076 INFO:teuthology.orchestra.run.smithi037.stdout:(24/31): python3-cherrypy-18.4.0-1.el8.noarch.r 1.2 MB/s | 384 kB 00:00 2022-04-28T14:37:52.092 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2022-04-28T14:37:52.093 INFO:teuthology.orchestra.run.smithi037.stdout:(25/31): python3-singledispatch-3.4.0.3-18.el8. 356 kB/s | 24 kB 00:00 2022-04-28T14:37:52.096 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/31 2022-04-28T14:37:52.110 INFO:teuthology.orchestra.run.smithi037.stdout:(26/31): python3-tempora-1.14.1-5.el8.noarch.rp 496 kB/s | 29 kB 00:00 2022-04-28T14:37:52.127 INFO:teuthology.orchestra.run.smithi037.stdout:(27/31): python3-trustme-0.6.0-4.el8.noarch.rpm 547 kB/s | 27 kB 00:00 2022-04-28T14:37:52.135 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2022-04-28T14:37:52.135 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2022-04-28T14:37:52.177 INFO:teuthology.orchestra.run.smithi037.stdout:(28/31): python3-waitress-1.2.1-2.el8.1.noarch. 2.8 MB/s | 241 kB 00:00 2022-04-28T14:37:52.236 INFO:teuthology.orchestra.run.smithi037.stdout:(29/31): python3-webtest-2.0.33-1.el8.noarch.rp 786 kB/s | 85 kB 00:00 2022-04-28T14:37:52.261 INFO:teuthology.orchestra.run.smithi037.stdout:(30/31): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.6 MB/s | 251 kB 00:00 2022-04-28T14:37:52.278 INFO:teuthology.orchestra.run.smithi037.stdout:(31/31): python3-zc-lockfile-2.0-2.el8.noarch.r 229 kB/s | 23 kB 00:00 2022-04-28T14:37:52.283 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:37:52.283 INFO:teuthology.orchestra.run.smithi037.stdout:Total 20 MB/s | 28 MB 00:01 2022-04-28T14:37:52.323 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/31 2022-04-28T14:37:52.367 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2022-04-28T14:37:52.409 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2022-04-28T14:37:52.409 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2022-04-28T14:37:52.476 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2022-04-28T14:37:52.479 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2022-04-28T14:37:52.702 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/31 2022-04-28T14:37:52.751 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2022-04-28T14:37:52.754 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2022-04-28T14:37:52.867 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/31 2022-04-28T14:37:53.060 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/31 2022-04-28T14:37:53.258 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/31 2022-04-28T14:37:53.403 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/31 2022-04-28T14:37:53.599 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/31 2022-04-28T14:37:53.739 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2022-04-28T14:37:53.809 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/31 2022-04-28T14:37:53.977 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2022-04-28T14:37:54.024 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/31 2022-04-28T14:37:54.048 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/31 2022-04-28T14:37:54.256 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/31 2022-04-28T14:37:54.264 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/31 2022-04-28T14:37:54.288 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/31 2022-04-28T14:37:54.524 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/31 2022-04-28T14:37:54.538 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/31 2022-04-28T14:37:54.644 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 13/31 2022-04-28T14:37:54.777 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/31 2022-04-28T14:37:54.799 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/31 2022-04-28T14:37:54.892 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 14/31 2022-04-28T14:37:55.009 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/31 2022-04-28T14:37:55.062 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/31 2022-04-28T14:37:55.080 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/31 2022-04-28T14:37:55.242 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/31 2022-04-28T14:37:55.287 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/31 2022-04-28T14:37:55.291 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/31 2022-04-28T14:37:55.475 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/31 2022-04-28T14:37:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/31 2022-04-28T14:37:55.631 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/31 2022-04-28T14:37:55.653 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/31 2022-04-28T14:37:55.749 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/31 2022-04-28T14:37:55.882 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/31 2022-04-28T14:37:55.911 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/31 2022-04-28T14:37:55.914 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/31 2022-04-28T14:37:56.127 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/31 2022-04-28T14:37:56.147 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/31 2022-04-28T14:37:56.153 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/31 2022-04-28T14:37:56.356 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/31 2022-04-28T14:37:56.358 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/31 2022-04-28T14:37:56.401 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/31 2022-04-28T14:37:56.544 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/31 2022-04-28T14:37:56.599 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/31 2022-04-28T14:37:56.648 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/31 2022-04-28T14:37:56.823 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/31 2022-04-28T14:37:56.914 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/31 2022-04-28T14:37:57.037 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 13/31 2022-04-28T14:37:57.194 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/31 2022-04-28T14:37:57.292 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 14/31 2022-04-28T14:37:57.382 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 13/31 2022-04-28T14:37:57.417 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/31 2022-04-28T14:37:57.521 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/31 2022-04-28T14:37:57.725 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 14/31 2022-04-28T14:37:57.743 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/31 2022-04-28T14:37:57.799 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/31 2022-04-28T14:37:57.971 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/31 2022-04-28T14:37:58.022 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/31 2022-04-28T14:37:58.179 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/31 2022-04-28T14:37:58.271 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/31 2022-04-28T14:37:58.337 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/31 2022-04-28T14:37:58.407 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-2:14.2.22-0.el8.x86_64 27/31 2022-04-28T14:37:58.499 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/31 2022-04-28T14:37:58.586 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/31 2022-04-28T14:37:58.807 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/31 2022-04-28T14:37:58.834 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/31 2022-04-28T14:37:59.034 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/31 2022-04-28T14:37:59.129 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/31 2022-04-28T14:37:59.336 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/31 2022-04-28T14:37:59.350 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/31 2022-04-28T14:37:59.593 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/31 2022-04-28T14:37:59.600 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/31 2022-04-28T14:37:59.855 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/31 2022-04-28T14:37:59.868 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-2:14.2.22-0.el8.x86_64 27/31 2022-04-28T14:37:59.879 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/31 2022-04-28T14:38:00.115 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-osd-2:14.2.22-0.el8.x86_64 28/31 2022-04-28T14:38:00.152 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/31 2022-04-28T14:38:00.283 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/31 2022-04-28T14:38:00.418 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/31 2022-04-28T14:38:00.539 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-osd-2:14.2.22-0.el8.x86_64 28/31 2022-04-28T14:38:00.687 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mon-2:14.2.22-0.el8.x86_64 29/31 2022-04-28T14:38:00.719 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/31 2022-04-28T14:38:00.791 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/31 2022-04-28T14:38:00.875 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mon-2:14.2.22-0.el8.x86_64 29/31 2022-04-28T14:38:00.970 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-2:14.2.22-0.el8.x86_64 27/31 2022-04-28T14:38:01.020 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mds-2:14.2.22-0.el8.x86_64 30/31 2022-04-28T14:38:01.038 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mds-2:14.2.22-0.el8.x86_64 30/31 2022-04-28T14:38:01.136 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-2:14.2.22-0.el8.x86_64 31/31 2022-04-28T14:38:01.235 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/31 2022-04-28T14:38:01.487 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-2:14.2.22-0.el8.x86_64 27/31 2022-04-28T14:38:01.535 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-2:14.2.22-0.el8.x86_64 31/31 2022-04-28T14:38:01.536 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-2:14.2.22-0.el8.x86_64 1/31 2022-04-28T14:38:01.536 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mds-2:14.2.22-0.el8.x86_64 2/31 2022-04-28T14:38:01.536 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-2:14.2.22-0.el8.x86_64 3/31 2022-04-28T14:38:01.536 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mon-2:14.2.22-0.el8.x86_64 4/31 2022-04-28T14:38:01.536 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-osd-2:14.2.22-0.el8.x86_64 5/31 2022-04-28T14:38:01.536 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 6/31 2022-04-28T14:38:01.536 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 7/31 2022-04-28T14:38:01.536 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 8/31 2022-04-28T14:38:01.536 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 9/31 2022-04-28T14:38:01.537 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 10/31 2022-04-28T14:38:01.537 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 11/31 2022-04-28T14:38:01.537 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 12/31 2022-04-28T14:38:01.537 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 13/31 2022-04-28T14:38:01.537 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 14/31 2022-04-28T14:38:01.537 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 15/31 2022-04-28T14:38:01.537 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 16/31 2022-04-28T14:38:01.537 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 17/31 2022-04-28T14:38:01.537 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 18/31 2022-04-28T14:38:01.537 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 19/31 2022-04-28T14:38:01.538 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 20/31 2022-04-28T14:38:01.538 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 21/31 2022-04-28T14:38:01.538 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 22/31 2022-04-28T14:38:01.538 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-portend-2.6-1.el8.noarch 23/31 2022-04-28T14:38:01.538 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 24/31 2022-04-28T14:38:01.538 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 25/31 2022-04-28T14:38:01.538 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 26/31 2022-04-28T14:38:01.538 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 27/31 2022-04-28T14:38:01.538 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 28/31 2022-04-28T14:38:01.539 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 29/31 2022-04-28T14:38:01.539 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 30/31 2022-04-28T14:38:02.428 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-2:14.2.22-0.el8.x86_64 27/31 2022-04-28T14:38:02.438 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 31/31 2022-04-28T14:38:02.438 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:02.438 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2022-04-28T14:38:02.439 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:02.439 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:02.439 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:02.439 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:02.439 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:02.439 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-04-28T14:38:02.439 INFO:teuthology.orchestra.run.smithi022.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-04-28T14:38:02.439 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-04-28T14:38:02.439 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-04-28T14:38:02.440 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-04-28T14:38:02.440 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-04-28T14:38:02.440 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-6.2-6.el8.noarch 2022-04-28T14:38:02.440 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-04-28T14:38:02.440 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-04-28T14:38:02.440 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako-1.0.6-13.el8.noarch 2022-04-28T14:38:02.440 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-04-28T14:38:02.440 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-04-28T14:38:02.440 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-04-28T14:38:02.441 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend-2.6-1.el8.noarch 2022-04-28T14:38:02.441 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-04-28T14:38:02.441 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pycparser-2.14-14.el8.noarch 2022-04-28T14:38:02.441 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz-2017.2-9.el8.noarch 2022-04-28T14:38:02.441 INFO:teuthology.orchestra.run.smithi022.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-04-28T14:38:02.441 INFO:teuthology.orchestra.run.smithi022.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-04-28T14:38:02.441 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-04-28T14:38:02.441 INFO:teuthology.orchestra.run.smithi022.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-04-28T14:38:02.441 INFO:teuthology.orchestra.run.smithi022.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-04-28T14:38:02.442 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-04-28T14:38:02.442 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-04-28T14:38:02.442 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-04-28T14:38:02.442 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-04-28T14:38:02.442 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:02.442 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2022-04-28T14:38:02.641 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-base 2022-04-28T14:38:02.670 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-osd-2:14.2.22-0.el8.x86_64 28/31 2022-04-28T14:38:02.946 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-2:14.2.22-0.el8.x86_64 27/31 2022-04-28T14:38:03.081 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-osd-2:14.2.22-0.el8.x86_64 28/31 2022-04-28T14:38:03.187 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-2:14.2.22-0.el8.x86_64 28/31 2022-04-28T14:38:03.232 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:02 ago on Thu 28 Apr 2022 02:37:01 PM UTC. 2022-04-28T14:38:03.287 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mon-2:14.2.22-0.el8.x86_64 29/31 2022-04-28T14:38:03.475 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mon-2:14.2.22-0.el8.x86_64 29/31 2022-04-28T14:38:03.606 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-osd-2:14.2.22-0.el8.x86_64 28/31 2022-04-28T14:38:03.662 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mds-2:14.2.22-0.el8.x86_64 30/31 2022-04-28T14:38:03.680 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mds-2:14.2.22-0.el8.x86_64 30/31 2022-04-28T14:38:03.770 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-2:14.2.22-0.el8.x86_64 29/31 2022-04-28T14:38:03.844 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-2:14.2.22-0.el8.x86_64 31/31 2022-04-28T14:38:03.958 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mon-2:14.2.22-0.el8.x86_64 29/31 2022-04-28T14:38:04.088 INFO:teuthology.orchestra.run.smithi022.stdout:Package ceph-base-2:14.2.22-0.el8.x86_64 is already installed. 2022-04-28T14:38:04.148 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2022-04-28T14:38:04.149 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2022-04-28T14:38:04.149 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2022-04-28T14:38:04.186 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-2:14.2.22-0.el8.x86_64 30/31 2022-04-28T14:38:04.204 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mds-2:14.2.22-0.el8.x86_64 30/31 2022-04-28T14:38:04.225 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-mgr 2022-04-28T14:38:04.249 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-2:14.2.22-0.el8.x86_64 31/31 2022-04-28T14:38:04.249 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-2:14.2.22-0.el8.x86_64 1/31 2022-04-28T14:38:04.250 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mds-2:14.2.22-0.el8.x86_64 2/31 2022-04-28T14:38:04.250 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-2:14.2.22-0.el8.x86_64 3/31 2022-04-28T14:38:04.250 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mon-2:14.2.22-0.el8.x86_64 4/31 2022-04-28T14:38:04.250 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-osd-2:14.2.22-0.el8.x86_64 5/31 2022-04-28T14:38:04.250 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 6/31 2022-04-28T14:38:04.250 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 7/31 2022-04-28T14:38:04.250 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 8/31 2022-04-28T14:38:04.250 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 9/31 2022-04-28T14:38:04.250 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 10/31 2022-04-28T14:38:04.250 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 11/31 2022-04-28T14:38:04.251 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 12/31 2022-04-28T14:38:04.251 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 13/31 2022-04-28T14:38:04.251 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 14/31 2022-04-28T14:38:04.251 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 15/31 2022-04-28T14:38:04.251 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 16/31 2022-04-28T14:38:04.251 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 17/31 2022-04-28T14:38:04.251 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 18/31 2022-04-28T14:38:04.251 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 19/31 2022-04-28T14:38:04.251 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 20/31 2022-04-28T14:38:04.252 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 21/31 2022-04-28T14:38:04.252 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 22/31 2022-04-28T14:38:04.252 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-portend-2.6-1.el8.noarch 23/31 2022-04-28T14:38:04.252 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 24/31 2022-04-28T14:38:04.252 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 25/31 2022-04-28T14:38:04.252 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 26/31 2022-04-28T14:38:04.252 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 27/31 2022-04-28T14:38:04.253 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 28/31 2022-04-28T14:38:04.253 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 29/31 2022-04-28T14:38:04.253 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 30/31 2022-04-28T14:38:04.360 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-2:14.2.22-0.el8.x86_64 31/31 2022-04-28T14:38:04.753 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-2:14.2.22-0.el8.x86_64 31/31 2022-04-28T14:38:04.754 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-2:14.2.22-0.el8.x86_64 1/31 2022-04-28T14:38:04.754 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-2:14.2.22-0.el8.x86_64 2/31 2022-04-28T14:38:04.754 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-2:14.2.22-0.el8.x86_64 3/31 2022-04-28T14:38:04.754 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-2:14.2.22-0.el8.x86_64 4/31 2022-04-28T14:38:04.754 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-2:14.2.22-0.el8.x86_64 5/31 2022-04-28T14:38:04.754 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 6/31 2022-04-28T14:38:04.754 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 7/31 2022-04-28T14:38:04.754 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 8/31 2022-04-28T14:38:04.755 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 9/31 2022-04-28T14:38:04.755 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 10/31 2022-04-28T14:38:04.755 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 11/31 2022-04-28T14:38:04.755 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 12/31 2022-04-28T14:38:04.755 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 13/31 2022-04-28T14:38:04.755 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 14/31 2022-04-28T14:38:04.755 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 15/31 2022-04-28T14:38:04.755 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 16/31 2022-04-28T14:38:04.755 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 17/31 2022-04-28T14:38:04.755 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 18/31 2022-04-28T14:38:04.756 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 19/31 2022-04-28T14:38:04.756 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 20/31 2022-04-28T14:38:04.756 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 21/31 2022-04-28T14:38:04.756 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 22/31 2022-04-28T14:38:04.756 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-portend-2.6-1.el8.noarch 23/31 2022-04-28T14:38:04.756 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 24/31 2022-04-28T14:38:04.756 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 25/31 2022-04-28T14:38:04.757 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 26/31 2022-04-28T14:38:04.757 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 27/31 2022-04-28T14:38:04.757 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 28/31 2022-04-28T14:38:04.757 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 29/31 2022-04-28T14:38:04.757 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 30/31 2022-04-28T14:38:04.810 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:03 ago on Thu 28 Apr 2022 02:37:01 PM UTC. 2022-04-28T14:38:05.237 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 31/31 2022-04-28T14:38:05.237 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:05.237 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2022-04-28T14:38:05.237 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:05.237 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mds-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:05.237 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:05.238 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mon-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:05.238 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-osd-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:05.238 INFO:teuthology.orchestra.run.smithi039.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-04-28T14:38:05.238 INFO:teuthology.orchestra.run.smithi039.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-04-28T14:38:05.238 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-04-28T14:38:05.238 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-04-28T14:38:05.238 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-04-28T14:38:05.238 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-04-28T14:38:05.238 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-6.2-6.el8.noarch 2022-04-28T14:38:05.239 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-04-28T14:38:05.239 INFO:teuthology.orchestra.run.smithi039.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-04-28T14:38:05.239 INFO:teuthology.orchestra.run.smithi039.stdout: python3-mako-1.0.6-13.el8.noarch 2022-04-28T14:38:05.239 INFO:teuthology.orchestra.run.smithi039.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-04-28T14:38:05.239 INFO:teuthology.orchestra.run.smithi039.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-04-28T14:38:05.239 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-04-28T14:38:05.239 INFO:teuthology.orchestra.run.smithi039.stdout: python3-portend-2.6-1.el8.noarch 2022-04-28T14:38:05.239 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-04-28T14:38:05.239 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pycparser-2.14-14.el8.noarch 2022-04-28T14:38:05.240 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pytz-2017.2-9.el8.noarch 2022-04-28T14:38:05.240 INFO:teuthology.orchestra.run.smithi039.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-04-28T14:38:05.240 INFO:teuthology.orchestra.run.smithi039.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-04-28T14:38:05.240 INFO:teuthology.orchestra.run.smithi039.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-04-28T14:38:05.240 INFO:teuthology.orchestra.run.smithi039.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-04-28T14:38:05.240 INFO:teuthology.orchestra.run.smithi039.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-04-28T14:38:05.240 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-04-28T14:38:05.240 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-04-28T14:38:05.240 INFO:teuthology.orchestra.run.smithi039.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-04-28T14:38:05.240 INFO:teuthology.orchestra.run.smithi039.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-04-28T14:38:05.241 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:05.241 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2022-04-28T14:38:05.473 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum -y install ceph-base 2022-04-28T14:38:05.630 INFO:teuthology.orchestra.run.smithi022.stdout:Package ceph-mgr-2:14.2.22-0.el8.x86_64 is already installed. 2022-04-28T14:38:05.688 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 31/31 2022-04-28T14:38:05.688 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:05.688 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2022-04-28T14:38:05.688 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:05.688 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:05.688 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:05.689 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:05.689 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:05.689 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-04-28T14:38:05.689 INFO:teuthology.orchestra.run.smithi037.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-04-28T14:38:05.689 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-04-28T14:38:05.689 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-04-28T14:38:05.689 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-04-28T14:38:05.689 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-04-28T14:38:05.689 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-6.2-6.el8.noarch 2022-04-28T14:38:05.690 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-04-28T14:38:05.690 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-04-28T14:38:05.690 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako-1.0.6-13.el8.noarch 2022-04-28T14:38:05.690 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-04-28T14:38:05.690 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-04-28T14:38:05.690 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-04-28T14:38:05.690 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend-2.6-1.el8.noarch 2022-04-28T14:38:05.690 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-04-28T14:38:05.690 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser-2.14-14.el8.noarch 2022-04-28T14:38:05.691 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz-2017.2-9.el8.noarch 2022-04-28T14:38:05.691 INFO:teuthology.orchestra.run.smithi037.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-04-28T14:38:05.691 INFO:teuthology.orchestra.run.smithi037.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-04-28T14:38:05.691 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-04-28T14:38:05.691 INFO:teuthology.orchestra.run.smithi037.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-04-28T14:38:05.691 INFO:teuthology.orchestra.run.smithi037.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-04-28T14:38:05.691 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-04-28T14:38:05.691 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-04-28T14:38:05.691 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-04-28T14:38:05.691 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-04-28T14:38:05.692 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:05.692 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-04-28T14:38:05.692 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2022-04-28T14:38:05.692 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2022-04-28T14:38:05.693 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2022-04-28T14:38:05.764 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-fuse 2022-04-28T14:38:05.921 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-base 2022-04-28T14:38:06.066 INFO:teuthology.orchestra.run.smithi039.stdout:Last metadata expiration check: 0:01:04 ago on Thu 28 Apr 2022 02:37:02 PM UTC. 2022-04-28T14:38:06.351 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:05 ago on Thu 28 Apr 2022 02:37:01 PM UTC. 2022-04-28T14:38:06.512 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:05 ago on Thu 28 Apr 2022 02:37:01 PM UTC. 2022-04-28T14:38:06.921 INFO:teuthology.orchestra.run.smithi039.stdout:Package ceph-base-2:14.2.22-0.el8.x86_64 is already installed. 2022-04-28T14:38:06.981 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2022-04-28T14:38:06.982 INFO:teuthology.orchestra.run.smithi039.stdout:Nothing to do. 2022-04-28T14:38:06.982 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2022-04-28T14:38:07.068 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum -y install ceph-mgr 2022-04-28T14:38:07.259 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2022-04-28T14:38:07.259 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:38:07.259 INFO:teuthology.orchestra.run.smithi022.stdout: Package Architecture Version Repository Size 2022-04-28T14:38:07.259 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:38:07.260 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2022-04-28T14:38:07.260 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse x86_64 2:14.2.22-0.el8 ceph 590 k 2022-04-28T14:38:07.260 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2022-04-28T14:38:07.260 INFO:teuthology.orchestra.run.smithi022.stdout: fuse x86_64 2.9.7-15.el8 CentOS-Base 83 k 2022-04-28T14:38:07.260 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:07.260 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2022-04-28T14:38:07.260 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:38:07.260 INFO:teuthology.orchestra.run.smithi022.stdout:Install 2 Packages 2022-04-28T14:38:07.260 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:07.261 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 673 k 2022-04-28T14:38:07.261 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 1.9 M 2022-04-28T14:38:07.261 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2022-04-28T14:38:07.314 INFO:teuthology.orchestra.run.smithi022.stdout:(1/2): ceph-fuse-14.2.22-0.el8.x86_64.rpm 11 MB/s | 590 kB 00:00 2022-04-28T14:38:07.348 INFO:teuthology.orchestra.run.smithi022.stdout:(2/2): fuse-2.9.7-15.el8.x86_64.rpm 958 kB/s | 83 kB 00:00 2022-04-28T14:38:07.348 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:38:07.349 INFO:teuthology.orchestra.run.smithi022.stdout:Total 7.4 MB/s | 673 kB 00:00 2022-04-28T14:38:07.359 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2022-04-28T14:38:07.369 INFO:teuthology.orchestra.run.smithi037.stdout:Package ceph-base-2:14.2.22-0.el8.x86_64 is already installed. 2022-04-28T14:38:07.382 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2022-04-28T14:38:07.382 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2022-04-28T14:38:07.429 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-04-28T14:38:07.430 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2022-04-28T14:38:07.430 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-04-28T14:38:07.456 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2022-04-28T14:38:07.459 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2022-04-28T14:38:07.503 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr 2022-04-28T14:38:07.625 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2022-04-28T14:38:07.657 INFO:teuthology.orchestra.run.smithi039.stdout:Last metadata expiration check: 0:01:05 ago on Thu 28 Apr 2022 02:37:02 PM UTC. 2022-04-28T14:38:07.878 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : fuse-2.9.7-15.el8.x86_64 1/2 2022-04-28T14:38:08.042 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-fuse-2:14.2.22-0.el8.x86_64 2/2 2022-04-28T14:38:08.091 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:07 ago on Thu 28 Apr 2022 02:37:01 PM UTC. 2022-04-28T14:38:08.417 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-fuse-2:14.2.22-0.el8.x86_64 2/2 2022-04-28T14:38:08.417 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-fuse-2:14.2.22-0.el8.x86_64 1/2 2022-04-28T14:38:08.512 INFO:teuthology.orchestra.run.smithi039.stdout:Package ceph-mgr-2:14.2.22-0.el8.x86_64 is already installed. 2022-04-28T14:38:08.572 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2022-04-28T14:38:08.573 INFO:teuthology.orchestra.run.smithi039.stdout:Nothing to do. 2022-04-28T14:38:08.573 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2022-04-28T14:38:08.674 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum -y install ceph-fuse 2022-04-28T14:38:08.785 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 2/2 2022-04-28T14:38:08.785 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:08.785 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2022-04-28T14:38:08.785 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse-2:14.2.22-0.el8.x86_64 fuse-2.9.7-15.el8.x86_64 2022-04-28T14:38:08.785 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:08.785 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2022-04-28T14:38:08.947 INFO:teuthology.orchestra.run.smithi037.stdout:Package ceph-mgr-2:14.2.22-0.el8.x86_64 is already installed. 2022-04-28T14:38:08.982 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install librados-devel 2022-04-28T14:38:09.006 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-04-28T14:38:09.007 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2022-04-28T14:38:09.008 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-04-28T14:38:09.087 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-fuse 2022-04-28T14:38:09.263 INFO:teuthology.orchestra.run.smithi039.stdout:Last metadata expiration check: 0:01:07 ago on Thu 28 Apr 2022 02:37:02 PM UTC. 2022-04-28T14:38:09.581 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:08 ago on Thu 28 Apr 2022 02:37:01 PM UTC. 2022-04-28T14:38:09.681 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:08 ago on Thu 28 Apr 2022 02:37:01 PM UTC. 2022-04-28T14:38:10.191 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2022-04-28T14:38:10.191 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:38:10.191 INFO:teuthology.orchestra.run.smithi039.stdout: Package Architecture Version Repository Size 2022-04-28T14:38:10.191 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:38:10.192 INFO:teuthology.orchestra.run.smithi039.stdout:Installing: 2022-04-28T14:38:10.192 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-fuse x86_64 2:14.2.22-0.el8 ceph 590 k 2022-04-28T14:38:10.192 INFO:teuthology.orchestra.run.smithi039.stdout:Installing dependencies: 2022-04-28T14:38:10.192 INFO:teuthology.orchestra.run.smithi039.stdout: fuse x86_64 2.9.7-15.el8 CentOS-Base 83 k 2022-04-28T14:38:10.192 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:10.192 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2022-04-28T14:38:10.192 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:38:10.192 INFO:teuthology.orchestra.run.smithi039.stdout:Install 2 Packages 2022-04-28T14:38:10.192 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:10.193 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 673 k 2022-04-28T14:38:10.193 INFO:teuthology.orchestra.run.smithi039.stdout:Installed size: 1.9 M 2022-04-28T14:38:10.193 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2022-04-28T14:38:10.271 INFO:teuthology.orchestra.run.smithi039.stdout:(1/2): ceph-fuse-14.2.22-0.el8.x86_64.rpm 7.4 MB/s | 590 kB 00:00 2022-04-28T14:38:10.296 INFO:teuthology.orchestra.run.smithi039.stdout:(2/2): fuse-2.9.7-15.el8.x86_64.rpm 804 kB/s | 83 kB 00:00 2022-04-28T14:38:10.297 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:38:10.297 INFO:teuthology.orchestra.run.smithi039.stdout:Total 6.2 MB/s | 673 kB 00:00 2022-04-28T14:38:10.308 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2022-04-28T14:38:10.331 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2022-04-28T14:38:10.332 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2022-04-28T14:38:10.407 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2022-04-28T14:38:10.410 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2022-04-28T14:38:10.507 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2022-04-28T14:38:10.508 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:38:10.508 INFO:teuthology.orchestra.run.smithi022.stdout: Package Architecture Version Repository Size 2022-04-28T14:38:10.508 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:38:10.508 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2022-04-28T14:38:10.508 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel x86_64 2:14.2.22-0.el8 ceph 90 k 2022-04-28T14:38:10.508 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:10.508 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2022-04-28T14:38:10.508 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:38:10.509 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2022-04-28T14:38:10.509 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:10.509 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 90 k 2022-04-28T14:38:10.509 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 310 k 2022-04-28T14:38:10.509 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2022-04-28T14:38:10.546 INFO:teuthology.orchestra.run.smithi022.stdout:librados-devel-14.2.22-0.el8.x86_64.rpm 2.4 MB/s | 90 kB 00:00 2022-04-28T14:38:10.547 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:38:10.547 INFO:teuthology.orchestra.run.smithi022.stdout:Total 2.3 MB/s | 90 kB 00:00 2022-04-28T14:38:10.547 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2022-04-28T14:38:10.558 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2022-04-28T14:38:10.558 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2022-04-28T14:38:10.591 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2022-04-28T14:38:10.596 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-04-28T14:38:10.597 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:38:10.597 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2022-04-28T14:38:10.597 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:38:10.597 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2022-04-28T14:38:10.597 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse x86_64 2:14.2.22-0.el8 ceph 590 k 2022-04-28T14:38:10.597 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2022-04-28T14:38:10.597 INFO:teuthology.orchestra.run.smithi037.stdout: fuse x86_64 2.9.7-15.el8 CentOS-Base 83 k 2022-04-28T14:38:10.598 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:10.598 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-04-28T14:38:10.598 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:38:10.598 INFO:teuthology.orchestra.run.smithi037.stdout:Install 2 Packages 2022-04-28T14:38:10.598 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:10.599 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 673 k 2022-04-28T14:38:10.599 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 1.9 M 2022-04-28T14:38:10.599 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2022-04-28T14:38:10.615 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2022-04-28T14:38:10.618 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2022-04-28T14:38:10.664 INFO:teuthology.orchestra.run.smithi037.stdout:(1/2): ceph-fuse-14.2.22-0.el8.x86_64.rpm 8.9 MB/s | 590 kB 00:00 2022-04-28T14:38:10.680 INFO:teuthology.orchestra.run.smithi037.stdout:(2/2): fuse-2.9.7-15.el8.x86_64.rpm 1.0 MB/s | 83 kB 00:00 2022-04-28T14:38:10.681 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:38:10.682 INFO:teuthology.orchestra.run.smithi037.stdout:Total 7.8 MB/s | 673 kB 00:00 2022-04-28T14:38:10.692 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2022-04-28T14:38:10.714 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2022-04-28T14:38:10.715 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2022-04-28T14:38:10.735 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2022-04-28T14:38:10.789 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2022-04-28T14:38:10.793 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2022-04-28T14:38:10.861 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : fuse-2.9.7-15.el8.x86_64 1/2 2022-04-28T14:38:10.925 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librados-devel-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:10.976 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2022-04-28T14:38:11.084 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-fuse-2:14.2.22-0.el8.x86_64 2/2 2022-04-28T14:38:11.183 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados-devel-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:11.245 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fuse-2.9.7-15.el8.x86_64 1/2 2022-04-28T14:38:11.451 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-2:14.2.22-0.el8.x86_64 2/2 2022-04-28T14:38:11.477 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-fuse-2:14.2.22-0.el8.x86_64 2/2 2022-04-28T14:38:11.478 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-fuse-2:14.2.22-0.el8.x86_64 1/2 2022-04-28T14:38:11.841 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-fuse-2:14.2.22-0.el8.x86_64 2/2 2022-04-28T14:38:11.841 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-2:14.2.22-0.el8.x86_64 1/2 2022-04-28T14:38:11.861 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 2/2 2022-04-28T14:38:11.861 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:11.861 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2022-04-28T14:38:11.861 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-fuse-2:14.2.22-0.el8.x86_64 fuse-2.9.7-15.el8.x86_64 2022-04-28T14:38:11.861 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:11.861 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2022-04-28T14:38:12.047 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum -y install librados-devel 2022-04-28T14:38:12.052 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados-devel-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:12.053 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:12.053 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2022-04-28T14:38:12.053 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:12.053 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:12.053 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2022-04-28T14:38:12.248 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 2/2 2022-04-28T14:38:12.248 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:12.248 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2022-04-28T14:38:12.248 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-2:14.2.22-0.el8.x86_64 fuse-2.9.7-15.el8.x86_64 2022-04-28T14:38:12.248 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:12.248 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-04-28T14:38:12.259 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install libcephfs2 2022-04-28T14:38:12.443 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install librados-devel 2022-04-28T14:38:12.645 INFO:teuthology.orchestra.run.smithi039.stdout:Last metadata expiration check: 0:01:10 ago on Thu 28 Apr 2022 02:37:02 PM UTC. 2022-04-28T14:38:12.855 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:11 ago on Thu 28 Apr 2022 02:37:01 PM UTC. 2022-04-28T14:38:13.037 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:12 ago on Thu 28 Apr 2022 02:37:01 PM UTC. 2022-04-28T14:38:13.571 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2022-04-28T14:38:13.572 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:38:13.572 INFO:teuthology.orchestra.run.smithi039.stdout: Package Architecture Version Repository Size 2022-04-28T14:38:13.572 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:38:13.572 INFO:teuthology.orchestra.run.smithi039.stdout:Installing: 2022-04-28T14:38:13.572 INFO:teuthology.orchestra.run.smithi039.stdout: librados-devel x86_64 2:14.2.22-0.el8 ceph 90 k 2022-04-28T14:38:13.572 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:13.572 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2022-04-28T14:38:13.573 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:38:13.573 INFO:teuthology.orchestra.run.smithi039.stdout:Install 1 Package 2022-04-28T14:38:13.573 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:13.573 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 90 k 2022-04-28T14:38:13.573 INFO:teuthology.orchestra.run.smithi039.stdout:Installed size: 310 k 2022-04-28T14:38:13.573 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2022-04-28T14:38:13.618 INFO:teuthology.orchestra.run.smithi039.stdout:librados-devel-14.2.22-0.el8.x86_64.rpm 2.0 MB/s | 90 kB 00:00 2022-04-28T14:38:13.619 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:38:13.619 INFO:teuthology.orchestra.run.smithi039.stdout:Total 1.9 MB/s | 90 kB 00:00 2022-04-28T14:38:13.619 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2022-04-28T14:38:13.630 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2022-04-28T14:38:13.630 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2022-04-28T14:38:13.685 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2022-04-28T14:38:13.688 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2022-04-28T14:38:13.700 INFO:teuthology.orchestra.run.smithi022.stdout:Package libcephfs2-2:14.2.22-0.el8.x86_64 is already installed. 2022-04-28T14:38:13.760 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2022-04-28T14:38:13.761 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2022-04-28T14:38:13.761 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2022-04-28T14:38:13.790 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2022-04-28T14:38:13.842 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install libcephfs-devel 2022-04-28T14:38:13.952 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-04-28T14:38:13.953 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:38:13.953 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2022-04-28T14:38:13.953 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:38:13.953 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2022-04-28T14:38:13.954 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:14.2.22-0.el8 ceph 90 k 2022-04-28T14:38:13.954 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:13.954 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-04-28T14:38:13.954 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:38:13.954 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2022-04-28T14:38:13.954 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:13.954 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 90 k 2022-04-28T14:38:13.954 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 310 k 2022-04-28T14:38:13.954 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2022-04-28T14:38:14.001 INFO:teuthology.orchestra.run.smithi037.stdout:librados-devel-14.2.22-0.el8.x86_64.rpm 1.9 MB/s | 90 kB 00:00 2022-04-28T14:38:14.002 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:38:14.002 INFO:teuthology.orchestra.run.smithi037.stdout:Total 1.8 MB/s | 90 kB 00:00 2022-04-28T14:38:14.002 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2022-04-28T14:38:14.008 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librados-devel-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:14.013 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2022-04-28T14:38:14.013 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2022-04-28T14:38:14.072 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2022-04-28T14:38:14.075 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2022-04-28T14:38:14.219 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2022-04-28T14:38:14.261 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librados-devel-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:14.432 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:13 ago on Thu 28 Apr 2022 02:37:01 PM UTC. 2022-04-28T14:38:14.458 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:14.655 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados-devel-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:14.656 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:14.656 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2022-04-28T14:38:14.656 INFO:teuthology.orchestra.run.smithi039.stdout: librados-devel-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:14.656 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:14.656 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2022-04-28T14:38:14.721 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados-devel-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:14.852 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum -y install libcephfs2 2022-04-28T14:38:15.172 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:15.173 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:15.173 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2022-04-28T14:38:15.173 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:15.173 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:15.173 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-04-28T14:38:15.360 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2022-04-28T14:38:15.361 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:38:15.361 INFO:teuthology.orchestra.run.smithi022.stdout: Package Architecture Version Repository Size 2022-04-28T14:38:15.361 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:38:15.361 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2022-04-28T14:38:15.361 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel x86_64 2:14.2.22-0.el8 ceph 22 k 2022-04-28T14:38:15.361 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:15.361 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2022-04-28T14:38:15.361 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:38:15.361 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2022-04-28T14:38:15.362 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:15.362 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 22 k 2022-04-28T14:38:15.362 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 77 k 2022-04-28T14:38:15.362 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2022-04-28T14:38:15.398 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install libcephfs2 2022-04-28T14:38:15.407 INFO:teuthology.orchestra.run.smithi022.stdout:libcephfs-devel-14.2.22-0.el8.x86_64.rpm 479 kB/s | 22 kB 00:00 2022-04-28T14:38:15.408 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:38:15.408 INFO:teuthology.orchestra.run.smithi022.stdout:Total 467 kB/s | 22 kB 00:00 2022-04-28T14:38:15.408 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2022-04-28T14:38:15.411 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2022-04-28T14:38:15.412 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2022-04-28T14:38:15.413 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2022-04-28T14:38:15.416 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2022-04-28T14:38:15.446 INFO:teuthology.orchestra.run.smithi039.stdout:Last metadata expiration check: 0:01:13 ago on Thu 28 Apr 2022 02:37:02 PM UTC. 2022-04-28T14:38:15.486 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2022-04-28T14:38:15.632 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs-devel-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:15.864 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephfs-devel-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:15.989 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:14 ago on Thu 28 Apr 2022 02:37:01 PM UTC. 2022-04-28T14:38:16.208 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs-devel-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:16.208 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:16.208 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2022-04-28T14:38:16.208 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:16.208 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:16.208 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2022-04-28T14:38:16.297 INFO:teuthology.orchestra.run.smithi039.stdout:Package libcephfs2-2:14.2.22-0.el8.x86_64 is already installed. 2022-04-28T14:38:16.311 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install librados2 2022-04-28T14:38:16.358 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2022-04-28T14:38:16.359 INFO:teuthology.orchestra.run.smithi039.stdout:Nothing to do. 2022-04-28T14:38:16.360 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2022-04-28T14:38:16.440 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum -y install libcephfs-devel 2022-04-28T14:38:16.844 INFO:teuthology.orchestra.run.smithi037.stdout:Package libcephfs2-2:14.2.22-0.el8.x86_64 is already installed. 2022-04-28T14:38:16.900 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:15 ago on Thu 28 Apr 2022 02:37:01 PM UTC. 2022-04-28T14:38:16.903 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-04-28T14:38:16.905 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2022-04-28T14:38:16.905 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-04-28T14:38:17.000 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install libcephfs-devel 2022-04-28T14:38:17.028 INFO:teuthology.orchestra.run.smithi039.stdout:Last metadata expiration check: 0:01:15 ago on Thu 28 Apr 2022 02:37:02 PM UTC. 2022-04-28T14:38:17.585 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:16 ago on Thu 28 Apr 2022 02:37:01 PM UTC. 2022-04-28T14:38:17.758 INFO:teuthology.orchestra.run.smithi022.stdout:Package librados2-2:14.2.22-0.el8.x86_64 is already installed. 2022-04-28T14:38:17.821 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2022-04-28T14:38:17.822 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2022-04-28T14:38:17.822 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2022-04-28T14:38:17.939 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2022-04-28T14:38:17.940 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:38:17.940 INFO:teuthology.orchestra.run.smithi039.stdout: Package Architecture Version Repository Size 2022-04-28T14:38:17.940 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:38:17.940 INFO:teuthology.orchestra.run.smithi039.stdout:Installing: 2022-04-28T14:38:17.940 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs-devel x86_64 2:14.2.22-0.el8 ceph 22 k 2022-04-28T14:38:17.940 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:17.940 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2022-04-28T14:38:17.941 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:38:17.941 INFO:teuthology.orchestra.run.smithi039.stdout:Install 1 Package 2022-04-28T14:38:17.941 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:17.941 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 22 k 2022-04-28T14:38:17.942 INFO:teuthology.orchestra.run.smithi039.stdout:Installed size: 77 k 2022-04-28T14:38:17.942 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2022-04-28T14:38:17.987 INFO:teuthology.orchestra.run.smithi039.stdout:libcephfs-devel-14.2.22-0.el8.x86_64.rpm 472 kB/s | 22 kB 00:00 2022-04-28T14:38:17.988 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:38:17.988 INFO:teuthology.orchestra.run.smithi039.stdout:Total 461 kB/s | 22 kB 00:00 2022-04-28T14:38:17.988 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2022-04-28T14:38:17.991 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2022-04-28T14:38:17.991 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2022-04-28T14:38:17.993 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2022-04-28T14:38:17.996 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2022-04-28T14:38:18.037 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install librbd1 2022-04-28T14:38:18.042 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2022-04-28T14:38:18.470 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-04-28T14:38:18.471 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:38:18.471 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2022-04-28T14:38:18.471 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:38:18.471 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2022-04-28T14:38:18.471 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:14.2.22-0.el8 ceph 22 k 2022-04-28T14:38:18.472 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:18.472 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-04-28T14:38:18.472 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:38:18.472 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2022-04-28T14:38:18.472 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:18.472 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 22 k 2022-04-28T14:38:18.472 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 77 k 2022-04-28T14:38:18.472 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2022-04-28T14:38:18.615 INFO:teuthology.orchestra.run.smithi037.stdout:libcephfs-devel-14.2.22-0.el8.x86_64.rpm 151 kB/s | 22 kB 00:00 2022-04-28T14:38:18.616 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:38:18.616 INFO:teuthology.orchestra.run.smithi037.stdout:Total 149 kB/s | 22 kB 00:00 2022-04-28T14:38:18.616 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2022-04-28T14:38:18.619 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2022-04-28T14:38:18.619 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2022-04-28T14:38:18.621 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2022-04-28T14:38:18.624 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2022-04-28T14:38:18.626 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:17 ago on Thu 28 Apr 2022 02:37:01 PM UTC. 2022-04-28T14:38:18.680 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2022-04-28T14:38:18.866 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs-devel-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:18.977 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephfs-devel-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:19.138 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs-devel-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:19.496 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libcephfs-devel-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:19.522 INFO:teuthology.orchestra.run.smithi022.stdout:Package librbd1-2:14.2.22-0.el8.x86_64 is already installed. 2022-04-28T14:38:19.583 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2022-04-28T14:38:19.584 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2022-04-28T14:38:19.584 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2022-04-28T14:38:19.663 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install rbd-fuse 2022-04-28T14:38:20.251 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:19 ago on Thu 28 Apr 2022 02:37:01 PM UTC. 2022-04-28T14:38:20.257 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephfs-devel-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:20.257 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:20.257 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2022-04-28T14:38:20.257 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs-devel-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:20.257 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:20.257 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2022-04-28T14:38:20.307 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs-devel-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:20.307 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:20.307 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2022-04-28T14:38:20.307 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:20.307 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:20.307 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-04-28T14:38:20.395 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum -y install librados2 2022-04-28T14:38:20.513 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install librados2 2022-04-28T14:38:20.986 INFO:teuthology.orchestra.run.smithi039.stdout:Last metadata expiration check: 0:01:18 ago on Thu 28 Apr 2022 02:37:02 PM UTC. 2022-04-28T14:38:21.103 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:20 ago on Thu 28 Apr 2022 02:37:01 PM UTC. 2022-04-28T14:38:21.167 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2022-04-28T14:38:21.168 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:38:21.168 INFO:teuthology.orchestra.run.smithi022.stdout: Package Architecture Version Repository Size 2022-04-28T14:38:21.168 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:38:21.168 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2022-04-28T14:38:21.168 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse x86_64 2:14.2.22-0.el8 ceph 73 k 2022-04-28T14:38:21.168 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:21.168 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2022-04-28T14:38:21.168 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:38:21.168 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2022-04-28T14:38:21.169 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:21.169 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 73 k 2022-04-28T14:38:21.169 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 188 k 2022-04-28T14:38:21.169 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2022-04-28T14:38:21.218 INFO:teuthology.orchestra.run.smithi022.stdout:rbd-fuse-14.2.22-0.el8.x86_64.rpm 1.5 MB/s | 73 kB 00:00 2022-04-28T14:38:21.219 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:38:21.219 INFO:teuthology.orchestra.run.smithi022.stdout:Total 1.4 MB/s | 73 kB 00:00 2022-04-28T14:38:21.219 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2022-04-28T14:38:21.230 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2022-04-28T14:38:21.230 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2022-04-28T14:38:21.280 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2022-04-28T14:38:21.283 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2022-04-28T14:38:21.408 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2022-04-28T14:38:21.622 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-fuse-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:21.836 INFO:teuthology.orchestra.run.smithi039.stdout:Package librados2-2:14.2.22-0.el8.x86_64 is already installed. 2022-04-28T14:38:21.868 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-fuse-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:21.899 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2022-04-28T14:38:21.900 INFO:teuthology.orchestra.run.smithi039.stdout:Nothing to do. 2022-04-28T14:38:21.900 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2022-04-28T14:38:21.967 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-2:14.2.22-0.el8.x86_64 is already installed. 2022-04-28T14:38:21.981 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum -y install librbd1 2022-04-28T14:38:22.027 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-04-28T14:38:22.028 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2022-04-28T14:38:22.028 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-04-28T14:38:22.127 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install librbd1 2022-04-28T14:38:22.266 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-fuse-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:22.283 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:22.284 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2022-04-28T14:38:22.284 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:22.284 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:22.284 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2022-04-28T14:38:22.487 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install rbd-mirror 2022-04-28T14:38:22.569 INFO:teuthology.orchestra.run.smithi039.stdout:Last metadata expiration check: 0:01:20 ago on Thu 28 Apr 2022 02:37:02 PM UTC. 2022-04-28T14:38:22.714 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:21 ago on Thu 28 Apr 2022 02:37:01 PM UTC. 2022-04-28T14:38:23.075 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:22 ago on Thu 28 Apr 2022 02:37:01 PM UTC. 2022-04-28T14:38:23.425 INFO:teuthology.orchestra.run.smithi039.stdout:Package librbd1-2:14.2.22-0.el8.x86_64 is already installed. 2022-04-28T14:38:23.485 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2022-04-28T14:38:23.486 INFO:teuthology.orchestra.run.smithi039.stdout:Nothing to do. 2022-04-28T14:38:23.486 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2022-04-28T14:38:23.563 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum -y install rbd-fuse 2022-04-28T14:38:23.585 INFO:teuthology.orchestra.run.smithi037.stdout:Package librbd1-2:14.2.22-0.el8.x86_64 is already installed. 2022-04-28T14:38:23.645 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-04-28T14:38:23.646 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2022-04-28T14:38:23.646 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-04-28T14:38:23.747 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install rbd-fuse 2022-04-28T14:38:23.985 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2022-04-28T14:38:23.987 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:38:23.987 INFO:teuthology.orchestra.run.smithi022.stdout: Package Architecture Version Repository Size 2022-04-28T14:38:23.987 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:38:23.987 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2022-04-28T14:38:23.988 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror x86_64 2:14.2.22-0.el8 ceph 2.3 M 2022-04-28T14:38:23.988 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:23.988 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2022-04-28T14:38:23.988 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:38:23.988 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2022-04-28T14:38:23.989 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:23.989 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 2.3 M 2022-04-28T14:38:23.989 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 8.4 M 2022-04-28T14:38:23.989 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2022-04-28T14:38:24.071 INFO:teuthology.orchestra.run.smithi022.stdout:rbd-mirror-14.2.22-0.el8.x86_64.rpm 28 MB/s | 2.3 MB 00:00 2022-04-28T14:38:24.071 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:38:24.072 INFO:teuthology.orchestra.run.smithi022.stdout:Total 27 MB/s | 2.3 MB 00:00 2022-04-28T14:38:24.072 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2022-04-28T14:38:24.085 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2022-04-28T14:38:24.085 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2022-04-28T14:38:24.143 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2022-04-28T14:38:24.146 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2022-04-28T14:38:24.153 INFO:teuthology.orchestra.run.smithi039.stdout:Last metadata expiration check: 0:01:22 ago on Thu 28 Apr 2022 02:37:02 PM UTC. 2022-04-28T14:38:24.335 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:23 ago on Thu 28 Apr 2022 02:37:01 PM UTC. 2022-04-28T14:38:24.467 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2022-04-28T14:38:24.666 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-mirror-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:25.044 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-mirror-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:25.078 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2022-04-28T14:38:25.078 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:38:25.078 INFO:teuthology.orchestra.run.smithi039.stdout: Package Architecture Version Repository Size 2022-04-28T14:38:25.078 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:38:25.078 INFO:teuthology.orchestra.run.smithi039.stdout:Installing: 2022-04-28T14:38:25.079 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-fuse x86_64 2:14.2.22-0.el8 ceph 73 k 2022-04-28T14:38:25.079 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:25.079 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2022-04-28T14:38:25.079 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:38:25.079 INFO:teuthology.orchestra.run.smithi039.stdout:Install 1 Package 2022-04-28T14:38:25.079 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:25.080 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 73 k 2022-04-28T14:38:25.080 INFO:teuthology.orchestra.run.smithi039.stdout:Installed size: 188 k 2022-04-28T14:38:25.080 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2022-04-28T14:38:25.123 INFO:teuthology.orchestra.run.smithi039.stdout:rbd-fuse-14.2.22-0.el8.x86_64.rpm 1.6 MB/s | 73 kB 00:00 2022-04-28T14:38:25.124 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:38:25.124 INFO:teuthology.orchestra.run.smithi039.stdout:Total 1.6 MB/s | 73 kB 00:00 2022-04-28T14:38:25.124 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2022-04-28T14:38:25.136 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2022-04-28T14:38:25.136 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2022-04-28T14:38:25.184 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2022-04-28T14:38:25.187 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2022-04-28T14:38:25.259 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-04-28T14:38:25.260 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:38:25.260 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2022-04-28T14:38:25.260 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:38:25.261 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2022-04-28T14:38:25.261 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:14.2.22-0.el8 ceph 73 k 2022-04-28T14:38:25.261 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:25.261 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-04-28T14:38:25.261 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:38:25.261 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2022-04-28T14:38:25.261 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:25.262 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 73 k 2022-04-28T14:38:25.262 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 188 k 2022-04-28T14:38:25.262 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2022-04-28T14:38:25.325 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2022-04-28T14:38:25.337 INFO:teuthology.orchestra.run.smithi037.stdout:rbd-fuse-14.2.22-0.el8.x86_64.rpm 968 kB/s | 73 kB 00:00 2022-04-28T14:38:25.338 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:38:25.338 INFO:teuthology.orchestra.run.smithi037.stdout:Total 953 kB/s | 73 kB 00:00 2022-04-28T14:38:25.338 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2022-04-28T14:38:25.349 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2022-04-28T14:38:25.350 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2022-04-28T14:38:25.399 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2022-04-28T14:38:25.402 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2022-04-28T14:38:25.425 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-mirror-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:25.425 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:25.425 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2022-04-28T14:38:25.425 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:25.425 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:25.425 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2022-04-28T14:38:25.517 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2022-04-28T14:38:25.573 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-fuse-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:25.592 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install rbd-nbd 2022-04-28T14:38:25.723 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:25.824 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: rbd-fuse-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:25.959 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-fuse-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:26.184 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:25 ago on Thu 28 Apr 2022 02:37:01 PM UTC. 2022-04-28T14:38:26.211 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-fuse-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:26.211 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:26.211 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2022-04-28T14:38:26.211 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-fuse-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:26.212 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:26.212 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2022-04-28T14:38:26.352 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:26.352 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:26.352 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2022-04-28T14:38:26.353 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:26.353 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:26.353 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-04-28T14:38:26.385 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum -y install rbd-mirror 2022-04-28T14:38:26.584 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install rbd-mirror 2022-04-28T14:38:26.972 INFO:teuthology.orchestra.run.smithi039.stdout:Last metadata expiration check: 0:01:24 ago on Thu 28 Apr 2022 02:37:02 PM UTC. 2022-04-28T14:38:27.107 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2022-04-28T14:38:27.108 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:38:27.108 INFO:teuthology.orchestra.run.smithi022.stdout: Package Architecture Version Repository Size 2022-04-28T14:38:27.108 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:38:27.108 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2022-04-28T14:38:27.108 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd x86_64 2:14.2.22-0.el8 ceph 142 k 2022-04-28T14:38:27.108 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:27.108 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2022-04-28T14:38:27.109 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:38:27.109 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2022-04-28T14:38:27.109 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:27.109 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 142 k 2022-04-28T14:38:27.109 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 422 k 2022-04-28T14:38:27.109 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2022-04-28T14:38:27.158 INFO:teuthology.orchestra.run.smithi022.stdout:rbd-nbd-14.2.22-0.el8.x86_64.rpm 2.8 MB/s | 142 kB 00:00 2022-04-28T14:38:27.159 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:38:27.159 INFO:teuthology.orchestra.run.smithi022.stdout:Total 2.7 MB/s | 142 kB 00:00 2022-04-28T14:38:27.159 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2022-04-28T14:38:27.171 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2022-04-28T14:38:27.171 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2022-04-28T14:38:27.173 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:26 ago on Thu 28 Apr 2022 02:37:01 PM UTC. 2022-04-28T14:38:27.229 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2022-04-28T14:38:27.232 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2022-04-28T14:38:27.352 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2022-04-28T14:38:27.521 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-nbd-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:27.760 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-nbd-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:27.891 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2022-04-28T14:38:27.892 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:38:27.892 INFO:teuthology.orchestra.run.smithi039.stdout: Package Architecture Version Repository Size 2022-04-28T14:38:27.892 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:38:27.892 INFO:teuthology.orchestra.run.smithi039.stdout:Installing: 2022-04-28T14:38:27.892 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-mirror x86_64 2:14.2.22-0.el8 ceph 2.3 M 2022-04-28T14:38:27.892 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:27.893 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2022-04-28T14:38:27.893 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:38:27.893 INFO:teuthology.orchestra.run.smithi039.stdout:Install 1 Package 2022-04-28T14:38:27.893 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:27.893 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 2.3 M 2022-04-28T14:38:27.893 INFO:teuthology.orchestra.run.smithi039.stdout:Installed size: 8.4 M 2022-04-28T14:38:27.893 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2022-04-28T14:38:27.976 INFO:teuthology.orchestra.run.smithi039.stdout:rbd-mirror-14.2.22-0.el8.x86_64.rpm 28 MB/s | 2.3 MB 00:00 2022-04-28T14:38:27.977 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:38:27.977 INFO:teuthology.orchestra.run.smithi039.stdout:Total 28 MB/s | 2.3 MB 00:00 2022-04-28T14:38:27.977 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2022-04-28T14:38:27.990 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2022-04-28T14:38:27.990 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2022-04-28T14:38:28.048 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2022-04-28T14:38:28.051 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2022-04-28T14:38:28.085 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-04-28T14:38:28.086 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:38:28.086 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2022-04-28T14:38:28.086 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:38:28.087 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2022-04-28T14:38:28.087 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:14.2.22-0.el8 ceph 2.3 M 2022-04-28T14:38:28.087 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:28.087 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-04-28T14:38:28.087 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:38:28.087 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2022-04-28T14:38:28.087 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:28.087 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 2.3 M 2022-04-28T14:38:28.087 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 8.4 M 2022-04-28T14:38:28.088 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2022-04-28T14:38:28.142 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-nbd-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:28.142 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:28.142 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2022-04-28T14:38:28.142 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:28.143 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:28.143 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2022-04-28T14:38:28.208 INFO:teuthology.orchestra.run.smithi037.stdout:rbd-mirror-14.2.22-0.el8.x86_64.rpm 19 MB/s | 2.3 MB 00:00 2022-04-28T14:38:28.209 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:38:28.209 INFO:teuthology.orchestra.run.smithi037.stdout:Total 19 MB/s | 2.3 MB 00:00 2022-04-28T14:38:28.209 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2022-04-28T14:38:28.222 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2022-04-28T14:38:28.222 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2022-04-28T14:38:28.279 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2022-04-28T14:38:28.282 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2022-04-28T14:38:28.375 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2022-04-28T14:38:28.575 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-mirror-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:28.596 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2022-04-28T14:38:28.783 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:28.808 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install librados2 2022-04-28T14:38:28.952 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: rbd-mirror-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:29.238 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-mirror-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:29.395 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-mirror-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:29.395 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:29.395 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2022-04-28T14:38:29.396 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-mirror-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:29.396 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:29.396 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2022-04-28T14:38:29.408 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:28 ago on Thu 28 Apr 2022 02:37:01 PM UTC. 2022-04-28T14:38:29.600 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum -y install rbd-nbd 2022-04-28T14:38:29.610 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:29.610 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:29.610 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2022-04-28T14:38:29.610 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:29.610 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:29.611 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-04-28T14:38:29.792 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install rbd-nbd 2022-04-28T14:38:30.195 INFO:teuthology.orchestra.run.smithi039.stdout:Last metadata expiration check: 0:01:28 ago on Thu 28 Apr 2022 02:37:02 PM UTC. 2022-04-28T14:38:30.260 INFO:teuthology.orchestra.run.smithi022.stdout:Package librados2-2:14.2.22-0.el8.x86_64 is already installed. 2022-04-28T14:38:30.321 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2022-04-28T14:38:30.322 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2022-04-28T14:38:30.322 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2022-04-28T14:38:30.384 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:29 ago on Thu 28 Apr 2022 02:37:01 PM UTC. 2022-04-28T14:38:30.395 DEBUG:teuthology.parallel:result is None 2022-04-28T14:38:31.142 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2022-04-28T14:38:31.143 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:38:31.143 INFO:teuthology.orchestra.run.smithi039.stdout: Package Architecture Version Repository Size 2022-04-28T14:38:31.143 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:38:31.143 INFO:teuthology.orchestra.run.smithi039.stdout:Installing: 2022-04-28T14:38:31.143 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-nbd x86_64 2:14.2.22-0.el8 ceph 142 k 2022-04-28T14:38:31.143 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:31.144 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2022-04-28T14:38:31.144 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2022-04-28T14:38:31.144 INFO:teuthology.orchestra.run.smithi039.stdout:Install 1 Package 2022-04-28T14:38:31.144 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:31.144 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 142 k 2022-04-28T14:38:31.144 INFO:teuthology.orchestra.run.smithi039.stdout:Installed size: 422 k 2022-04-28T14:38:31.144 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2022-04-28T14:38:31.215 INFO:teuthology.orchestra.run.smithi039.stdout:rbd-nbd-14.2.22-0.el8.x86_64.rpm 2.0 MB/s | 142 kB 00:00 2022-04-28T14:38:31.215 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:38:31.216 INFO:teuthology.orchestra.run.smithi039.stdout:Total 1.9 MB/s | 142 kB 00:00 2022-04-28T14:38:31.216 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2022-04-28T14:38:31.227 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2022-04-28T14:38:31.227 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2022-04-28T14:38:31.285 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2022-04-28T14:38:31.288 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2022-04-28T14:38:31.299 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-04-28T14:38:31.299 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:38:31.300 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2022-04-28T14:38:31.300 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:38:31.300 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2022-04-28T14:38:31.300 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:14.2.22-0.el8 ceph 142 k 2022-04-28T14:38:31.300 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:31.300 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-04-28T14:38:31.300 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-04-28T14:38:31.300 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2022-04-28T14:38:31.301 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:31.301 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 142 k 2022-04-28T14:38:31.301 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 422 k 2022-04-28T14:38:31.301 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2022-04-28T14:38:31.348 INFO:teuthology.orchestra.run.smithi037.stdout:rbd-nbd-14.2.22-0.el8.x86_64.rpm 3.0 MB/s | 142 kB 00:00 2022-04-28T14:38:31.349 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:38:31.349 INFO:teuthology.orchestra.run.smithi037.stdout:Total 2.9 MB/s | 142 kB 00:00 2022-04-28T14:38:31.349 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2022-04-28T14:38:31.361 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2022-04-28T14:38:31.361 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2022-04-28T14:38:31.419 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2022-04-28T14:38:31.422 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2022-04-28T14:38:31.436 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2022-04-28T14:38:31.545 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2022-04-28T14:38:31.663 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-nbd-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:31.749 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:31.908 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: rbd-nbd-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:32.015 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-nbd-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:32.294 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-nbd-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:32.294 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:32.294 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2022-04-28T14:38:32.294 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-nbd-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:32.294 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:32.294 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2022-04-28T14:38:32.411 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-2:14.2.22-0.el8.x86_64 1/1 2022-04-28T14:38:32.411 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:32.411 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2022-04-28T14:38:32.411 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-2:14.2.22-0.el8.x86_64 2022-04-28T14:38:32.412 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:32.412 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-04-28T14:38:32.480 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum -y install librados2 2022-04-28T14:38:32.624 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install librados2 2022-04-28T14:38:33.073 INFO:teuthology.orchestra.run.smithi039.stdout:Last metadata expiration check: 0:01:31 ago on Thu 28 Apr 2022 02:37:02 PM UTC. 2022-04-28T14:38:33.221 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:32 ago on Thu 28 Apr 2022 02:37:01 PM UTC. 2022-04-28T14:38:33.917 INFO:teuthology.orchestra.run.smithi039.stdout:Package librados2-2:14.2.22-0.el8.x86_64 is already installed. 2022-04-28T14:38:33.978 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2022-04-28T14:38:33.979 INFO:teuthology.orchestra.run.smithi039.stdout:Nothing to do. 2022-04-28T14:38:33.979 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2022-04-28T14:38:34.043 DEBUG:teuthology.parallel:result is None 2022-04-28T14:38:34.074 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-2:14.2.22-0.el8.x86_64 is already installed. 2022-04-28T14:38:34.134 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-04-28T14:38:34.135 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2022-04-28T14:38:34.136 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-04-28T14:38:34.215 DEBUG:teuthology.parallel:result is None 2022-04-28T14:38:34.215 DEBUG:teuthology.orchestra.run.smithi022:> sudo lsb_release -is 2022-04-28T14:38:34.259 INFO:teuthology.orchestra.run.smithi022.stdout:CentOSStream 2022-04-28T14:38:34.261 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-04-28T14:38:34.261 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-04-28T14:38:34.261 INFO:teuthology.packaging:ref: None 2022-04-28T14:38:34.261 INFO:teuthology.packaging:tag: None 2022-04-28T14:38:34.262 INFO:teuthology.packaging:branch: nautilus 2022-04-28T14:38:34.262 INFO:teuthology.packaging:sha1: 4fa079ba14503defa8dc257d7c2d506ebefcfe6d 2022-04-28T14:38:34.263 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=nautilus 2022-04-28T14:38:34.445 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-04-28T14:38:34.472 INFO:teuthology.orchestra.run.smithi022.stdout:14.2.22-0.el8 2022-04-28T14:38:34.473 INFO:teuthology.packaging:The installed version of ceph is 14.2.22-0.el8 2022-04-28T14:38:34.473 INFO:teuthology.task.install:The correct ceph version 14.2.22-0 is installed. 2022-04-28T14:38:34.473 DEBUG:teuthology.orchestra.run.smithi037:> sudo lsb_release -is 2022-04-28T14:38:34.511 INFO:teuthology.orchestra.run.smithi037.stdout:CentOSStream 2022-04-28T14:38:34.512 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-04-28T14:38:34.513 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-04-28T14:38:34.513 INFO:teuthology.packaging:ref: None 2022-04-28T14:38:34.513 INFO:teuthology.packaging:tag: None 2022-04-28T14:38:34.513 INFO:teuthology.packaging:branch: nautilus 2022-04-28T14:38:34.513 INFO:teuthology.packaging:sha1: 4fa079ba14503defa8dc257d7c2d506ebefcfe6d 2022-04-28T14:38:34.513 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=nautilus 2022-04-28T14:38:34.695 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-04-28T14:38:34.718 INFO:teuthology.orchestra.run.smithi037.stdout:14.2.22-0.el8 2022-04-28T14:38:34.719 INFO:teuthology.packaging:The installed version of ceph is 14.2.22-0.el8 2022-04-28T14:38:34.719 INFO:teuthology.task.install:The correct ceph version 14.2.22-0 is installed. 2022-04-28T14:38:34.719 DEBUG:teuthology.orchestra.run.smithi039:> sudo lsb_release -is 2022-04-28T14:38:34.758 INFO:teuthology.orchestra.run.smithi039.stdout:CentOSStream 2022-04-28T14:38:34.760 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-04-28T14:38:34.760 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-04-28T14:38:34.760 INFO:teuthology.packaging:ref: None 2022-04-28T14:38:34.760 INFO:teuthology.packaging:tag: None 2022-04-28T14:38:34.760 INFO:teuthology.packaging:branch: nautilus 2022-04-28T14:38:34.760 INFO:teuthology.packaging:sha1: 4fa079ba14503defa8dc257d7c2d506ebefcfe6d 2022-04-28T14:38:34.760 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=nautilus 2022-04-28T14:38:34.955 DEBUG:teuthology.orchestra.run.smithi039:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-04-28T14:38:34.984 INFO:teuthology.orchestra.run.smithi039.stdout:14.2.22-0.el8 2022-04-28T14:38:34.984 INFO:teuthology.packaging:The installed version of ceph is 14.2.22-0.el8 2022-04-28T14:38:34.984 INFO:teuthology.task.install:The correct ceph version 14.2.22-0 is installed. 2022-04-28T14:38:34.985 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2022-04-28T14:38:34.985 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2022-04-28T14:38:34.985 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-04-28T14:38:35.018 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2022-04-28T14:38:35.018 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-04-28T14:38:35.049 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2022-04-28T14:38:35.049 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-04-28T14:38:35.077 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2022-04-28T14:38:35.078 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2022-04-28T14:38:35.078 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/daemon-helper 2022-04-28T14:38:35.108 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-04-28T14:38:35.179 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2022-04-28T14:38:35.179 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2022-04-28T14:38:35.209 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-04-28T14:38:35.279 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2022-04-28T14:38:35.279 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/daemon-helper 2022-04-28T14:38:35.308 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-04-28T14:38:35.377 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2022-04-28T14:38:35.377 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2022-04-28T14:38:35.377 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/adjust-ulimits 2022-04-28T14:38:35.407 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-04-28T14:38:35.477 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2022-04-28T14:38:35.478 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2022-04-28T14:38:35.509 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-04-28T14:38:35.581 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2022-04-28T14:38:35.581 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/adjust-ulimits 2022-04-28T14:38:35.610 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-04-28T14:38:35.715 INFO:teuthology.run_tasks:Running task print... 2022-04-28T14:38:35.728 INFO:teuthology.task.print:**** done installing nautilus 2022-04-28T14:38:35.728 INFO:teuthology.run_tasks:Running task ceph... 2022-04-28T14:38:35.817 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2022-04-28T14:38:35.818 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 777 /var/log/ceph 2022-04-28T14:38:35.821 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /var/log/ceph 2022-04-28T14:38:35.823 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 777 /var/log/ceph 2022-04-28T14:38:35.854 INFO:tasks.ceph:Disabling ceph logrotate... 2022-04-28T14:38:35.854 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /etc/logrotate.d/ceph 2022-04-28T14:38:35.894 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/logrotate.d/ceph 2022-04-28T14:38:35.896 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /etc/logrotate.d/ceph 2022-04-28T14:38:35.925 INFO:tasks.ceph:Creating extra log directories... 2022-04-28T14:38:35.925 DEBUG:teuthology.orchestra.run.smithi022:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-04-28T14:38:35.966 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-04-28T14:38:35.968 DEBUG:teuthology.orchestra.run.smithi039:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-04-28T14:38:36.022 INFO:tasks.ceph:Creating ceph cluster ceph... 2022-04-28T14:38:36.022 INFO:tasks.ceph:config {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request', 'missing required features'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2022-04-28T14:38:36.022 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2022-04-28_13:46:48-fs-pacific-distro-default-smithi/6810810', 'branch': 'pacific', 'description': 'fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}', 'email': None, 'first_in_suite': False, 'job_id': '6810810', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'meta': [{'desc': 'install ceph/nautilus latest\n'}], 'name': 'yuriw-2022-04-28_13:46:48-fs-pacific-distro-default-smithi', 'nuke-on-error': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'pacific'}, 'ceph': {'cephfs': {'max_mds': 2}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request', 'missing required features'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '4fa079ba14503defa8dc257d7c2d506ebefcfe6d'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4fa079ba14503defa8dc257d7c2d506ebefcfe6d'}}, 'nuke-on-error': False, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'pacific', 'sha1': '4fa079ba14503defa8dc257d7c2d506ebefcfe6d'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 70, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['client.0'], ['client.1']], 'sha1': '4fa079ba14503defa8dc257d7c2d506ebefcfe6d', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'pacific', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_4fa079ba14503defa8dc257d7c2d506ebefcfe6d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '4fa079ba14503defa8dc257d7c2d506ebefcfe6d', 'targets': {'smithi022.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGBPD82XVQq8/r2zhDct+FtjpgqhM14uxFiwcvNi0rmWXwkm3QfeE/DsWJdxz6VWXgFvaokBZHSDAIALwL/QivcAcjM6nfyuorVp2FkRPdjwiEmYZo3n1sdABSG5fNjRI2LkofkUjDM9TU+mgsHdsnYHzmYzfUXBiKLuYFQweCsbMWxK8DFxg2c148v6VjKEE+a481k6R5+C/SHKo+72Vs/bGh+uto6DTbC8qCO3W94HNMnx/yZEkswD3Qzm/H1VTBF1WDrNNClbd0rp/OUNdn6Wv6cLq2Rq/j9hPAqAsw3F/odGfcp0Q5dsHiXowAWjs6aapMEzt6jlQQCbprSTRtaXR17X1yAVDFQEck4NUphSxnBYvV/ssPeIdg2xpHR6jpDRXTs5Nes/7JvPSkKdocXuYzuXhhuOY1JnZVhEeOdihkLrwINuRvT9UoBMH9Ndnpk1fQelSwJn21sKfbSlJdZlZ4ZVbEgkxQPs1/5mHCoDiUKhvrzeT5aVz2zbBiR4k=', 'smithi037.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCuS0bGi1Izsn66HFWRztZ6OaoBlGhw6XfZI197mIm0/XTGC9u45wDjmqWVinJH4FD61+usAaZo7j+nd34RX5kb7hICf7Au1Dnj7PuqAKRHkmEEXnrpN7nJ/o9FI24pb1rq8SSv8MJRABTloY05S7HkX9tLeW/+HuD75KsYB+16NIMh49tNEfm3rlQ3FIa72WlkpZ0tcFMRXZQpCCcd6KEtbtYo8JicE8JDWpGzKii2F0J621ViRdfWKgjKcJTVpPRj5UShYqUyFeTXF667QPDtZFSDeKmiZAPL5/KmJJMWPx22QVKAzOMtV/2KXLpwK0Q+ruwXjHoy4gQBtXDjryWGDSOuFZcbwJuZCDb52Ah3wTCVyqvdQvWcvYAJRXvG8cgNkG5rm+25NHUJcycdRPpaRuJ2Iy0voZR/F/ODvtYtQYwbEH0wNbJYR0tfAH50iy1hGnkoXkipTdm5K4g0CBwDqeRwqOEa0qRn6T8m1Wcomzwc1zAq9AY9OqF8J/zsYJE=', 'smithi039.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFtho9m4Y58t6Inrqav8xgmCf/OCSC4nMJWaY4WHDPQDUYmjdWNHv9nHkexXzYZO05i8X+woy9RZ8Z6Gh/CIIS7bymq7akLZx8Of7s06WqH53SfmIj+itmxulbyJi44C/Mffgg6GUKPUss0VeMoECM/HAZWr9u6JPMD0kwSxS7DZd4IVaaC0MoZbdAxefW8fun6+xZaD/bMyrrab8uuAwjV8Zr1SZElNipyZfBBvV9Db0yMRFw920Uvy/Y/2ZuKd+PxxNfekiuD088Ut45o0tENyynL7Qlon0cA73VNklJTtXfxBQm9X5UfIjrtBpfk9wQMNDkxVydVMDKtQRq6bJtMX44II6ioL4LRQ7Q2ob9B0T4gxkBvf19UxXtp04So5bPMKVIcD6A/VhiuNt/oPHcRTyUbHeY99uVy0QU5BTtSCjDJcwflhXcJ+PzAVODCMo/EMVL/+PP1FKU+tEJKKkU7/jobBqWY+vLDu8khwQs/5nYaSkHTF/srP8jfYJR2+E='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'nautilus', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs'], 'extra_packages': ['librados2'], 'flavor': 'default', 'sha1': '4fa079ba14503defa8dc257d7c2d506ebefcfe6d'}}, {'print': '**** done installing nautilus'}, {'ceph': {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'log-ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request', 'missing required features'], 'cephfs': {'max_mds': 2}, 'flavor': 'default', 'fs': 'xfs', 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '4fa079ba14503defa8dc257d7c2d506ebefcfe6d', 'cluster': 'ceph'}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client nautilus']}}, {'print': '**** done ceph'}, {'ceph-fuse': None}, {'print': '**** done nautilus client'}, {'print': '**** done fsstress'}, {'mds_pre_upgrade': None}, {'print': '**** done mds pre-upgrade sequence'}, {'install.upgrade': {'mon.a': None, 'mon.b': None}}, {'print': '**** done install.upgrade both hosts'}, {'ceph.restart': {'daemons': ['mon.*', 'mgr.*'], 'mon-health-to-clog': False, 'wait-for-healthy': False}}, {'ceph.healthy': None}, {'ceph.restart': {'daemons': ['osd.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'ceph.stop': ['mds.*']}, {'ceph.restart': {'daemons': ['mds.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'exec': {'mon.a': ['ceph versions', 'ceph osd dump -f json-pretty', 'ceph osd require-osd-release pacific', 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done']}}, {'ceph.healthy': None}, {'print': '**** done ceph.restart'}, {'install.upgrade': {'client.0': None}}, {'print': '**** done install.upgrade on client.0'}, {'ceph-fuse': {'client.0': {'mounted': False}, 'client.1': {'skip': True}}}, {'ceph-fuse': {'client.0': None, 'client.1': {'skip': True}}}, {'print': '**** done remount client'}, {'exec': {'mon.a': ['ceph fs dump --format=json-pretty', 'ceph fs required_client_features cephfs add metric_collect']}}, {'sleep': {'duration': 5}}, {'fs.clients_evicted': {'clients': {'client.0': False, 'client.1': True}}}, {'workunit': {'clients': {'client.0': ['suites/fsstress.sh']}}}, {'print': '**** done fsstress'}], 'teuthology_branch': 'master', 'teuthology_sha1': '004701def07b67dd914d7b1775457fec6788a495', 'timestamp': '2022-04-28_13:46:48', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.5191'} 2022-04-28T14:38:36.023 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-04-28T14:38:36.037 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-04-28T14:38:36.052 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-04-28T14:38:36.070 DEBUG:teuthology.orchestra.run.smithi022:> sudo install -d -m0777 -- /var/run/ceph 2022-04-28T14:38:36.097 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/run/ceph 2022-04-28T14:38:36.110 DEBUG:teuthology.orchestra.run.smithi039:> sudo install -d -m0777 -- /var/run/ceph 2022-04-28T14:38:36.138 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2022-04-28T14:38:36.138 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/scratch_devs of=/dev/stdout 2022-04-28T14:38:36.183 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-04-28T14:38:36.183 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-04-28T14:38:36.242 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-04-28T14:38:36.242 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-04-28T14:38:36.242 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 6h/6d Inode: 340874 Links: 1 2022-04-28T14:38:36.242 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-04-28T14:38:36.242 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2022-04-28T14:38:36.242 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2022-04-28 14:38:24.828309576 +0000 2022-04-28T14:38:36.242 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2022-04-28 14:36:13.200693285 +0000 2022-04-28T14:38:36.243 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2022-04-28 14:36:13.200693285 +0000 2022-04-28T14:38:36.243 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2022-04-28T14:38:36.253 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2022-04-28T14:38:36.253 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2022-04-28T14:38:36.253 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000124489 s, 4.1 MB/s 2022-04-28T14:38:36.256 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-04-28T14:38:36.315 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-04-28T14:38:36.315 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-04-28T14:38:36.315 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 6h/6d Inode: 338757 Links: 1 2022-04-28T14:38:36.315 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-04-28T14:38:36.315 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2022-04-28T14:38:36.315 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2022-04-28 14:38:24.828309576 +0000 2022-04-28T14:38:36.315 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2022-04-28 14:36:13.862684572 +0000 2022-04-28T14:38:36.316 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2022-04-28 14:36:13.862684572 +0000 2022-04-28T14:38:36.316 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2022-04-28T14:38:36.325 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2022-04-28T14:38:36.325 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2022-04-28T14:38:36.326 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000112855 s, 4.5 MB/s 2022-04-28T14:38:36.328 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-04-28T14:38:36.386 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-04-28T14:38:36.387 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-04-28T14:38:36.387 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 6h/6d Inode: 342511 Links: 1 2022-04-28T14:38:36.387 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-04-28T14:38:36.387 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2022-04-28T14:38:36.387 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2022-04-28 14:38:24.828309576 +0000 2022-04-28T14:38:36.387 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2022-04-28 14:36:14.395677557 +0000 2022-04-28T14:38:36.387 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2022-04-28 14:36:14.395677557 +0000 2022-04-28T14:38:36.387 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2022-04-28T14:38:36.397 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2022-04-28T14:38:36.397 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2022-04-28T14:38:36.397 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000109979 s, 4.7 MB/s 2022-04-28T14:38:36.400 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-04-28T14:38:36.458 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-04-28T14:38:36.458 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-04-28T14:38:36.459 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 6h/6d Inode: 337539 Links: 1 2022-04-28T14:38:36.459 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-04-28T14:38:36.459 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2022-04-28T14:38:36.459 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2022-04-28 14:38:24.828309576 +0000 2022-04-28T14:38:36.459 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2022-04-28 14:36:14.908670805 +0000 2022-04-28T14:38:36.459 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2022-04-28 14:36:14.908670805 +0000 2022-04-28T14:38:36.459 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2022-04-28T14:38:36.468 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2022-04-28T14:38:36.469 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2022-04-28T14:38:36.469 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000112141 s, 4.6 MB/s 2022-04-28T14:38:36.471 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-04-28T14:38:36.471 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi022.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2022-04-28T14:38:36.471 INFO:tasks.ceph:Generating config... 2022-04-28T14:38:36.473 INFO:tasks.ceph:[global] mon warn on pool no app = False 2022-04-28T14:38:36.473 INFO:tasks.ceph:[global] ms bind msgr2 = False 2022-04-28T14:38:36.473 INFO:tasks.ceph:[global] bluestore warn on legacy statfs = False 2022-04-28T14:38:36.473 INFO:tasks.ceph:[global] bluestore warn on no per pool omap = False 2022-04-28T14:38:36.473 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2022-04-28T14:38:36.473 INFO:tasks.ceph:[client] client mount timeout = 600 2022-04-28T14:38:36.473 INFO:tasks.ceph:[client] debug client = 20 2022-04-28T14:38:36.473 INFO:tasks.ceph:[client] debug ms = 1 2022-04-28T14:38:36.473 INFO:tasks.ceph:[client] rados mon op timeout = 900 2022-04-28T14:38:36.474 INFO:tasks.ceph:[client] rados osd op timeout = 900 2022-04-28T14:38:36.474 INFO:tasks.ceph:[mds] debug mds = 20 2022-04-28T14:38:36.474 INFO:tasks.ceph:[mds] debug ms = 1 2022-04-28T14:38:36.474 INFO:tasks.ceph:[mds] mds debug frag = True 2022-04-28T14:38:36.474 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2022-04-28T14:38:36.474 INFO:tasks.ceph:[mds] mds op complaint time = 180 2022-04-28T14:38:36.474 INFO:tasks.ceph:[mds] mds verify scatter = True 2022-04-28T14:38:36.474 INFO:tasks.ceph:[mds] osd op complaint time = 180 2022-04-28T14:38:36.474 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2022-04-28T14:38:36.474 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2022-04-28T14:38:36.475 INFO:tasks.ceph:[mgr] debug mgr = 20 2022-04-28T14:38:36.475 INFO:tasks.ceph:[mgr] debug ms = 1 2022-04-28T14:38:36.475 INFO:tasks.ceph:[mon] debug mon = 20 2022-04-28T14:38:36.475 INFO:tasks.ceph:[mon] debug ms = 1 2022-04-28T14:38:36.475 INFO:tasks.ceph:[mon] debug paxos = 20 2022-04-28T14:38:36.475 INFO:tasks.ceph:[mon] mon op complaint time = 120 2022-04-28T14:38:36.476 INFO:tasks.ceph:[mon] mon warn on osd down out interval zero = False 2022-04-28T14:38:36.476 INFO:tasks.ceph:[osd] bdev async discard = True 2022-04-28T14:38:36.476 INFO:tasks.ceph:[osd] bdev enable discard = True 2022-04-28T14:38:36.476 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2022-04-28T14:38:36.476 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2022-04-28T14:38:36.477 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2022-04-28T14:38:36.477 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2022-04-28T14:38:36.477 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2022-04-28T14:38:36.477 INFO:tasks.ceph:[osd] debug ms = 1 2022-04-28T14:38:36.477 INFO:tasks.ceph:[osd] debug osd = 20 2022-04-28T14:38:36.478 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2022-04-28T14:38:36.478 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2022-04-28T14:38:36.478 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2022-04-28T14:38:36.478 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2022-04-28T14:38:36.479 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2022-04-28T14:38:36.479 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2022-04-28T14:38:36.479 INFO:tasks.ceph:[osd] osd op complaint time = 180 2022-04-28T14:38:36.479 INFO:tasks.ceph:Setting up mon.a... 2022-04-28T14:38:36.480 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2022-04-28T14:38:36.626 INFO:teuthology.orchestra.run.smithi022.stdout:creating /etc/ceph/ceph.keyring 2022-04-28T14:38:36.631 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2022-04-28T14:38:36.697 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-04-28T14:38:36.724 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.22'), ('mon.b', '[v2:172.21.15.22:3301,v1:172.21.15.22:6790]'), ('mon.c', '[v2:172.21.15.22:3302,v1:172.21.15.22:6791]')] 2022-04-28T14:38:36.725 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.22,[v2:172.21.15.22:3301,v1:172.21.15.22:6790],[v2:172.21.15.22:3302,v1:172.21.15.22:6791]', 'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds.c': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2022-04-28T14:38:36.727 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2022-04-28T14:38:36.727 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2022-04-28T14:38:36.781 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.22 --addv b '[v2:172.21.15.22:3301,v1:172.21.15.22:6790]' --addv c '[v2:172.21.15.22:3302,v1:172.21.15.22:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2022-04-28T14:38:36.887 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2022-04-28T14:38:36.888 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool: generated fsid 3047163a-0285-4058-8e05-ce74c6fbb9c5 2022-04-28T14:38:36.888 INFO:teuthology.orchestra.run.smithi022.stdout:epoch 0 2022-04-28T14:38:36.888 INFO:teuthology.orchestra.run.smithi022.stdout:fsid 3047163a-0285-4058-8e05-ce74c6fbb9c5 2022-04-28T14:38:36.888 INFO:teuthology.orchestra.run.smithi022.stdout:last_changed 2022-04-28 14:38:36.884350 2022-04-28T14:38:36.888 INFO:teuthology.orchestra.run.smithi022.stdout:created 2022-04-28 14:38:36.884350 2022-04-28T14:38:36.889 INFO:teuthology.orchestra.run.smithi022.stdout:min_mon_release 0 (unknown) 2022-04-28T14:38:36.889 INFO:teuthology.orchestra.run.smithi022.stdout:0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2022-04-28T14:38:36.889 INFO:teuthology.orchestra.run.smithi022.stdout:1: [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] mon.b 2022-04-28T14:38:36.889 INFO:teuthology.orchestra.run.smithi022.stdout:2: [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] mon.c 2022-04-28T14:38:36.889 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2022-04-28T14:38:36.891 DEBUG:teuthology.orchestra.run.smithi022:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2022-04-28T14:38:36.908 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3047163a-0285-4058-8e05-ce74c6fbb9c5... 2022-04-28T14:38:36.909 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-04-28T14:38:36.951 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-04-28T14:38:36.954 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-04-28T14:38:36.994 INFO:teuthology.orchestra.run.smithi022.stdout:[global] 2022-04-28T14:38:36.995 INFO:teuthology.orchestra.run.smithi022.stdout: chdir = "" 2022-04-28T14:38:36.995 INFO:teuthology.orchestra.run.smithi022.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-04-28T14:38:36.995 INFO:teuthology.orchestra.run.smithi022.stdout: auth supported = cephx 2022-04-28T14:38:36.995 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:36.995 INFO:teuthology.orchestra.run.smithi022.stdout: filestore xattr use omap = true 2022-04-28T14:38:36.995 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:36.995 INFO:teuthology.orchestra.run.smithi022.stdout: mon clock drift allowed = 1.000 2022-04-28T14:38:36.995 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:36.995 INFO:teuthology.orchestra.run.smithi022.stdout: osd crush chooseleaf type = 0 2022-04-28T14:38:36.996 INFO:teuthology.orchestra.run.smithi022.stdout: auth debug = true 2022-04-28T14:38:36.996 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:36.996 INFO:teuthology.orchestra.run.smithi022.stdout: ms die on old message = true 2022-04-28T14:38:36.996 INFO:teuthology.orchestra.run.smithi022.stdout: ms die on bug = true 2022-04-28T14:38:36.996 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:36.996 INFO:teuthology.orchestra.run.smithi022.stdout: mon max pg per osd = 10000 # >= luminous 2022-04-28T14:38:36.996 INFO:teuthology.orchestra.run.smithi022.stdout: mon pg warn max object skew = 0 2022-04-28T14:38:36.996 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:36.996 INFO:teuthology.orchestra.run.smithi022.stdout: # disable pg_autoscaler by default for new pools 2022-04-28T14:38:36.996 INFO:teuthology.orchestra.run.smithi022.stdout: osd_pool_default_pg_autoscale_mode = off 2022-04-28T14:38:36.997 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:36.997 INFO:teuthology.orchestra.run.smithi022.stdout: osd pool default size = 2 2022-04-28T14:38:36.997 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:36.997 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd allow primary affinity = true 2022-04-28T14:38:36.997 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd allow pg remap = true 2022-04-28T14:38:36.997 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on legacy crush tunables = false 2022-04-28T14:38:36.997 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on crush straw calc version zero = false 2022-04-28T14:38:36.997 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on no sortbitwise = false 2022-04-28T14:38:36.997 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on osd down out interval zero = false 2022-04-28T14:38:36.998 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on too few osds = false 2022-04-28T14:38:36.998 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-04-28T14:38:36.998 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_pool_no_redundancy = false 2022-04-28T14:38:36.998 INFO:teuthology.orchestra.run.smithi022.stdout: mon_allow_pool_size_one = true 2022-04-28T14:38:36.998 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:36.998 INFO:teuthology.orchestra.run.smithi022.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2022-04-28T14:38:36.998 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:36.998 INFO:teuthology.orchestra.run.smithi022.stdout: osd default data pool replay window = 5 2022-04-28T14:38:36.998 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:36.999 INFO:teuthology.orchestra.run.smithi022.stdout: mon allow pool delete = true 2022-04-28T14:38:36.999 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:36.999 INFO:teuthology.orchestra.run.smithi022.stdout: mon cluster log file level = debug 2022-04-28T14:38:36.999 INFO:teuthology.orchestra.run.smithi022.stdout: debug asserts on shutdown = true 2022-04-28T14:38:36.999 INFO:teuthology.orchestra.run.smithi022.stdout: mon health detail to clog = false 2022-04-28T14:38:36.999 INFO:teuthology.orchestra.run.smithi022.stdout: mon host = "172.21.15.22,[v2:172.21.15.22:3301,v1:172.21.15.22:6790],[v2:172.21.15.22:3302,v1:172.21.15.22:6791]" 2022-04-28T14:38:36.999 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on pool no app = False 2022-04-28T14:38:36.999 INFO:teuthology.orchestra.run.smithi022.stdout: ms bind msgr2 = False 2022-04-28T14:38:36.999 INFO:teuthology.orchestra.run.smithi022.stdout: bluestore warn on legacy statfs = False 2022-04-28T14:38:37.000 INFO:teuthology.orchestra.run.smithi022.stdout: bluestore warn on no per pool omap = False 2022-04-28T14:38:37.000 INFO:teuthology.orchestra.run.smithi022.stdout: mon pg warn min per osd = 0 2022-04-28T14:38:37.000 INFO:teuthology.orchestra.run.smithi022.stdout: fsid = 3047163a-0285-4058-8e05-ce74c6fbb9c5 2022-04-28T14:38:37.000 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:37.000 INFO:teuthology.orchestra.run.smithi022.stdout:[osd] 2022-04-28T14:38:37.000 INFO:teuthology.orchestra.run.smithi022.stdout: osd journal size = 100 2022-04-28T14:38:37.000 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:37.000 INFO:teuthology.orchestra.run.smithi022.stdout: osd scrub load threshold = 5.0 2022-04-28T14:38:37.000 INFO:teuthology.orchestra.run.smithi022.stdout: osd scrub max interval = 600 2022-04-28T14:38:37.000 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:37.001 INFO:teuthology.orchestra.run.smithi022.stdout: osd recover clone overlap = true 2022-04-28T14:38:37.001 INFO:teuthology.orchestra.run.smithi022.stdout: osd recovery max chunk = 1048576 2022-04-28T14:38:37.001 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:37.001 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug shutdown = true 2022-04-28T14:38:37.001 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug op order = true 2022-04-28T14:38:37.001 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug verify stray on activate = true 2022-04-28T14:38:37.001 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:37.001 INFO:teuthology.orchestra.run.smithi022.stdout: osd open classes on start = true 2022-04-28T14:38:37.001 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug pg log writeout = true 2022-04-28T14:38:37.001 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:37.002 INFO:teuthology.orchestra.run.smithi022.stdout: osd deep scrub update digest min age = 30 2022-04-28T14:38:37.002 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:37.002 INFO:teuthology.orchestra.run.smithi022.stdout: osd map max advance = 10 2022-04-28T14:38:37.002 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:37.002 INFO:teuthology.orchestra.run.smithi022.stdout: journal zero on create = true 2022-04-28T14:38:37.002 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:37.002 INFO:teuthology.orchestra.run.smithi022.stdout: filestore ondisk finisher threads = 3 2022-04-28T14:38:37.002 INFO:teuthology.orchestra.run.smithi022.stdout: filestore apply finisher threads = 3 2022-04-28T14:38:37.003 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:37.003 INFO:teuthology.orchestra.run.smithi022.stdout: bdev debug aio = true 2022-04-28T14:38:37.003 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug misdirected ops = true 2022-04-28T14:38:37.003 INFO:teuthology.orchestra.run.smithi022.stdout: bdev async discard = True 2022-04-28T14:38:37.003 INFO:teuthology.orchestra.run.smithi022.stdout: bdev enable discard = True 2022-04-28T14:38:37.003 INFO:teuthology.orchestra.run.smithi022.stdout: bluestore allocator = bitmap 2022-04-28T14:38:37.003 INFO:teuthology.orchestra.run.smithi022.stdout: bluestore block size = 96636764160 2022-04-28T14:38:37.003 INFO:teuthology.orchestra.run.smithi022.stdout: bluestore fsck on mount = True 2022-04-28T14:38:37.003 INFO:teuthology.orchestra.run.smithi022.stdout: debug bluefs = 1/20 2022-04-28T14:38:37.003 INFO:teuthology.orchestra.run.smithi022.stdout: debug bluestore = 1/20 2022-04-28T14:38:37.004 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2022-04-28T14:38:37.004 INFO:teuthology.orchestra.run.smithi022.stdout: debug osd = 20 2022-04-28T14:38:37.004 INFO:teuthology.orchestra.run.smithi022.stdout: debug rocksdb = 4/10 2022-04-28T14:38:37.004 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd backfillfull_ratio = 0.85 2022-04-28T14:38:37.004 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd full ratio = 0.9 2022-04-28T14:38:37.004 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd nearfull ratio = 0.8 2022-04-28T14:38:37.004 INFO:teuthology.orchestra.run.smithi022.stdout: osd failsafe full ratio = 0.95 2022-04-28T14:38:37.004 INFO:teuthology.orchestra.run.smithi022.stdout: osd objectstore = bluestore 2022-04-28T14:38:37.004 INFO:teuthology.orchestra.run.smithi022.stdout: osd op complaint time = 180 2022-04-28T14:38:37.004 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:37.005 INFO:teuthology.orchestra.run.smithi022.stdout:[mgr] 2022-04-28T14:38:37.005 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2022-04-28T14:38:37.005 INFO:teuthology.orchestra.run.smithi022.stdout: debug mgr = 20 2022-04-28T14:38:37.005 INFO:teuthology.orchestra.run.smithi022.stdout: debug mon = 20 2022-04-28T14:38:37.005 INFO:teuthology.orchestra.run.smithi022.stdout: debug auth = 20 2022-04-28T14:38:37.005 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min pgs per osd = 4 2022-04-28T14:38:37.005 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min bytes per osd = 10 2022-04-28T14:38:37.005 INFO:teuthology.orchestra.run.smithi022.stdout: mgr/telemetry/nag = false 2022-04-28T14:38:37.005 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:37.005 INFO:teuthology.orchestra.run.smithi022.stdout:[mon] 2022-04-28T14:38:37.006 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2022-04-28T14:38:37.006 INFO:teuthology.orchestra.run.smithi022.stdout: debug mon = 20 2022-04-28T14:38:37.006 INFO:teuthology.orchestra.run.smithi022.stdout: debug paxos = 20 2022-04-28T14:38:37.006 INFO:teuthology.orchestra.run.smithi022.stdout: debug auth = 20 2022-04-28T14:38:37.006 INFO:teuthology.orchestra.run.smithi022.stdout: mon data avail warn = 5 2022-04-28T14:38:37.006 INFO:teuthology.orchestra.run.smithi022.stdout: mon mgr mkfs grace = 240 2022-04-28T14:38:37.006 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min pgs per osd = 4 2022-04-28T14:38:37.006 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd reporter subtree level = osd 2022-04-28T14:38:37.006 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd prime pg temp = true 2022-04-28T14:38:37.007 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min bytes per osd = 10 2022-04-28T14:38:37.007 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:37.007 INFO:teuthology.orchestra.run.smithi022.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-04-28T14:38:37.007 INFO:teuthology.orchestra.run.smithi022.stdout: auth mon ticket ttl = 660 # 11m 2022-04-28T14:38:37.007 INFO:teuthology.orchestra.run.smithi022.stdout: auth service ticket ttl = 240 # 4m 2022-04-28T14:38:37.007 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:37.007 INFO:teuthology.orchestra.run.smithi022.stdout: # don't complain about insecure global_id in the test suite 2022-04-28T14:38:37.007 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-04-28T14:38:37.007 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-04-28T14:38:37.007 INFO:teuthology.orchestra.run.smithi022.stdout: mon op complaint time = 120 2022-04-28T14:38:37.008 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on osd down out interval zero = False 2022-04-28T14:38:37.008 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:37.008 INFO:teuthology.orchestra.run.smithi022.stdout:[client] 2022-04-28T14:38:37.008 INFO:teuthology.orchestra.run.smithi022.stdout: rgw cache enabled = true 2022-04-28T14:38:37.008 INFO:teuthology.orchestra.run.smithi022.stdout: rgw enable ops log = true 2022-04-28T14:38:37.008 INFO:teuthology.orchestra.run.smithi022.stdout: rgw enable usage log = true 2022-04-28T14:38:37.008 INFO:teuthology.orchestra.run.smithi022.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-04-28T14:38:37.008 INFO:teuthology.orchestra.run.smithi022.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-04-28T14:38:37.008 INFO:teuthology.orchestra.run.smithi022.stdout: client mount timeout = 600 2022-04-28T14:38:37.009 INFO:teuthology.orchestra.run.smithi022.stdout: debug client = 20 2022-04-28T14:38:37.009 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2022-04-28T14:38:37.009 INFO:teuthology.orchestra.run.smithi022.stdout: rados mon op timeout = 900 2022-04-28T14:38:37.009 INFO:teuthology.orchestra.run.smithi022.stdout: rados osd op timeout = 900 2022-04-28T14:38:37.009 INFO:teuthology.orchestra.run.smithi022.stdout:[mon.a] 2022-04-28T14:38:37.009 INFO:teuthology.orchestra.run.smithi022.stdout:[mon.b] 2022-04-28T14:38:37.009 INFO:teuthology.orchestra.run.smithi022.stdout:[mon.c] 2022-04-28T14:38:37.009 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.a] 2022-04-28T14:38:37.009 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.b] 2022-04-28T14:38:37.010 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.c] 2022-04-28T14:38:37.010 INFO:teuthology.orchestra.run.smithi022.stdout:[mds] 2022-04-28T14:38:37.010 INFO:teuthology.orchestra.run.smithi022.stdout: debug mds = 20 2022-04-28T14:38:37.010 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2022-04-28T14:38:37.010 INFO:teuthology.orchestra.run.smithi022.stdout: mds debug frag = True 2022-04-28T14:38:37.010 INFO:teuthology.orchestra.run.smithi022.stdout: mds debug scatterstat = True 2022-04-28T14:38:37.010 INFO:teuthology.orchestra.run.smithi022.stdout: mds op complaint time = 180 2022-04-28T14:38:37.010 INFO:teuthology.orchestra.run.smithi022.stdout: mds verify scatter = True 2022-04-28T14:38:37.010 INFO:teuthology.orchestra.run.smithi022.stdout: osd op complaint time = 180 2022-04-28T14:38:37.010 INFO:teuthology.orchestra.run.smithi022.stdout: rados mon op timeout = 900 2022-04-28T14:38:37.011 INFO:teuthology.orchestra.run.smithi022.stdout: rados osd op timeout = 900 2022-04-28T14:38:37.011 INFO:teuthology.orchestra.run.smithi039.stdout:[global] 2022-04-28T14:38:37.012 INFO:teuthology.orchestra.run.smithi039.stdout: chdir = "" 2022-04-28T14:38:37.012 INFO:teuthology.orchestra.run.smithi039.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-04-28T14:38:37.012 INFO:teuthology.orchestra.run.smithi039.stdout: auth supported = cephx 2022-04-28T14:38:37.012 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:37.012 INFO:teuthology.orchestra.run.smithi039.stdout: filestore xattr use omap = true 2022-04-28T14:38:37.012 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:37.012 INFO:teuthology.orchestra.run.smithi039.stdout: mon clock drift allowed = 1.000 2022-04-28T14:38:37.012 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:37.013 INFO:teuthology.orchestra.run.smithi039.stdout: osd crush chooseleaf type = 0 2022-04-28T14:38:37.013 INFO:teuthology.orchestra.run.smithi039.stdout: auth debug = true 2022-04-28T14:38:37.013 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:37.013 INFO:teuthology.orchestra.run.smithi039.stdout: ms die on old message = true 2022-04-28T14:38:37.013 INFO:teuthology.orchestra.run.smithi039.stdout: ms die on bug = true 2022-04-28T14:38:37.013 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:37.013 INFO:teuthology.orchestra.run.smithi039.stdout: mon max pg per osd = 10000 # >= luminous 2022-04-28T14:38:37.013 INFO:teuthology.orchestra.run.smithi039.stdout: mon pg warn max object skew = 0 2022-04-28T14:38:37.013 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:37.013 INFO:teuthology.orchestra.run.smithi039.stdout: # disable pg_autoscaler by default for new pools 2022-04-28T14:38:37.014 INFO:teuthology.orchestra.run.smithi039.stdout: osd_pool_default_pg_autoscale_mode = off 2022-04-28T14:38:37.014 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:37.014 INFO:teuthology.orchestra.run.smithi039.stdout: osd pool default size = 2 2022-04-28T14:38:37.014 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:37.014 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd allow primary affinity = true 2022-04-28T14:38:37.014 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd allow pg remap = true 2022-04-28T14:38:37.014 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on legacy crush tunables = false 2022-04-28T14:38:37.014 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on crush straw calc version zero = false 2022-04-28T14:38:37.014 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on no sortbitwise = false 2022-04-28T14:38:37.014 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on osd down out interval zero = false 2022-04-28T14:38:37.015 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on too few osds = false 2022-04-28T14:38:37.015 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-04-28T14:38:37.015 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_pool_no_redundancy = false 2022-04-28T14:38:37.015 INFO:teuthology.orchestra.run.smithi039.stdout: mon_allow_pool_size_one = true 2022-04-28T14:38:37.015 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:37.015 INFO:teuthology.orchestra.run.smithi039.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2022-04-28T14:38:37.015 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:37.015 INFO:teuthology.orchestra.run.smithi039.stdout: osd default data pool replay window = 5 2022-04-28T14:38:37.015 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:37.016 INFO:teuthology.orchestra.run.smithi039.stdout: mon allow pool delete = true 2022-04-28T14:38:37.016 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:37.016 INFO:teuthology.orchestra.run.smithi039.stdout: mon cluster log file level = debug 2022-04-28T14:38:37.016 INFO:teuthology.orchestra.run.smithi039.stdout: debug asserts on shutdown = true 2022-04-28T14:38:37.016 INFO:teuthology.orchestra.run.smithi039.stdout: mon health detail to clog = false 2022-04-28T14:38:37.016 INFO:teuthology.orchestra.run.smithi039.stdout: mon host = "172.21.15.22,[v2:172.21.15.22:3301,v1:172.21.15.22:6790],[v2:172.21.15.22:3302,v1:172.21.15.22:6791]" 2022-04-28T14:38:37.016 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on pool no app = False 2022-04-28T14:38:37.016 INFO:teuthology.orchestra.run.smithi039.stdout: ms bind msgr2 = False 2022-04-28T14:38:37.016 INFO:teuthology.orchestra.run.smithi039.stdout: bluestore warn on legacy statfs = False 2022-04-28T14:38:37.017 INFO:teuthology.orchestra.run.smithi039.stdout: bluestore warn on no per pool omap = False 2022-04-28T14:38:37.017 INFO:teuthology.orchestra.run.smithi039.stdout: mon pg warn min per osd = 0 2022-04-28T14:38:37.017 INFO:teuthology.orchestra.run.smithi039.stdout: fsid = 3047163a-0285-4058-8e05-ce74c6fbb9c5 2022-04-28T14:38:37.017 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:37.017 INFO:teuthology.orchestra.run.smithi039.stdout:[osd] 2022-04-28T14:38:37.017 INFO:teuthology.orchestra.run.smithi039.stdout: osd journal size = 100 2022-04-28T14:38:37.017 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:37.017 INFO:teuthology.orchestra.run.smithi039.stdout: osd scrub load threshold = 5.0 2022-04-28T14:38:37.017 INFO:teuthology.orchestra.run.smithi039.stdout: osd scrub max interval = 600 2022-04-28T14:38:37.017 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:37.018 INFO:teuthology.orchestra.run.smithi039.stdout: osd recover clone overlap = true 2022-04-28T14:38:37.018 INFO:teuthology.orchestra.run.smithi039.stdout: osd recovery max chunk = 1048576 2022-04-28T14:38:37.018 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:37.018 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug shutdown = true 2022-04-28T14:38:37.018 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug op order = true 2022-04-28T14:38:37.018 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug verify stray on activate = true 2022-04-28T14:38:37.018 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:37.018 INFO:teuthology.orchestra.run.smithi039.stdout: osd open classes on start = true 2022-04-28T14:38:37.018 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug pg log writeout = true 2022-04-28T14:38:37.019 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:37.019 INFO:teuthology.orchestra.run.smithi039.stdout: osd deep scrub update digest min age = 30 2022-04-28T14:38:37.019 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:37.019 INFO:teuthology.orchestra.run.smithi039.stdout: osd map max advance = 10 2022-04-28T14:38:37.019 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:37.019 INFO:teuthology.orchestra.run.smithi039.stdout: journal zero on create = true 2022-04-28T14:38:37.019 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:37.019 INFO:teuthology.orchestra.run.smithi039.stdout: filestore ondisk finisher threads = 3 2022-04-28T14:38:37.019 INFO:teuthology.orchestra.run.smithi039.stdout: filestore apply finisher threads = 3 2022-04-28T14:38:37.019 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:37.020 INFO:teuthology.orchestra.run.smithi039.stdout: bdev debug aio = true 2022-04-28T14:38:37.020 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug misdirected ops = true 2022-04-28T14:38:37.020 INFO:teuthology.orchestra.run.smithi039.stdout: bdev async discard = True 2022-04-28T14:38:37.020 INFO:teuthology.orchestra.run.smithi039.stdout: bdev enable discard = True 2022-04-28T14:38:37.020 INFO:teuthology.orchestra.run.smithi039.stdout: bluestore allocator = bitmap 2022-04-28T14:38:37.020 INFO:teuthology.orchestra.run.smithi039.stdout: bluestore block size = 96636764160 2022-04-28T14:38:37.020 INFO:teuthology.orchestra.run.smithi039.stdout: bluestore fsck on mount = True 2022-04-28T14:38:37.020 INFO:teuthology.orchestra.run.smithi039.stdout: debug bluefs = 1/20 2022-04-28T14:38:37.020 INFO:teuthology.orchestra.run.smithi039.stdout: debug bluestore = 1/20 2022-04-28T14:38:37.020 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2022-04-28T14:38:37.021 INFO:teuthology.orchestra.run.smithi039.stdout: debug osd = 20 2022-04-28T14:38:37.021 INFO:teuthology.orchestra.run.smithi039.stdout: debug rocksdb = 4/10 2022-04-28T14:38:37.021 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd backfillfull_ratio = 0.85 2022-04-28T14:38:37.021 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd full ratio = 0.9 2022-04-28T14:38:37.021 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd nearfull ratio = 0.8 2022-04-28T14:38:37.021 INFO:teuthology.orchestra.run.smithi039.stdout: osd failsafe full ratio = 0.95 2022-04-28T14:38:37.021 INFO:teuthology.orchestra.run.smithi039.stdout: osd objectstore = bluestore 2022-04-28T14:38:37.021 INFO:teuthology.orchestra.run.smithi039.stdout: osd op complaint time = 180 2022-04-28T14:38:37.021 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:37.021 INFO:teuthology.orchestra.run.smithi039.stdout:[mgr] 2022-04-28T14:38:37.022 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2022-04-28T14:38:37.022 INFO:teuthology.orchestra.run.smithi039.stdout: debug mgr = 20 2022-04-28T14:38:37.022 INFO:teuthology.orchestra.run.smithi039.stdout: debug mon = 20 2022-04-28T14:38:37.022 INFO:teuthology.orchestra.run.smithi039.stdout: debug auth = 20 2022-04-28T14:38:37.022 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min pgs per osd = 4 2022-04-28T14:38:37.022 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min bytes per osd = 10 2022-04-28T14:38:37.022 INFO:teuthology.orchestra.run.smithi039.stdout: mgr/telemetry/nag = false 2022-04-28T14:38:37.022 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:37.022 INFO:teuthology.orchestra.run.smithi039.stdout:[mon] 2022-04-28T14:38:37.022 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2022-04-28T14:38:37.023 INFO:teuthology.orchestra.run.smithi039.stdout: debug mon = 20 2022-04-28T14:38:37.023 INFO:teuthology.orchestra.run.smithi039.stdout: debug paxos = 20 2022-04-28T14:38:37.023 INFO:teuthology.orchestra.run.smithi039.stdout: debug auth = 20 2022-04-28T14:38:37.023 INFO:teuthology.orchestra.run.smithi039.stdout: mon data avail warn = 5 2022-04-28T14:38:37.023 INFO:teuthology.orchestra.run.smithi039.stdout: mon mgr mkfs grace = 240 2022-04-28T14:38:37.023 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min pgs per osd = 4 2022-04-28T14:38:37.023 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd reporter subtree level = osd 2022-04-28T14:38:37.023 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd prime pg temp = true 2022-04-28T14:38:37.023 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min bytes per osd = 10 2022-04-28T14:38:37.023 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:37.024 INFO:teuthology.orchestra.run.smithi039.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-04-28T14:38:37.024 INFO:teuthology.orchestra.run.smithi039.stdout: auth mon ticket ttl = 660 # 11m 2022-04-28T14:38:37.024 INFO:teuthology.orchestra.run.smithi039.stdout: auth service ticket ttl = 240 # 4m 2022-04-28T14:38:37.024 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:37.024 INFO:teuthology.orchestra.run.smithi039.stdout: # don't complain about insecure global_id in the test suite 2022-04-28T14:38:37.024 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-04-28T14:38:37.024 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-04-28T14:38:37.024 INFO:teuthology.orchestra.run.smithi039.stdout: mon op complaint time = 120 2022-04-28T14:38:37.024 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on osd down out interval zero = False 2022-04-28T14:38:37.024 INFO:teuthology.orchestra.run.smithi039.stdout: 2022-04-28T14:38:37.025 INFO:teuthology.orchestra.run.smithi039.stdout:[client] 2022-04-28T14:38:37.025 INFO:teuthology.orchestra.run.smithi039.stdout: rgw cache enabled = true 2022-04-28T14:38:37.025 INFO:teuthology.orchestra.run.smithi039.stdout: rgw enable ops log = true 2022-04-28T14:38:37.025 INFO:teuthology.orchestra.run.smithi039.stdout: rgw enable usage log = true 2022-04-28T14:38:37.025 INFO:teuthology.orchestra.run.smithi039.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-04-28T14:38:37.025 INFO:teuthology.orchestra.run.smithi039.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-04-28T14:38:37.025 INFO:teuthology.orchestra.run.smithi039.stdout: client mount timeout = 600 2022-04-28T14:38:37.025 INFO:teuthology.orchestra.run.smithi039.stdout: debug client = 20 2022-04-28T14:38:37.025 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2022-04-28T14:38:37.025 INFO:teuthology.orchestra.run.smithi039.stdout: rados mon op timeout = 900 2022-04-28T14:38:37.026 INFO:teuthology.orchestra.run.smithi039.stdout: rados osd op timeout = 900 2022-04-28T14:38:37.026 INFO:teuthology.orchestra.run.smithi039.stdout:[mon.a] 2022-04-28T14:38:37.026 INFO:teuthology.orchestra.run.smithi039.stdout:[mon.b] 2022-04-28T14:38:37.026 INFO:teuthology.orchestra.run.smithi039.stdout:[mon.c] 2022-04-28T14:38:37.026 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.a] 2022-04-28T14:38:37.026 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.b] 2022-04-28T14:38:37.026 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.c] 2022-04-28T14:38:37.026 INFO:teuthology.orchestra.run.smithi039.stdout:[mds] 2022-04-28T14:38:37.026 INFO:teuthology.orchestra.run.smithi039.stdout: debug mds = 20 2022-04-28T14:38:37.026 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2022-04-28T14:38:37.027 INFO:teuthology.orchestra.run.smithi039.stdout: mds debug frag = True 2022-04-28T14:38:37.027 INFO:teuthology.orchestra.run.smithi039.stdout: mds debug scatterstat = True 2022-04-28T14:38:37.027 INFO:teuthology.orchestra.run.smithi039.stdout: mds op complaint time = 180 2022-04-28T14:38:37.027 INFO:teuthology.orchestra.run.smithi039.stdout: mds verify scatter = True 2022-04-28T14:38:37.027 INFO:teuthology.orchestra.run.smithi039.stdout: osd op complaint time = 180 2022-04-28T14:38:37.027 INFO:teuthology.orchestra.run.smithi039.stdout: rados mon op timeout = 900 2022-04-28T14:38:37.027 INFO:teuthology.orchestra.run.smithi039.stdout: rados osd op timeout = 900 2022-04-28T14:38:37.027 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2022-04-28T14:38:37.027 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2022-04-28T14:38:37.028 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-04-28T14:38:37.028 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2022-04-28T14:38:37.028 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:37.028 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2022-04-28T14:38:37.028 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:37.028 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2022-04-28T14:38:37.028 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:37.028 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2022-04-28T14:38:37.028 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2022-04-28T14:38:37.028 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:37.029 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2022-04-28T14:38:37.029 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2022-04-28T14:38:37.029 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:37.029 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2022-04-28T14:38:37.029 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2022-04-28T14:38:37.029 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:37.029 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2022-04-28T14:38:37.029 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2022-04-28T14:38:37.029 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:37.029 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2022-04-28T14:38:37.030 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:37.030 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2022-04-28T14:38:37.030 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2022-04-28T14:38:37.030 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2022-04-28T14:38:37.030 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2022-04-28T14:38:37.030 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2022-04-28T14:38:37.030 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2022-04-28T14:38:37.030 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2022-04-28T14:38:37.030 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-04-28T14:38:37.030 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2022-04-28T14:38:37.031 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2022-04-28T14:38:37.031 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:37.031 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2022-04-28T14:38:37.031 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:37.031 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2022-04-28T14:38:37.031 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:37.031 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2022-04-28T14:38:37.031 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:37.031 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2022-04-28T14:38:37.032 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2022-04-28T14:38:37.032 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2022-04-28T14:38:37.032 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = "172.21.15.22,[v2:172.21.15.22:3301,v1:172.21.15.22:6790],[v2:172.21.15.22:3302,v1:172.21.15.22:6791]" 2022-04-28T14:38:37.032 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on pool no app = False 2022-04-28T14:38:37.032 INFO:teuthology.orchestra.run.smithi037.stdout: ms bind msgr2 = False 2022-04-28T14:38:37.032 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore warn on legacy statfs = False 2022-04-28T14:38:37.032 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore warn on no per pool omap = False 2022-04-28T14:38:37.032 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn min per osd = 0 2022-04-28T14:38:37.032 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = 3047163a-0285-4058-8e05-ce74c6fbb9c5 2022-04-28T14:38:37.032 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:37.033 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2022-04-28T14:38:37.033 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2022-04-28T14:38:37.033 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:37.033 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2022-04-28T14:38:37.033 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2022-04-28T14:38:37.033 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:37.033 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2022-04-28T14:38:37.033 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2022-04-28T14:38:37.033 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:37.033 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2022-04-28T14:38:37.034 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2022-04-28T14:38:37.034 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2022-04-28T14:38:37.034 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:37.034 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2022-04-28T14:38:37.034 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2022-04-28T14:38:37.034 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:37.034 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2022-04-28T14:38:37.034 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:37.034 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2022-04-28T14:38:37.034 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:37.035 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2022-04-28T14:38:37.035 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:37.035 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2022-04-28T14:38:37.035 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2022-04-28T14:38:37.035 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:37.035 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2022-04-28T14:38:37.035 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2022-04-28T14:38:37.035 INFO:teuthology.orchestra.run.smithi037.stdout: bdev async discard = True 2022-04-28T14:38:37.042 INFO:teuthology.orchestra.run.smithi037.stdout: bdev enable discard = True 2022-04-28T14:38:37.042 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore allocator = bitmap 2022-04-28T14:38:37.042 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2022-04-28T14:38:37.042 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2022-04-28T14:38:37.042 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 1/20 2022-04-28T14:38:37.043 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 1/20 2022-04-28T14:38:37.043 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2022-04-28T14:38:37.043 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2022-04-28T14:38:37.043 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 4/10 2022-04-28T14:38:37.043 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2022-04-28T14:38:37.043 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2022-04-28T14:38:37.043 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2022-04-28T14:38:37.043 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2022-04-28T14:38:37.043 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2022-04-28T14:38:37.044 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2022-04-28T14:38:37.044 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:37.044 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2022-04-28T14:38:37.044 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2022-04-28T14:38:37.044 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2022-04-28T14:38:37.044 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2022-04-28T14:38:37.044 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2022-04-28T14:38:37.044 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2022-04-28T14:38:37.044 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2022-04-28T14:38:37.044 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2022-04-28T14:38:37.045 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:37.045 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2022-04-28T14:38:37.045 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2022-04-28T14:38:37.045 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2022-04-28T14:38:37.045 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2022-04-28T14:38:37.045 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2022-04-28T14:38:37.045 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2022-04-28T14:38:37.045 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2022-04-28T14:38:37.045 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2022-04-28T14:38:37.045 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2022-04-28T14:38:37.046 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2022-04-28T14:38:37.046 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2022-04-28T14:38:37.046 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:37.046 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-04-28T14:38:37.046 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2022-04-28T14:38:37.046 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2022-04-28T14:38:37.046 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:37.046 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2022-04-28T14:38:37.046 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-04-28T14:38:37.047 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-04-28T14:38:37.047 INFO:teuthology.orchestra.run.smithi037.stdout: mon op complaint time = 120 2022-04-28T14:38:37.047 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = False 2022-04-28T14:38:37.047 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-04-28T14:38:37.047 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2022-04-28T14:38:37.047 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2022-04-28T14:38:37.047 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = true 2022-04-28T14:38:37.047 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2022-04-28T14:38:37.047 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-04-28T14:38:37.047 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-04-28T14:38:37.047 INFO:teuthology.orchestra.run.smithi037.stdout: client mount timeout = 600 2022-04-28T14:38:37.048 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2022-04-28T14:38:37.048 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2022-04-28T14:38:37.048 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2022-04-28T14:38:37.048 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2022-04-28T14:38:37.048 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2022-04-28T14:38:37.048 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.b] 2022-04-28T14:38:37.048 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.c] 2022-04-28T14:38:37.048 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2022-04-28T14:38:37.048 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2022-04-28T14:38:37.048 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2022-04-28T14:38:37.049 INFO:teuthology.orchestra.run.smithi037.stdout:[mds] 2022-04-28T14:38:37.049 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds = 20 2022-04-28T14:38:37.049 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2022-04-28T14:38:37.049 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug frag = True 2022-04-28T14:38:37.049 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug scatterstat = True 2022-04-28T14:38:37.049 INFO:teuthology.orchestra.run.smithi037.stdout: mds op complaint time = 180 2022-04-28T14:38:37.049 INFO:teuthology.orchestra.run.smithi037.stdout: mds verify scatter = True 2022-04-28T14:38:37.049 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2022-04-28T14:38:37.049 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2022-04-28T14:38:37.049 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2022-04-28T14:38:37.052 INFO:tasks.ceph:Creating admin key on mon.a... 2022-04-28T14:38:37.052 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2022-04-28T14:38:37.167 INFO:tasks.ceph:Copying monmap to all nodes... 2022-04-28T14:38:37.168 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2022-04-28T14:38:37.168 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2022-04-28T14:38:37.184 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2022-04-28T14:38:37.184 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2022-04-28T14:38:37.241 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi022.front.sepia.ceph.com 2022-04-28T14:38:37.241 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2022-04-28T14:38:37.241 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.keyring 2022-04-28T14:38:37.241 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-04-28T14:38:37.319 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2022-04-28T14:38:37.319 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-04-28T14:38:37.376 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi037.front.sepia.ceph.com 2022-04-28T14:38:37.376 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2022-04-28T14:38:37.376 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.keyring 2022-04-28T14:38:37.377 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-04-28T14:38:37.422 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2022-04-28T14:38:37.422 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-04-28T14:38:37.482 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi039.front.sepia.ceph.com 2022-04-28T14:38:37.482 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2022-04-28T14:38:37.482 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/ceph/ceph.keyring 2022-04-28T14:38:37.482 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-04-28T14:38:37.527 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2022-04-28T14:38:37.527 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-04-28T14:38:37.587 INFO:tasks.ceph:Setting up mon nodes... 2022-04-28T14:38:37.587 INFO:tasks.ceph:Setting up mgr nodes... 2022-04-28T14:38:37.587 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2022-04-28T14:38:37.662 INFO:teuthology.orchestra.run.smithi022.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2022-04-28T14:38:37.665 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2022-04-28T14:38:37.740 INFO:teuthology.orchestra.run.smithi022.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2022-04-28T14:38:37.742 INFO:tasks.ceph:Setting up mds nodes... 2022-04-28T14:38:37.742 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2022-04-28T14:38:37.816 INFO:teuthology.orchestra.run.smithi022.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2022-04-28T14:38:37.819 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2022-04-28T14:38:37.846 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2022-04-28T14:38:37.961 INFO:teuthology.orchestra.run.smithi022.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2022-04-28T14:38:37.963 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2022-04-28T14:38:37.990 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2022-04-28T14:38:38.105 INFO:teuthology.orchestra.run.smithi022.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2022-04-28T14:38:38.108 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2022-04-28T14:38:38.135 INFO:tasks.ceph_client:Setting up client nodes... 2022-04-28T14:38:38.135 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2022-04-28T14:38:38.270 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.client.0.keyring 2022-04-28T14:38:38.287 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2022-04-28T14:38:38.416 INFO:teuthology.orchestra.run.smithi039.stdout:creating /etc/ceph/ceph.client.1.keyring 2022-04-28T14:38:38.435 INFO:tasks.ceph:Running mkfs on osd nodes... 2022-04-28T14:38:38.435 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi022.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2022-04-28T14:38:38.436 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2022-04-28T14:38:38.463 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-04-28T14:38:38.464 INFO:tasks.ceph:role: osd.0 2022-04-28T14:38:38.464 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi022.front.sepia.ceph.com 2022-04-28T14:38:38.464 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-04-28T14:38:38.531 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-04-28T14:38:38.531 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2022-04-28T14:38:38.532 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-04-28T14:38:38.532 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-04-28T14:38:38.532 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-04-28T14:38:38.532 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2022-04-28T14:38:38.532 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-04-28T14:38:38.532 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-04-28T14:38:38.532 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-04-28T14:38:38.532 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-04-28T14:38:38.554 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2022-04-28T14:38:38.556 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2022-04-28T14:38:38.556 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2022-04-28T14:38:38.638 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2022-04-28T14:38:38.711 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2022-04-28T14:38:38.780 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-04-28T14:38:38.780 INFO:tasks.ceph:role: osd.1 2022-04-28T14:38:38.780 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi022.front.sepia.ceph.com 2022-04-28T14:38:38.780 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-04-28T14:38:38.847 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-04-28T14:38:38.848 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2022-04-28T14:38:38.848 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-04-28T14:38:38.848 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-04-28T14:38:38.848 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-04-28T14:38:38.848 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2022-04-28T14:38:38.848 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-04-28T14:38:38.848 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-04-28T14:38:38.848 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-04-28T14:38:38.848 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-04-28T14:38:38.870 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2022-04-28T14:38:38.871 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2022-04-28T14:38:38.872 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2022-04-28T14:38:38.951 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2022-04-28T14:38:39.023 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2022-04-28T14:38:39.091 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-04-28T14:38:39.091 INFO:tasks.ceph:role: osd.2 2022-04-28T14:38:39.091 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi022.front.sepia.ceph.com 2022-04-28T14:38:39.091 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-04-28T14:38:39.158 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-04-28T14:38:39.158 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2022-04-28T14:38:39.158 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-04-28T14:38:39.158 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-04-28T14:38:39.158 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-04-28T14:38:39.158 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2022-04-28T14:38:39.158 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-04-28T14:38:39.159 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-04-28T14:38:39.159 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-04-28T14:38:39.159 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-04-28T14:38:39.180 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2022-04-28T14:38:39.182 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2022-04-28T14:38:39.182 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2022-04-28T14:38:39.264 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2022-04-28T14:38:39.335 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2022-04-28T14:38:39.403 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-04-28T14:38:39.403 INFO:tasks.ceph:role: osd.3 2022-04-28T14:38:39.403 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi022.front.sepia.ceph.com 2022-04-28T14:38:39.404 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-04-28T14:38:39.470 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-04-28T14:38:39.470 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2022-04-28T14:38:39.470 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-04-28T14:38:39.470 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-04-28T14:38:39.470 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-04-28T14:38:39.470 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2022-04-28T14:38:39.471 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-04-28T14:38:39.471 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-04-28T14:38:39.471 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-04-28T14:38:39.471 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-04-28T14:38:39.494 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2022-04-28T14:38:39.495 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2022-04-28T14:38:39.496 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2022-04-28T14:38:39.575 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2022-04-28T14:38:39.646 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-04-28T14:38:39.755 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:39.750 7f64fcbb1dc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2022-04-28T14:38:39.755 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:39.751 7f64fcbb1dc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2022-04-28T14:38:39.755 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:39.751 7f64fcbb1dc0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-04-28T14:38:39.755 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:39.751 7f64fcbb1dc0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-04-28T14:38:39.756 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:39.751 7f64fcbb1dc0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-04-28T14:38:39.756 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:39.751 7f64fcbb1dc0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2022-04-28T14:38:42.605 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2022-04-28T14:38:42.638 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-04-28T14:38:42.752 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:42.747 7f49fb3dddc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2022-04-28T14:38:42.752 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:42.747 7f49fb3dddc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2022-04-28T14:38:42.752 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:42.747 7f49fb3dddc0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-04-28T14:38:42.752 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:42.747 7f49fb3dddc0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-04-28T14:38:42.752 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:42.747 7f49fb3dddc0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-04-28T14:38:42.753 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:42.748 7f49fb3dddc0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2022-04-28T14:38:45.588 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2022-04-28T14:38:45.621 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-04-28T14:38:45.735 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:45.730 7fc3c03b7dc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2022-04-28T14:38:45.735 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:45.730 7fc3c03b7dc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2022-04-28T14:38:45.735 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:45.730 7fc3c03b7dc0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-04-28T14:38:45.735 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:45.730 7fc3c03b7dc0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-04-28T14:38:45.735 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:45.730 7fc3c03b7dc0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-04-28T14:38:45.735 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:45.731 7fc3c03b7dc0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2022-04-28T14:38:48.577 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2022-04-28T14:38:48.610 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-04-28T14:38:48.724 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:48.718 7f8e3cc6fdc0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2022-04-28T14:38:48.724 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:48.719 7f8e3cc6fdc0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2022-04-28T14:38:48.724 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:48.719 7f8e3cc6fdc0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-04-28T14:38:48.724 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:48.719 7f8e3cc6fdc0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-04-28T14:38:48.724 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:48.719 7f8e3cc6fdc0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-04-28T14:38:48.725 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:48.719 7f8e3cc6fdc0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2022-04-28T14:38:51.575 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2022-04-28T14:38:51.607 INFO:tasks.ceph:Reading keys from all nodes... 2022-04-28T14:38:51.608 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2022-04-28T14:38:51.608 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2022-04-28T14:38:51.678 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2022-04-28T14:38:51.678 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2022-04-28T14:38:51.747 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2022-04-28T14:38:51.747 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2022-04-28T14:38:51.816 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2022-04-28T14:38:51.816 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2022-04-28T14:38:51.885 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2022-04-28T14:38:51.885 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2022-04-28T14:38:51.954 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2022-04-28T14:38:51.954 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2022-04-28T14:38:52.022 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2022-04-28T14:38:52.023 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2022-04-28T14:38:52.090 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2022-04-28T14:38:52.090 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2022-04-28T14:38:52.156 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2022-04-28T14:38:52.157 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2022-04-28T14:38:52.223 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2022-04-28T14:38:52.223 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2022-04-28T14:38:52.244 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2022-04-28T14:38:52.244 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2022-04-28T14:38:52.265 INFO:tasks.ceph:Adding keys to all mons... 2022-04-28T14:38:52.265 DEBUG:teuthology.orchestra.run.smithi022:> sudo tee -a /etc/ceph/ceph.keyring 2022-04-28T14:38:52.291 INFO:teuthology.orchestra.run.smithi022.stdout:[mgr.x] 2022-04-28T14:38:52.291 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQDtpmpi/mxFJxAATjQoaYyEfacyPQu8O0afDA== 2022-04-28T14:38:52.291 INFO:teuthology.orchestra.run.smithi022.stdout:[mgr.y] 2022-04-28T14:38:52.292 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQDtpmpis3/hKxAAQrxiUn6RG9nMSy20FZK2zA== 2022-04-28T14:38:52.292 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.a] 2022-04-28T14:38:52.292 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQDtpmpiRMN9MBAA9QcyoIMhW4VgrCUt81pbNA== 2022-04-28T14:38:52.292 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.b] 2022-04-28T14:38:52.292 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQDtpmpik5sTORAAjaTpD/ydOTRnkHMV6/guIQ== 2022-04-28T14:38:52.292 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.c] 2022-04-28T14:38:52.292 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQDupmpi5IgUBhAAuqfe2YSu0LtjL97o20adkQ== 2022-04-28T14:38:52.292 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.0] 2022-04-28T14:38:52.292 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQDvpmpiuxTELBAAqq8RQZAa4cWz+WbvHqOpeg== 2022-04-28T14:38:52.293 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.1] 2022-04-28T14:38:52.293 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQDypmpiHnaULBAAEG35ZVYI7A9Qhv6yphWtYA== 2022-04-28T14:38:52.293 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.2] 2022-04-28T14:38:52.293 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQD1pmpiwpCRKxAAQ7I/IKtIyR/dADEoCa5KgQ== 2022-04-28T14:38:52.293 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.3] 2022-04-28T14:38:52.293 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQD4pmpieazqKhAA1+ov2L0vpJJsxUmPVSANlw== 2022-04-28T14:38:52.293 INFO:teuthology.orchestra.run.smithi022.stdout:[client.0] 2022-04-28T14:38:52.293 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQDupmpixnrvDxAALVoB6lLAnNNaJVKKdlocAg== 2022-04-28T14:38:52.293 INFO:teuthology.orchestra.run.smithi022.stdout:[client.1] 2022-04-28T14:38:52.293 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQDupmpinJWYGBAAQFWny5N6YY+iCuMW8TgYcg== 2022-04-28T14:38:52.294 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-04-28T14:38:52.408 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-04-28T14:38:52.481 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-04-28T14:38:52.558 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-04-28T14:38:52.634 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-04-28T14:38:52.709 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-04-28T14:38:52.783 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-04-28T14:38:52.857 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-04-28T14:38:52.929 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-04-28T14:38:53.004 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-04-28T14:38:53.080 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-04-28T14:38:53.156 INFO:tasks.ceph:Running mkfs on mon nodes... 2022-04-28T14:38:53.157 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2022-04-28T14:38:53.184 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-04-28T14:38:53.302 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2022-04-28T14:38:53.329 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2022-04-28T14:38:53.396 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-04-28T14:38:53.516 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2022-04-28T14:38:53.542 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2022-04-28T14:38:53.609 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-04-28T14:38:53.727 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2022-04-28T14:38:53.754 DEBUG:teuthology.orchestra.run.smithi022:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-04-28T14:38:53.811 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2022-04-28T14:38:53.812 INFO:tasks.ceph.mon.a:Restarting daemon 2022-04-28T14:38:53.812 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2022-04-28T14:38:53.854 INFO:tasks.ceph.mon.a:Started 2022-04-28T14:38:53.854 INFO:tasks.ceph.mon.b:Restarting daemon 2022-04-28T14:38:53.854 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2022-04-28T14:38:53.856 INFO:tasks.ceph.mon.b:Started 2022-04-28T14:38:53.856 INFO:tasks.ceph.mon.c:Restarting daemon 2022-04-28T14:38:53.856 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2022-04-28T14:38:53.858 INFO:tasks.ceph.mon.c:Started 2022-04-28T14:38:53.858 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2022-04-28T14:38:53.859 INFO:tasks.ceph.mgr.x:Restarting daemon 2022-04-28T14:38:53.859 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2022-04-28T14:38:53.862 INFO:tasks.ceph.mgr.x:Started 2022-04-28T14:38:53.862 INFO:tasks.ceph.mgr.y:Restarting daemon 2022-04-28T14:38:53.862 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2022-04-28T14:38:53.864 INFO:tasks.ceph.mgr.y:Started 2022-04-28T14:38:53.865 INFO:tasks.ceph:Setting crush tunables to default 2022-04-28T14:38:53.865 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --cluster ceph osd crush tunables default 2022-04-28T14:38:54.052 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.046 7ff1538e1700 1 Processor -- start 2022-04-28T14:38:54.052 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.046 7ff1538e1700 1 -- start start 2022-04-28T14:38:54.052 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.046 7ff1538e1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff14c1b2fa0 0x7ff14c1b7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:54.052 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.046 7ff1538e1700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff14c1b8120 0x7ff14c1ba580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:54.053 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.046 7ff1538e1700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff14c0ab2b0 con 0x7ff14c0f6530 2022-04-28T14:38:54.053 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.046 7ff1538e1700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff14c10d320 con 0x7ff14c1b2fa0 2022-04-28T14:38:54.053 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.046 7ff1538e1700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c10ce80 con 0x7ff14c1b8120 2022-04-28T14:38:54.053 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.046 7ff14b7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff14c1b2fa0 0x7ff14c1b7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:54.053 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.046 7ff150ee1700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff14c1b8120 0x7ff14c1ba580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:54.053 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.046 7ff14b7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff14c1b2fa0 0x7ff14c1b7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48164/0 (socket says 172.21.15.22:48164) 2022-04-28T14:38:54.054 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.046 7ff14b7fe700 1 -- 172.21.15.22:0/3888336643 learned_addr learned my addr 172.21.15.22:0/3888336643 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:38:54.054 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.046 7ff150ee1700 1 -- 172.21.15.22:0/3888336643 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff14c1b8120 msgr2=0x7ff14c1ba580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-04-28T14:38:54.054 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.046 7ff14b7fe700 1 -- 172.21.15.22:0/3888336643 >> v2:172.21.15.22:3300/0 conn(0x7ff14c1b2fa0 msgr2=0x7ff14c1b7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-04-28T14:38:54.054 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.046 7ff150ee1700 1 -- 172.21.15.22:0/3888336643 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff14c1b8120 msgr2=0x7ff14c1ba580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-04-28T14:38:54.054 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.046 7ff14b7fe700 1 -- 172.21.15.22:0/3888336643 >> v2:172.21.15.22:3300/0 conn(0x7ff14c1b2fa0 msgr2=0x7ff14c1b7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-04-28T14:38:54.054 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.046 7ff150ee1700 1 --2- 172.21.15.22:0/3888336643 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff14c1b8120 0x7ff14c1ba580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-04-28T14:38:54.054 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.046 7ff14b7fe700 1 --2- 172.21.15.22:0/3888336643 >> v2:172.21.15.22:3300/0 conn(0x7ff14c1b2fa0 0x7ff14c1b7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-04-28T14:38:54.054 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.046 7ff150ee1700 1 --2- 172.21.15.22:0/3888336643 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff14c1b8120 0x7ff14c1ba580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-04-28T14:38:54.054 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.047 7ff14b7fe700 1 --2- 172.21.15.22:0/3888336643 >> v2:172.21.15.22:3300/0 conn(0x7ff14c1b2fa0 0x7ff14c1b7af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-04-28T14:38:54.248 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.240 7ff14affd700 1 -- 172.21.15.22:0/3888336643 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055791485 0 0) 0x7ff13c001110 con 0x7ff14c0f6530 2022-04-28T14:38:54.248 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.240 7ff14affd700 1 -- 172.21.15.22:0/3888336643 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff138003270 con 0x7ff14c0f6530 2022-04-28T14:38:54.249 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.240 7ff14affd700 1 -- 172.21.15.22:0/3888336643 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 816401423 0 0) 0x7ff13c0015e0 con 0x7ff14c0f6530 2022-04-28T14:38:54.249 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.240 7ff14affd700 1 -- 172.21.15.22:0/3888336643 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff14c1b8120 msgr2=0x7ff14c1ba580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-04-28T14:38:54.249 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.240 7ff14affd700 1 --2- 172.21.15.22:0/3888336643 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff14c1b8120 0x7ff14c1ba580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:54.249 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.240 7ff14affd700 1 -- 172.21.15.22:0/3888336643 >> v2:172.21.15.22:3300/0 conn(0x7ff14c1b2fa0 msgr2=0x7ff14c1b7af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-04-28T14:38:54.249 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.240 7ff14affd700 1 --2- 172.21.15.22:0/3888336643 >> v2:172.21.15.22:3300/0 conn(0x7ff14c1b2fa0 0x7ff14c1b7af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:54.250 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.240 7ff14affd700 1 -- 172.21.15.22:0/3888336643 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c10d550 con 0x7ff14c0f6530 2022-04-28T14:38:54.250 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.240 7ff14affd700 1 -- 172.21.15.22:0/3888336643 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (unknown 4283608803 0 0) 0x7ff13c001b40 con 0x7ff14c0f6530 2022-04-28T14:38:54.250 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.240 7ff14affd700 1 -- 172.21.15.22:0/3888336643 >> v1:172.21.15.22:6789/0 conn(0x7ff14c0f6530 legacy=0x7ff14c1b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:54.250 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.240 7ff14affd700 1 --2- 172.21.15.22:0/3888336643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1380038f0 0x7ff138003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:54.250 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.240 7ff14affd700 1 --2- 172.21.15.22:0/3888336643 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff1380045d0 0x7ff138004a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:54.250 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.240 7ff14affd700 1 --2- 172.21.15.22:0/3888336643 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff138009810 0x7ff13800bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:54.250 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.240 7ff14affd700 1 -- 172.21.15.22:0/3888336643 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c10d320 con 0x7ff1380038f0 2022-04-28T14:38:54.251 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.240 7ff14affd700 1 -- 172.21.15.22:0/3888336643 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c10ce80 con 0x7ff138009810 2022-04-28T14:38:54.251 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.240 7ff14affd700 1 -- 172.21.15.22:0/3888336643 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff13800c320 con 0x7ff1380045d0 2022-04-28T14:38:54.251 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.240 7ff150ee1700 1 --2- 172.21.15.22:0/3888336643 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff138009810 0x7ff13800bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:54.251 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.241 7ff14b7fe700 1 --2- 172.21.15.22:0/3888336643 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff1380045d0 0x7ff138004a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:54.251 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.241 7ff150ee1700 1 -- 172.21.15.22:0/3888336643 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff1380045d0 msgr2=0x7ff138004a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:38:54.251 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.241 7ff150ee1700 1 --2- 172.21.15.22:0/3888336643 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff1380045d0 0x7ff138004a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:54.251 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.241 7ff150ee1700 1 -- 172.21.15.22:0/3888336643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1380038f0 msgr2=0x7ff138003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:38:54.251 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.241 7ff150ee1700 1 --2- 172.21.15.22:0/3888336643 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff1380038f0 0x7ff138003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-04-28T14:38:54.251 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.241 7ff150ee1700 1 -- 172.21.15.22:0/3888336643 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13800c610 con 0x7ff138009810 2022-04-28T14:38:54.252 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.241 7ff150ee1700 1 --2- 172.21.15.22:0/3888336643 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff138009810 0x7ff13800bc70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7ff144001210 tx=0x7ff144009190).ready entity=mon.1 client_cookie=c7604d636973a643 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:38:54.252 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.241 7ff14affd700 1 -- 172.21.15.22:0/3888336643 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff13800c610 con 0x7ff138009810 2022-04-28T14:38:54.252 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.241 7ff14affd700 1 -- 172.21.15.22:0/3888336643 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14400e650 con 0x7ff138009810 2022-04-28T14:38:54.252 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.241 7ff14affd700 1 -- 172.21.15.22:0/3888336643 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff14400ea20 con 0x7ff138009810 2022-04-28T14:38:54.252 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.241 7ff1538e1700 1 -- 172.21.15.22:0/3888336643 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff138009810 msgr2=0x7ff13800bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:54.252 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.241 7ff1538e1700 1 --2- 172.21.15.22:0/3888336643 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff138009810 0x7ff13800bc70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7ff144001210 tx=0x7ff144009190).stop 2022-04-28T14:38:54.252 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.241 7ff150ee1700 1 -- 172.21.15.22:0/3888336643 reap_dead start 2022-04-28T14:38:54.252 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.242 7ff1538e1700 1 -- 172.21.15.22:0/3888336643 shutdown_connections 2022-04-28T14:38:54.252 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.242 7ff1538e1700 1 -- 172.21.15.22:0/3888336643 >> 172.21.15.22:0/3888336643 conn(0x7ff14c117260 msgr2=0x7ff14c0f2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:38:54.252 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.242 7ff1538e1700 1 -- 172.21.15.22:0/3888336643 shutdown_connections 2022-04-28T14:38:54.253 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.242 7ff1538e1700 1 -- 172.21.15.22:0/3888336643 wait complete. 2022-04-28T14:38:54.271 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.266 7ff1538e1700 1 Processor -- start 2022-04-28T14:38:54.271 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.266 7ff1538e1700 1 -- start start 2022-04-28T14:38:54.274 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.267 7ff1538e1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff14c0b4bb0 0x7ff14c0b3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:54.274 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.267 7ff1538e1700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff14c0b3aa0 0x7ff14c1c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:54.274 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.267 7ff1538e1700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff14c0b3ef0 0x7ff14c1c4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:54.274 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.267 7ff1538e1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c0d6120 con 0x7ff14c0b4bb0 2022-04-28T14:38:54.274 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.267 7ff1538e1700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c0de370 con 0x7ff14c0b3aa0 2022-04-28T14:38:54.275 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.267 7ff1538e1700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c0b5610 con 0x7ff14c0b3ef0 2022-04-28T14:38:54.275 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.267 7ff14b7fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff14c0b3aa0 0x7ff14c1c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:54.275 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.267 7ff14b7fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff14c0b3aa0 0x7ff14c1c3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:45768/0 (socket says 172.21.15.22:45768) 2022-04-28T14:38:54.275 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.267 7ff150ee1700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff14c0b3ef0 0x7ff14c1c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:54.275 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.267 7ff14b7fe700 1 -- 172.21.15.22:0/1294264904 learned_addr learned my addr 172.21.15.22:0/1294264904 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:38:54.276 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.267 7ff14bfff700 1 --2- 172.21.15.22:0/1294264904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff14c0b4bb0 0x7ff14c0b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:54.276 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.267 7ff150ee1700 1 -- 172.21.15.22:0/1294264904 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff14c0b3aa0 msgr2=0x7ff14c1c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:54.276 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.267 7ff150ee1700 1 --2- 172.21.15.22:0/1294264904 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff14c0b3aa0 0x7ff14c1c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:54.276 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.267 7ff150ee1700 1 -- 172.21.15.22:0/1294264904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff14c0b4bb0 msgr2=0x7ff14c0b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:54.276 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.267 7ff150ee1700 1 --2- 172.21.15.22:0/1294264904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff14c0b4bb0 0x7ff14c0b3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:54.276 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.267 7ff150ee1700 1 -- 172.21.15.22:0/1294264904 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c0d5e00 con 0x7ff14c0b3ef0 2022-04-28T14:38:54.277 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.267 7ff14bfff700 1 --2- 172.21.15.22:0/1294264904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff14c0b4bb0 0x7ff14c0b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-04-28T14:38:54.277 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.267 7ff150ee1700 1 --2- 172.21.15.22:0/1294264904 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff14c0b3ef0 0x7ff14c1c4320 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7ff13c001810 tx=0x7ff144006bb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:38:54.277 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.268 7ff1497fa700 1 -- 172.21.15.22:0/1294264904 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff14c0d5e00 con 0x7ff14c0b3ef0 2022-04-28T14:38:54.277 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.268 7ff1497fa700 1 -- 172.21.15.22:0/1294264904 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14400eb90 con 0x7ff14c0b3ef0 2022-04-28T14:38:54.277 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.268 7ff1497fa700 1 -- 172.21.15.22:0/1294264904 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff144022070 con 0x7ff14c0b3ef0 2022-04-28T14:38:54.278 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.268 7ff1538e1700 1 -- 172.21.15.22:0/1294264904 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14c0b5270 con 0x7ff14c0b3ef0 2022-04-28T14:38:54.278 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.268 7ff1538e1700 1 -- 172.21.15.22:0/1294264904 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14c1c4950 con 0x7ff14c0b3ef0 2022-04-28T14:38:54.278 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.268 7ff1497fa700 1 -- 172.21.15.22:0/1294264904 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7ff14401a070 con 0x7ff14c0b3ef0 2022-04-28T14:38:54.278 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.268 7ff1497fa700 1 -- 172.21.15.22:0/1294264904 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7ff144006020 con 0x7ff14c0b3ef0 2022-04-28T14:38:54.278 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.269 7ff1538e1700 1 -- 172.21.15.22:0/1294264904 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff14c0f0400 con 0x7ff14c0b3ef0 2022-04-28T14:38:54.279 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.271 7ff1497fa700 1 -- 172.21.15.22:0/1294264904 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66062 (secure 0 0 0) 0x7ff14400e980 con 0x7ff14c0b3ef0 2022-04-28T14:38:54.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.337 7ff1538e1700 1 -- 172.21.15.22:0/1294264904 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff14c1c4d80 con 0x7ff14c0b3ef0 2022-04-28T14:38:54.344 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.339 7ff1497fa700 1 -- 172.21.15.22:0/1294264904 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff144010040 con 0x7ff14c0b3ef0 2022-04-28T14:38:54.346 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.340 7ff1538e1700 1 -- 172.21.15.22:0/1294264904 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff14c0b3ef0 msgr2=0x7ff14c1c4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:54.346 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.340 7ff1538e1700 1 --2- 172.21.15.22:0/1294264904 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff14c0b3ef0 0x7ff14c1c4320 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7ff13c001810 tx=0x7ff144006bb0).stop 2022-04-28T14:38:54.346 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.340 7ff1538e1700 1 -- 172.21.15.22:0/1294264904 shutdown_connections 2022-04-28T14:38:54.346 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.340 7ff1538e1700 1 --2- 172.21.15.22:0/1294264904 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff14c0b3ef0 0x7ff14c1c4320 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:54.346 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.340 7ff1538e1700 1 --2- 172.21.15.22:0/1294264904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff14c0b4bb0 0x7ff14c0b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:54.346 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.340 7ff1538e1700 1 --2- 172.21.15.22:0/1294264904 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff14c0b3aa0 0x7ff14c1c3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:54.346 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.340 7ff1538e1700 1 -- 172.21.15.22:0/1294264904 >> 172.21.15.22:0/1294264904 conn(0x7ff14c0bb810 msgr2=0x7ff14c0bac20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:38:54.346 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.340 7ff1538e1700 1 -- 172.21.15.22:0/1294264904 shutdown_connections 2022-04-28T14:38:54.347 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.341 7ff1538e1700 1 -- 172.21.15.22:0/1294264904 wait complete. 2022-04-28T14:38:54.347 INFO:teuthology.orchestra.run.smithi022.stderr:adjusted tunables profile to default 2022-04-28T14:38:54.356 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2022-04-28T14:38:54.357 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2022-04-28T14:38:54.357 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2022-04-28T14:38:54.384 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2022-04-28T14:38:54.385 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2022-04-28T14:38:54.451 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2022-04-28T14:38:54.451 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2022-04-28T14:38:54.520 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2022-04-28T14:38:54.520 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2022-04-28T14:38:54.587 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --cluster ceph osd new 782ee638-1ada-48d9-9454-f9e0ca8a3135 0 2022-04-28T14:38:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.754 7f31e9651700 1 Processor -- start 2022-04-28T14:38:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.755 7f31e9651700 1 -- start start 2022-04-28T14:38:54.761 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.755 7f31e9651700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f31e41b7830 0x7f31e41b9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:54.761 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.755 7f31e9651700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f31e41ba2c0 0x7f31e41bc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:54.761 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.755 7f31e9651700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e40ab2b0 con 0x7f31e40f2470 2022-04-28T14:38:54.761 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.755 7f31e9651700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e40f1df0 con 0x7f31e41ba2c0 2022-04-28T14:38:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.755 7f31e9651700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e40f1b30 con 0x7f31e41b7830 2022-04-28T14:38:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.755 7f31e2ab2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f31e41ba2c0 0x7f31e41bc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.755 7f31e22b1700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f31e40f2470 0x7f31e41b4b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37610/0 (socket says 172.21.15.22:37610) 2022-04-28T14:38:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.756 7f31e22b1700 1 -- 172.21.15.22:0/3335962421 learned_addr learned my addr 172.21.15.22:0/3335962421 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:38:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.756 7f31e1ab0700 1 --2- 172.21.15.22:0/3335962421 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f31e41b7830 0x7f31e41b9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.756 7f31e1ab0700 1 -- 172.21.15.22:0/3335962421 >> v2:172.21.15.22:3300/0 conn(0x7f31e41ba2c0 msgr2=0x7f31e41bc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:38:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.756 7f31e1ab0700 1 --2- 172.21.15.22:0/3335962421 >> v2:172.21.15.22:3300/0 conn(0x7f31e41ba2c0 0x7f31e41bc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.756 7f31e1ab0700 1 -- 172.21.15.22:0/3335962421 >> v1:172.21.15.22:6789/0 conn(0x7f31e40f2470 legacy=0x7f31e41b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.756 7f31e12af700 1 -- 172.21.15.22:0/3335962421 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 980558498 0 0) 0x7f31d4001110 con 0x7f31e40f2470 2022-04-28T14:38:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.756 7f31e1ab0700 1 -- 172.21.15.22:0/3335962421 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e40f28c0 con 0x7f31e41b7830 2022-04-28T14:38:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.756 7f31e2ab2700 1 --2- 172.21.15.22:0/3335962421 >> v2:172.21.15.22:3300/0 conn(0x7f31e41ba2c0 0x7f31e41bc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:38:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.756 7f31e1ab0700 1 --2- 172.21.15.22:0/3335962421 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f31e41b7830 0x7f31e41b9c90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f31d8002f70 tx=0x7f31d800b970).ready entity=mon.1 client_cookie=6051f657c8c1a6d6 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:38:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.756 7f31e12af700 1 -- 172.21.15.22:0/3335962421 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f31e40f28c0 con 0x7f31e41b7830 2022-04-28T14:38:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.756 7f31e12af700 1 -- 172.21.15.22:0/3335962421 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d800d610 con 0x7f31e41b7830 2022-04-28T14:38:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.756 7f31e12af700 1 -- 172.21.15.22:0/3335962421 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f31d800d9e0 con 0x7f31e41b7830 2022-04-28T14:38:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.756 7f31e9651700 1 -- 172.21.15.22:0/3335962421 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f31e41b7830 msgr2=0x7f31e41b9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.756 7f31e9651700 1 --2- 172.21.15.22:0/3335962421 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f31e41b7830 0x7f31e41b9c90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f31d8002f70 tx=0x7f31d800b970).stop 2022-04-28T14:38:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.757 7f31e9651700 1 -- 172.21.15.22:0/3335962421 shutdown_connections 2022-04-28T14:38:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.757 7f31e9651700 1 --2- 172.21.15.22:0/3335962421 >> v2:172.21.15.22:3300/0 conn(0x7f31e41ba2c0 0x7f31e41bc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.757 7f31e9651700 1 --2- 172.21.15.22:0/3335962421 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f31e41b7830 0x7f31e41b9c90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.757 7f31e9651700 1 -- 172.21.15.22:0/3335962421 >> 172.21.15.22:0/3335962421 conn(0x7f31e4124020 msgr2=0x7f31e4124470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:38:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.757 7f31e9651700 1 -- 172.21.15.22:0/3335962421 shutdown_connections 2022-04-28T14:38:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.757 7f31e9651700 1 -- 172.21.15.22:0/3335962421 wait complete. 2022-04-28T14:38:54.799 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.794 7f31e9651700 1 Processor -- start 2022-04-28T14:38:54.799 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.795 7f31e9651700 1 -- start start 2022-04-28T14:38:54.801 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.795 7f31e9651700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f31e40d5170 0x7f31e40d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:54.802 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.795 7f31e9651700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f31e40d0ad0 0x7f31e41c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:54.802 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.795 7f31e9651700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31e40d0f20 0x7f31e41c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:54.802 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.795 7f31e9651700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e40b8710 con 0x7f31e40d0f20 2022-04-28T14:38:54.802 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.795 7f31e9651700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e40d1a20 con 0x7f31e40d5170 2022-04-28T14:38:54.802 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.795 7f31e9651700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31e40cfbe0 con 0x7f31e40d0ad0 2022-04-28T14:38:54.802 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.795 7f31e1ab0700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f31e40d0ad0 0x7f31e41c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:54.802 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.795 7f31e22b1700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f31e40d5170 0x7f31e40d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:54.802 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.795 7f31e1ab0700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f31e40d0ad0 0x7f31e41c5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:45574/0 (socket says 172.21.15.22:45574) 2022-04-28T14:38:54.802 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.795 7f31e1ab0700 1 -- 172.21.15.22:0/3566950634 learned_addr learned my addr 172.21.15.22:0/3566950634 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:38:54.803 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.795 7f31e2ab2700 1 --2- 172.21.15.22:0/3566950634 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31e40d0f20 0x7f31e41c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:54.803 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.796 7f31e2ab2700 1 -- 172.21.15.22:0/3566950634 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f31e40d0ad0 msgr2=0x7f31e41c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:54.803 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.796 7f31e2ab2700 1 --2- 172.21.15.22:0/3566950634 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f31e40d0ad0 0x7f31e41c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:54.803 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.796 7f31e2ab2700 1 -- 172.21.15.22:0/3566950634 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f31e40d5170 msgr2=0x7f31e40d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:54.803 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.796 7f31e2ab2700 1 --2- 172.21.15.22:0/3566950634 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f31e40d5170 0x7f31e40d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:54.803 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.796 7f31e2ab2700 1 -- 172.21.15.22:0/3566950634 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e40cf290 con 0x7f31e40d0f20 2022-04-28T14:38:54.803 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.796 7f31e1ab0700 1 --2- 172.21.15.22:0/3566950634 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f31e40d0ad0 0x7f31e41c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:38:54.803 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.796 7f31e2ab2700 1 --2- 172.21.15.22:0/3566950634 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31e40d0f20 0x7f31e41c6160 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f31e40d00d0 tx=0x7f31dc00ed70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:38:54.803 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.796 7f31d37fe700 1 -- 172.21.15.22:0/3566950634 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f31e40cf290 con 0x7f31e40d0f20 2022-04-28T14:38:54.803 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.796 7f31d37fe700 1 -- 172.21.15.22:0/3566950634 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31dc00c880 con 0x7f31e40d0f20 2022-04-28T14:38:54.804 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.796 7f31d37fe700 1 -- 172.21.15.22:0/3566950634 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f31dc00f040 con 0x7f31e40d0f20 2022-04-28T14:38:54.804 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.796 7f31e9651700 1 -- 172.21.15.22:0/3566950634 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e40d1c70 con 0x7f31e40d0f20 2022-04-28T14:38:54.804 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.796 7f31e9651700 1 -- 172.21.15.22:0/3566950634 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e40cf650 con 0x7f31e40d0f20 2022-04-28T14:38:54.804 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.797 7f31d37fe700 1 -- 172.21.15.22:0/3566950634 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7f31dc022060 con 0x7f31e40d0f20 2022-04-28T14:38:54.804 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.797 7f31d37fe700 1 -- 172.21.15.22:0/3566950634 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f31dc010040 con 0x7f31e40d0f20 2022-04-28T14:38:54.805 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.798 7f31e9651700 1 -- 172.21.15.22:0/3566950634 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e40f0400 con 0x7f31e40d0f20 2022-04-28T14:38:54.805 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.800 7f31d37fe700 1 -- 172.21.15.22:0/3566950634 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66062 (secure 0 0 0) 0x7f31dc00c670 con 0x7f31e40d0f20 2022-04-28T14:38:54.891 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.887 7f31e9651700 1 -- 172.21.15.22:0/3566950634 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd new", "uuid": "782ee638-1ada-48d9-9454-f9e0ca8a3135", "id": 0} v 0) v1 -- 0x7f31e40a5b80 con 0x7f31e40d0f20 2022-04-28T14:38:54.894 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.889 7f31d37fe700 1 -- 172.21.15.22:0/3566950634 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "782ee638-1ada-48d9-9454-f9e0ca8a3135", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f31e40ff260 con 0x7f31e40d0f20 2022-04-28T14:38:54.894 INFO:teuthology.orchestra.run.smithi022.stdout:0 2022-04-28T14:38:54.895 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.890 7f31e9651700 1 -- 172.21.15.22:0/3566950634 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31e40d0f20 msgr2=0x7f31e41c6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:54.895 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.890 7f31e9651700 1 --2- 172.21.15.22:0/3566950634 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31e40d0f20 0x7f31e41c6160 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f31e40d00d0 tx=0x7f31dc00ed70).stop 2022-04-28T14:38:54.896 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.890 7f31e9651700 1 -- 172.21.15.22:0/3566950634 shutdown_connections 2022-04-28T14:38:54.896 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.891 7f31e9651700 1 --2- 172.21.15.22:0/3566950634 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31e40d0f20 0x7f31e41c6160 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:54.896 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.891 7f31e9651700 1 --2- 172.21.15.22:0/3566950634 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f31e40d5170 0x7f31e40d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:54.896 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.891 7f31e9651700 1 --2- 172.21.15.22:0/3566950634 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f31e40d0ad0 0x7f31e41c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:54.896 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.891 7f31e9651700 1 -- 172.21.15.22:0/3566950634 >> 172.21.15.22:0/3566950634 conn(0x7f31e40aced0 msgr2=0x7f31e40bb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:38:54.896 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.891 7f31e9651700 1 -- 172.21.15.22:0/3566950634 shutdown_connections 2022-04-28T14:38:54.896 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:54.891 7f31e9651700 1 -- 172.21.15.22:0/3566950634 wait complete. 2022-04-28T14:38:54.907 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --cluster ceph osd new 61ca6f96-fb4f-4c0f-b68b-edf1e7011f1c 1 2022-04-28T14:38:55.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.038 7fd9e1127700 1 Processor -- start 2022-04-28T14:38:55.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.038 7fd9e1127700 1 -- start start 2022-04-28T14:38:55.046 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.039 7fd9e1127700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd9dc115a30 0x7fd9dc0f13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:55.046 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.039 7fd9e1127700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd9dc0f1e30 0x7fd9dc1b5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:55.046 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.039 7fd9e1127700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9dc0ab0b0 con 0x7fd9dc0f19e0 2022-04-28T14:38:55.046 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.039 7fd9e1127700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9dc1b56a0 con 0x7fd9dc115a30 2022-04-28T14:38:55.047 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.039 7fd9e1127700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc115070 con 0x7fd9dc0f1e30 2022-04-28T14:38:55.047 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.039 7fd9d95ff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd9dc0f19e0 0x7fd9dc1b4870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37624/0 (socket says 172.21.15.22:37624) 2022-04-28T14:38:55.047 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.039 7fd9d95ff700 1 -- 172.21.15.22:0/1208010302 learned_addr learned my addr 172.21.15.22:0/1208010302 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:38:55.047 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.039 7fd9d9e00700 1 --2- 172.21.15.22:0/1208010302 >> v2:172.21.15.22:3300/0 conn(0x7fd9dc115a30 0x7fd9dc0f13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:55.047 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.039 7fd9da601700 1 --2- 172.21.15.22:0/1208010302 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd9dc0f1e30 0x7fd9dc1b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:55.047 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.039 7fd9d8dfe700 1 -- 172.21.15.22:0/1208010302 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642654573 0 0) 0x7fd9d0001110 con 0x7fd9dc0f19e0 2022-04-28T14:38:55.047 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.039 7fd9d8dfe700 1 -- 172.21.15.22:0/1208010302 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9c0003270 con 0x7fd9dc0f19e0 2022-04-28T14:38:55.047 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.040 7fd9d9e00700 1 -- 172.21.15.22:0/1208010302 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd9dc0f1e30 msgr2=0x7fd9dc1b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:38:55.047 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.040 7fd9d9e00700 1 --2- 172.21.15.22:0/1208010302 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd9dc0f1e30 0x7fd9dc1b5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.047 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.040 7fd9d9e00700 1 -- 172.21.15.22:0/1208010302 >> v1:172.21.15.22:6789/0 conn(0x7fd9dc0f19e0 legacy=0x7fd9dc1b4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:55.048 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.040 7fd9d9e00700 1 -- 172.21.15.22:0/1208010302 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9dc10f8a0 con 0x7fd9dc115a30 2022-04-28T14:38:55.048 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.040 7fd9da601700 1 --2- 172.21.15.22:0/1208010302 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd9dc0f1e30 0x7fd9dc1b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:38:55.048 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.040 7fd9d9e00700 1 --2- 172.21.15.22:0/1208010302 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9dc115a30 0x7fd9dc0f13b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fd9dc117120 tx=0x7fd9cc00ba20).ready entity=mon.0 client_cookie=4db25737b82ff2d6 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:38:55.048 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.040 7fd9d8dfe700 1 -- 172.21.15.22:0/1208010302 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd9cc00d5c0 con 0x7fd9dc115a30 2022-04-28T14:38:55.048 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.040 7fd9d8dfe700 1 -- 172.21.15.22:0/1208010302 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc00d7c0 con 0x7fd9dc115a30 2022-04-28T14:38:55.048 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.040 7fd9d8dfe700 1 -- 172.21.15.22:0/1208010302 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd9cc00db90 con 0x7fd9dc115a30 2022-04-28T14:38:55.048 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.040 7fd9e1127700 1 -- 172.21.15.22:0/1208010302 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9dc115a30 msgr2=0x7fd9dc0f13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:55.048 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.040 7fd9e1127700 1 --2- 172.21.15.22:0/1208010302 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9dc115a30 0x7fd9dc0f13b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fd9dc117120 tx=0x7fd9cc00ba20).stop 2022-04-28T14:38:55.048 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.041 7fd9e1127700 1 -- 172.21.15.22:0/1208010302 shutdown_connections 2022-04-28T14:38:55.048 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.041 7fd9e1127700 1 --2- 172.21.15.22:0/1208010302 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd9dc0f1e30 0x7fd9dc1b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.049 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.041 7fd9e1127700 1 --2- 172.21.15.22:0/1208010302 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9dc115a30 0x7fd9dc0f13b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.049 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.041 7fd9e1127700 1 -- 172.21.15.22:0/1208010302 >> 172.21.15.22:0/1208010302 conn(0x7fd9dc117260 msgr2=0x7fd9dc0f2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:38:55.049 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.041 7fd9e1127700 1 -- 172.21.15.22:0/1208010302 shutdown_connections 2022-04-28T14:38:55.049 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.041 7fd9e1127700 1 -- 172.21.15.22:0/1208010302 wait complete. 2022-04-28T14:38:55.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.080 7fd9e1127700 1 Processor -- start 2022-04-28T14:38:55.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.080 7fd9e1127700 1 -- start start 2022-04-28T14:38:55.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.081 7fd9e1127700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd9dc0d19d0 0x7fd9dc1c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:55.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.081 7fd9e1127700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd9dc1c63f0 0x7fd9dc1b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:55.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.081 7fd9e1127700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9dc1c6840 0x7fd9dc1b6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:55.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.081 7fd9e1127700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc0bebf0 con 0x7fd9dc1c6840 2022-04-28T14:38:55.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.081 7fd9e1127700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc0d11f0 con 0x7fd9dc0d19d0 2022-04-28T14:38:55.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.081 7fd9e1127700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc0cc420 con 0x7fd9dc1c63f0 2022-04-28T14:38:55.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.081 7fd9d9e00700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd9dc0d19d0 0x7fd9dc1c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:55.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.081 7fd9d9e00700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd9dc0d19d0 0x7fd9dc1c5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:45800/0 (socket says 172.21.15.22:45800) 2022-04-28T14:38:55.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.081 7fd9d9e00700 1 -- 172.21.15.22:0/3655068871 learned_addr learned my addr 172.21.15.22:0/3655068871 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:38:55.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.081 7fd9d95ff700 1 --2- 172.21.15.22:0/3655068871 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd9dc1c63f0 0x7fd9dc1b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:55.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.081 7fd9da601700 1 --2- 172.21.15.22:0/3655068871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9dc1c6840 0x7fd9dc1b6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:55.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.081 7fd9d9e00700 1 -- 172.21.15.22:0/3655068871 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd9dc1c63f0 msgr2=0x7fd9dc1b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:55.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.081 7fd9d9e00700 1 --2- 172.21.15.22:0/3655068871 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd9dc1c63f0 0x7fd9dc1b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.081 7fd9d9e00700 1 -- 172.21.15.22:0/3655068871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9dc1c6840 msgr2=0x7fd9dc1b6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:55.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.081 7fd9d9e00700 1 --2- 172.21.15.22:0/3655068871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9dc1c6840 0x7fd9dc1b6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.081 7fd9d9e00700 1 -- 172.21.15.22:0/3655068871 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9dc1b5880 con 0x7fd9dc0d19d0 2022-04-28T14:38:55.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.081 7fd9d95ff700 1 --2- 172.21.15.22:0/3655068871 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd9dc1c63f0 0x7fd9dc1b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:38:55.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.081 7fd9d9e00700 1 --2- 172.21.15.22:0/3655068871 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd9dc0d19d0 0x7fd9dc1c5dc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fd9dc0d1580 tx=0x7fd9cc0068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:38:55.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.082 7fd9caffd700 1 -- 172.21.15.22:0/3655068871 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd9dc1b5880 con 0x7fd9dc0d19d0 2022-04-28T14:38:55.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.082 7fd9caffd700 1 -- 172.21.15.22:0/3655068871 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc006a90 con 0x7fd9dc0d19d0 2022-04-28T14:38:55.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.082 7fd9e1127700 1 -- 172.21.15.22:0/3655068871 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9dc0ce9c0 con 0x7fd9dc0d19d0 2022-04-28T14:38:55.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.082 7fd9caffd700 1 -- 172.21.15.22:0/3655068871 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd9cc017040 con 0x7fd9dc0d19d0 2022-04-28T14:38:55.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.082 7fd9e1127700 1 -- 172.21.15.22:0/3655068871 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9dc0d1e20 con 0x7fd9dc0d19d0 2022-04-28T14:38:55.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.082 7fd9caffd700 1 -- 172.21.15.22:0/3655068871 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd9cc011ba0 con 0x7fd9dc0d19d0 2022-04-28T14:38:55.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.082 7fd9caffd700 1 -- 172.21.15.22:0/3655068871 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 857+0+0 (secure 0 0 0) 0x7fd9cc018070 con 0x7fd9dc0d19d0 2022-04-28T14:38:55.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.083 7fd9e1127700 1 -- 172.21.15.22:0/3655068871 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9dc0f0400 con 0x7fd9dc0d19d0 2022-04-28T14:38:55.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.085 7fd9caffd700 1 -- 172.21.15.22:0/3655068871 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66062 (secure 0 0 0) 0x7fd9cc0117a0 con 0x7fd9dc0d19d0 2022-04-28T14:38:55.165 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.160 7fd9e1127700 1 -- 172.21.15.22:0/3655068871 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd new", "uuid": "61ca6f96-fb4f-4c0f-b68b-edf1e7011f1c", "id": 1} v 0) v1 -- 0x7fd9dc0a5b80 con 0x7fd9dc0d19d0 2022-04-28T14:38:55.168 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.163 7fd9caffd700 1 -- 172.21.15.22:0/3655068871 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "61ca6f96-fb4f-4c0f-b68b-edf1e7011f1c", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd9cc00d3b0 con 0x7fd9dc0d19d0 2022-04-28T14:38:55.168 INFO:teuthology.orchestra.run.smithi022.stdout:1 2022-04-28T14:38:55.169 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.164 7fd9e1127700 1 -- 172.21.15.22:0/3655068871 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd9dc0d19d0 msgr2=0x7fd9dc1c5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:55.169 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.164 7fd9e1127700 1 --2- 172.21.15.22:0/3655068871 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd9dc0d19d0 0x7fd9dc1c5dc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fd9dc0d1580 tx=0x7fd9cc0068c0).stop 2022-04-28T14:38:55.169 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.164 7fd9e1127700 1 -- 172.21.15.22:0/3655068871 shutdown_connections 2022-04-28T14:38:55.170 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.164 7fd9e1127700 1 --2- 172.21.15.22:0/3655068871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9dc1c6840 0x7fd9dc1b6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.170 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.164 7fd9e1127700 1 --2- 172.21.15.22:0/3655068871 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd9dc0d19d0 0x7fd9dc1c5dc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.170 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.164 7fd9e1127700 1 --2- 172.21.15.22:0/3655068871 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd9dc1c63f0 0x7fd9dc1b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.170 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.164 7fd9e1127700 1 -- 172.21.15.22:0/3655068871 >> 172.21.15.22:0/3655068871 conn(0x7fd9dc0e04a0 msgr2=0x7fd9dc0aca80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:38:55.170 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.164 7fd9e1127700 1 -- 172.21.15.22:0/3655068871 shutdown_connections 2022-04-28T14:38:55.170 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.164 7fd9e1127700 1 -- 172.21.15.22:0/3655068871 wait complete. 2022-04-28T14:38:55.181 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --cluster ceph osd new 4b3043b9-50df-4b7f-a55a-ac8e6148c449 2 2022-04-28T14:38:55.311 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.306 7fb3e988a700 1 Processor -- start 2022-04-28T14:38:55.311 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.306 7fb3e988a700 1 -- start start 2022-04-28T14:38:55.313 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.307 7fb3e988a700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb3e40fa400 0x7fb3e40f0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:55.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.307 7fb3e988a700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb3e40fa850 0x7fb3e40f1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:55.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.307 7fb3e988a700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e40ab0b0 con 0x7fb3e4120cb0 2022-04-28T14:38:55.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.307 7fb3e988a700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e40f2780 con 0x7fb3e40fa400 2022-04-28T14:38:55.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.307 7fb3e988a700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e40f24a0 con 0x7fb3e40fa850 2022-04-28T14:38:55.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.307 7fb3e1dc4700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb3e40fa850 0x7fb3e40f1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:55.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.307 7fb3e1dc4700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb3e40fa850 0x7fb3e40f1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:45592/0 (socket says 172.21.15.22:45592) 2022-04-28T14:38:55.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.307 7fb3e1dc4700 1 -- 172.21.15.22:0/1972533682 learned_addr learned my addr 172.21.15.22:0/1972533682 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:38:55.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.307 7fb3e25c5700 1 --2- 172.21.15.22:0/1972533682 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb3e40fa400 0x7fb3e40f0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:55.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.307 7fb3e1dc4700 1 -- 172.21.15.22:0/1972533682 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb3e40fa400 msgr2=0x7fb3e40f0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:38:55.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.307 7fb3e1dc4700 1 --2- 172.21.15.22:0/1972533682 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb3e40fa400 0x7fb3e40f0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.307 7fb3e1dc4700 1 -- 172.21.15.22:0/1972533682 >> v1:172.21.15.22:6789/0 conn(0x7fb3e4120cb0 legacy=0x7fb3e4121100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:55.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.307 7fb3e15c3700 1 -- 172.21.15.22:0/1972533682 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272386125 0 0) 0x7fb3dc001490 con 0x7fb3e4120cb0 2022-04-28T14:38:55.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.308 7fb3e1dc4700 1 -- 172.21.15.22:0/1972533682 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e410beb0 con 0x7fb3e40fa850 2022-04-28T14:38:55.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.308 7fb3e25c5700 1 --2- 172.21.15.22:0/1972533682 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb3e40fa400 0x7fb3e40f0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:38:55.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.308 7fb3e1dc4700 1 --2- 172.21.15.22:0/1972533682 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb3e40fa850 0x7fb3e40f1250 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fb3d8002f70 tx=0x7fb3d8009a00).ready entity=mon.2 client_cookie=c29943df2e0c138f server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:38:55.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.308 7fb3e15c3700 1 -- 172.21.15.22:0/1972533682 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb3e410beb0 con 0x7fb3e40fa850 2022-04-28T14:38:55.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.308 7fb3e15c3700 1 -- 172.21.15.22:0/1972533682 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d800f510 con 0x7fb3e40fa850 2022-04-28T14:38:55.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.308 7fb3e15c3700 1 -- 172.21.15.22:0/1972533682 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb3d800f6f0 con 0x7fb3e40fa850 2022-04-28T14:38:55.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.308 7fb3e988a700 1 -- 172.21.15.22:0/1972533682 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb3e40fa850 msgr2=0x7fb3e40f1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:55.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.308 7fb3e988a700 1 --2- 172.21.15.22:0/1972533682 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb3e40fa850 0x7fb3e40f1250 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fb3d8002f70 tx=0x7fb3d8009a00).stop 2022-04-28T14:38:55.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.309 7fb3e988a700 1 -- 172.21.15.22:0/1972533682 shutdown_connections 2022-04-28T14:38:55.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.309 7fb3e988a700 1 --2- 172.21.15.22:0/1972533682 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb3e40fa400 0x7fb3e40f0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.309 7fb3e988a700 1 --2- 172.21.15.22:0/1972533682 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb3e40fa850 0x7fb3e40f1250 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.309 7fb3e988a700 1 -- 172.21.15.22:0/1972533682 >> 172.21.15.22:0/1972533682 conn(0x7fb3e40f2ce0 msgr2=0x7fb3e4124020 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:38:55.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.309 7fb3e988a700 1 -- 172.21.15.22:0/1972533682 shutdown_connections 2022-04-28T14:38:55.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.309 7fb3e988a700 1 -- 172.21.15.22:0/1972533682 wait complete. 2022-04-28T14:38:55.339 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.333 7fb3e988a700 1 Processor -- start 2022-04-28T14:38:55.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.333 7fb3e988a700 1 -- start start 2022-04-28T14:38:55.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.333 7fb3e988a700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb3e40d1370 0x7fb3e40b8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:55.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.333 7fb3e988a700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb3e40b9e70 0x7fb3e40ba2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:55.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.333 7fb3e988a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb3e40ba8f0 0x7fb3e41c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:55.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.333 7fb3e988a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e40f09c0 con 0x7fb3e40ba8f0 2022-04-28T14:38:55.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.333 7fb3e988a700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e40b87b0 con 0x7fb3e40d1370 2022-04-28T14:38:55.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.333 7fb3e988a700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e40b8af0 con 0x7fb3e40b9e70 2022-04-28T14:38:55.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.333 7fb3e1dc4700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb3e40b9e70 0x7fb3e40ba2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:55.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.333 7fb3e1dc4700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb3e40b9e70 0x7fb3e40ba2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:45598/0 (socket says 172.21.15.22:45598) 2022-04-28T14:38:55.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.333 7fb3e1dc4700 1 -- 172.21.15.22:0/4282265750 learned_addr learned my addr 172.21.15.22:0/4282265750 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:38:55.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.333 7fb3e25c5700 1 --2- 172.21.15.22:0/4282265750 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb3e40d1370 0x7fb3e40b8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:55.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.333 7fb3e2dc6700 1 --2- 172.21.15.22:0/4282265750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb3e40ba8f0 0x7fb3e41c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:55.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.334 7fb3e2dc6700 1 -- 172.21.15.22:0/4282265750 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb3e40b9e70 msgr2=0x7fb3e40ba2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:55.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.334 7fb3e2dc6700 1 --2- 172.21.15.22:0/4282265750 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb3e40b9e70 0x7fb3e40ba2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.334 7fb3e2dc6700 1 -- 172.21.15.22:0/4282265750 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb3e40d1370 msgr2=0x7fb3e40b8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:55.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.334 7fb3e2dc6700 1 --2- 172.21.15.22:0/4282265750 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb3e40d1370 0x7fb3e40b8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.334 7fb3e2dc6700 1 -- 172.21.15.22:0/4282265750 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e40b9880 con 0x7fb3e40ba8f0 2022-04-28T14:38:55.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.334 7fb3e25c5700 1 --2- 172.21.15.22:0/4282265750 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb3e40d1370 0x7fb3e40b8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:38:55.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.334 7fb3e1dc4700 1 --2- 172.21.15.22:0/4282265750 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb3e40b9e70 0x7fb3e40ba2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:38:55.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.334 7fb3e2dc6700 1 --2- 172.21.15.22:0/4282265750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb3e40ba8f0 0x7fb3e41c3a30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fb3e40d7390 tx=0x7fb3dc00a330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:38:55.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.334 7fb3d37fe700 1 -- 172.21.15.22:0/4282265750 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb3dc00ad00 con 0x7fb3e40ba8f0 2022-04-28T14:38:55.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.334 7fb3d37fe700 1 -- 172.21.15.22:0/4282265750 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3dc019070 con 0x7fb3e40ba8f0 2022-04-28T14:38:55.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.334 7fb3e988a700 1 -- 172.21.15.22:0/4282265750 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e40b95c0 con 0x7fb3e40ba8f0 2022-04-28T14:38:55.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.334 7fb3d37fe700 1 -- 172.21.15.22:0/4282265750 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb3dc006a90 con 0x7fb3e40ba8f0 2022-04-28T14:38:55.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.334 7fb3e988a700 1 -- 172.21.15.22:0/4282265750 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e41c4060 con 0x7fb3e40ba8f0 2022-04-28T14:38:55.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.334 7fb3d37fe700 1 -- 172.21.15.22:0/4282265750 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7fb3dc025070 con 0x7fb3e40ba8f0 2022-04-28T14:38:55.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.335 7fb3d37fe700 1 -- 172.21.15.22:0/4282265750 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 960+0+0 (secure 0 0 0) 0x7fb3dc008540 con 0x7fb3e40ba8f0 2022-04-28T14:38:55.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.335 7fb3e988a700 1 -- 172.21.15.22:0/4282265750 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e40f0400 con 0x7fb3e40ba8f0 2022-04-28T14:38:55.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.338 7fb3d37fe700 1 -- 172.21.15.22:0/4282265750 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66062 (secure 0 0 0) 0x7fb3dc00a900 con 0x7fb3e40ba8f0 2022-04-28T14:38:55.418 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.413 7fb3e988a700 1 -- 172.21.15.22:0/4282265750 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4b3043b9-50df-4b7f-a55a-ac8e6148c449", "id": 2} v 0) v1 -- 0x7fb3e40e1e60 con 0x7fb3e40ba8f0 2022-04-28T14:38:55.420 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.416 7fb3d37fe700 1 -- 172.21.15.22:0/4282265750 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4b3043b9-50df-4b7f-a55a-ac8e6148c449", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb3e40ff260 con 0x7fb3e40ba8f0 2022-04-28T14:38:55.421 INFO:teuthology.orchestra.run.smithi022.stdout:2 2022-04-28T14:38:55.422 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.417 7fb3e988a700 1 -- 172.21.15.22:0/4282265750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb3e40ba8f0 msgr2=0x7fb3e41c3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:55.423 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.417 7fb3e988a700 1 --2- 172.21.15.22:0/4282265750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb3e40ba8f0 0x7fb3e41c3a30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fb3e40d7390 tx=0x7fb3dc00a330).stop 2022-04-28T14:38:55.423 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.417 7fb3e988a700 1 -- 172.21.15.22:0/4282265750 shutdown_connections 2022-04-28T14:38:55.423 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.417 7fb3e988a700 1 --2- 172.21.15.22:0/4282265750 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb3e40ba8f0 0x7fb3e41c3a30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.423 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.417 7fb3e988a700 1 --2- 172.21.15.22:0/4282265750 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb3e40d1370 0x7fb3e40b8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.423 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.417 7fb3e988a700 1 --2- 172.21.15.22:0/4282265750 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb3e40b9e70 0x7fb3e40ba2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.423 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.417 7fb3e988a700 1 -- 172.21.15.22:0/4282265750 >> 172.21.15.22:0/4282265750 conn(0x7fb3e40aee40 msgr2=0x7fb3e40f66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:38:55.423 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.417 7fb3e988a700 1 -- 172.21.15.22:0/4282265750 shutdown_connections 2022-04-28T14:38:55.423 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.418 7fb3e988a700 1 -- 172.21.15.22:0/4282265750 wait complete. 2022-04-28T14:38:55.433 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --cluster ceph osd new 7807bcd1-53f8-44b5-9992-57c328e5b299 3 2022-04-28T14:38:55.568 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.561 7f03a6f0e700 1 Processor -- start 2022-04-28T14:38:55.568 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.561 7f03a6f0e700 1 -- start start 2022-04-28T14:38:55.568 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.561 7f03a6f0e700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f03a00f6390 0x7f03a00f67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:55.568 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.561 7f03a6f0e700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f03a01b2640 0x7f03a01b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:55.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.561 7f03a6f0e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f03a01b30c0 0x7f03a00f13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:55.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.561 7f03a6f0e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a0111d90 con 0x7f03a01b30c0 2022-04-28T14:38:55.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.561 7f03a6f0e700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a0111720 con 0x7f03a00f6390 2022-04-28T14:38:55.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.561 7f03a6f0e700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03a010d640 con 0x7f03a01b2640 2022-04-28T14:38:55.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.561 7f039effd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f03a01b2640 0x7f03a01b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:55.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.561 7f039effd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f03a01b2640 0x7f03a01b2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:45604/0 (socket says 172.21.15.22:45604) 2022-04-28T14:38:55.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.562 7f039effd700 1 -- 172.21.15.22:0/4018630443 learned_addr learned my addr 172.21.15.22:0/4018630443 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:38:55.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.562 7f039ffff700 1 --2- 172.21.15.22:0/4018630443 >> v2:172.21.15.22:3300/0 conn(0x7f03a01b30c0 0x7f03a00f13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:55.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.562 7f039f7fe700 1 --2- 172.21.15.22:0/4018630443 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f03a00f6390 0x7f03a00f67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:55.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.562 7f039ffff700 1 -- 172.21.15.22:0/4018630443 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f03a01b2640 msgr2=0x7f03a01b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:38:55.570 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.562 7f039ffff700 1 --2- 172.21.15.22:0/4018630443 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f03a01b2640 0x7f03a01b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.570 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.562 7f039ffff700 1 -- 172.21.15.22:0/4018630443 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f03a00f6390 msgr2=0x7f03a00f67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:38:55.570 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.562 7f039ffff700 1 --2- 172.21.15.22:0/4018630443 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f03a00f6390 0x7f03a00f67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.570 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.562 7f039ffff700 1 -- 172.21.15.22:0/4018630443 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a010cd00 con 0x7f03a01b30c0 2022-04-28T14:38:55.570 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.562 7f039effd700 1 --2- 172.21.15.22:0/4018630443 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f03a01b2640 0x7f03a01b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:38:55.570 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.562 7f039f7fe700 1 --2- 172.21.15.22:0/4018630443 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f03a00f6390 0x7f03a00f67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:38:55.570 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.562 7f039ffff700 1 --2- 172.21.15.22:0/4018630443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03a01b30c0 0x7f03a00f13b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f0398002f70 tx=0x7f039800b9f0).ready entity=mon.0 client_cookie=c8623e24b2360215 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:38:55.570 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.562 7f039e7fc700 1 -- 172.21.15.22:0/4018630443 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f03a010cd00 con 0x7f03a01b30c0 2022-04-28T14:38:55.570 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.562 7f039e7fc700 1 -- 172.21.15.22:0/4018630443 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039800d570 con 0x7f03a01b30c0 2022-04-28T14:38:55.570 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.562 7f039e7fc700 1 -- 172.21.15.22:0/4018630443 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f039800d940 con 0x7f03a01b30c0 2022-04-28T14:38:55.571 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.563 7f03a6f0e700 1 -- 172.21.15.22:0/4018630443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03a01b30c0 msgr2=0x7f03a00f13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:55.571 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.563 7f03a6f0e700 1 --2- 172.21.15.22:0/4018630443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03a01b30c0 0x7f03a00f13b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f0398002f70 tx=0x7f039800b9f0).stop 2022-04-28T14:38:55.571 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.563 7f03a6f0e700 1 -- 172.21.15.22:0/4018630443 shutdown_connections 2022-04-28T14:38:55.571 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.563 7f03a6f0e700 1 --2- 172.21.15.22:0/4018630443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03a01b30c0 0x7f03a00f13b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.571 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.563 7f03a6f0e700 1 --2- 172.21.15.22:0/4018630443 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f03a00f6390 0x7f03a00f67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.571 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.563 7f03a6f0e700 1 --2- 172.21.15.22:0/4018630443 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f03a01b2640 0x7f03a01b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.571 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.563 7f03a6f0e700 1 -- 172.21.15.22:0/4018630443 >> 172.21.15.22:0/4018630443 conn(0x7f03a0117260 msgr2=0x7f03a00f2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:38:55.571 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.563 7f03a6f0e700 1 -- 172.21.15.22:0/4018630443 shutdown_connections 2022-04-28T14:38:55.571 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.563 7f03a6f0e700 1 -- 172.21.15.22:0/4018630443 wait complete. 2022-04-28T14:38:55.592 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.587 7f03a6f0e700 1 Processor -- start 2022-04-28T14:38:55.592 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.587 7f03a6f0e700 1 -- start start 2022-04-28T14:38:55.594 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.588 7f03a6f0e700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f03a00d3310 0x7f03a01baa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:55.594 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.588 7f03a6f0e700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f03a01bb060 0x7f03a01c11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:55.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.588 7f03a6f0e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03a01bb4b0 0x7f03a01c17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:55.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.588 7f03a6f0e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a00d3b70 con 0x7f03a01bb4b0 2022-04-28T14:38:55.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.588 7f03a6f0e700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a00baee0 con 0x7f03a00d3310 2022-04-28T14:38:55.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.588 7f03a6f0e700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03a00bb220 con 0x7f03a01bb060 2022-04-28T14:38:55.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.588 7f039ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03a01bb4b0 0x7f03a01c17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:55.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.588 7f039ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03a01bb4b0 0x7f03a01c17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48258/0 (socket says 172.21.15.22:48258) 2022-04-28T14:38:55.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.588 7f039f7fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f03a00d3310 0x7f03a01baa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:55.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.588 7f039ffff700 1 -- 172.21.15.22:0/3529094793 learned_addr learned my addr 172.21.15.22:0/3529094793 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:38:55.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.588 7f039effd700 1 --2- 172.21.15.22:0/3529094793 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f03a01bb060 0x7f03a01c11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:55.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.589 7f039effd700 1 -- 172.21.15.22:0/3529094793 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f03a00d3310 msgr2=0x7f03a01baa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:55.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.589 7f039effd700 1 --2- 172.21.15.22:0/3529094793 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f03a00d3310 0x7f03a01baa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.589 7f039effd700 1 -- 172.21.15.22:0/3529094793 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03a01bb4b0 msgr2=0x7f03a01c17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:55.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.589 7f039effd700 1 --2- 172.21.15.22:0/3529094793 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03a01bb4b0 0x7f03a01c17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.589 7f039effd700 1 -- 172.21.15.22:0/3529094793 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a00decc0 con 0x7f03a01bb060 2022-04-28T14:38:55.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.589 7f039f7fe700 1 --2- 172.21.15.22:0/3529094793 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f03a00d3310 0x7f03a01baa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:38:55.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.589 7f039ffff700 1 --2- 172.21.15.22:0/3529094793 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03a01bb4b0 0x7f03a01c17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:38:55.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.589 7f039effd700 1 --2- 172.21.15.22:0/3529094793 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f03a01bb060 0x7f03a01c11a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f03a00df3a0 tx=0x7f0388009cb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:38:55.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.589 7f039cff9700 1 -- 172.21.15.22:0/3529094793 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0388016030 con 0x7f03a01bb060 2022-04-28T14:38:55.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.589 7f039cff9700 1 -- 172.21.15.22:0/3529094793 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038800ba10 con 0x7f03a01bb060 2022-04-28T14:38:55.597 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.589 7f039cff9700 1 -- 172.21.15.22:0/3529094793 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f038800bde0 con 0x7f03a01bb060 2022-04-28T14:38:55.597 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.589 7f03a6f0e700 1 -- 172.21.15.22:0/3529094793 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a00dea30 con 0x7f03a01bb060 2022-04-28T14:38:55.597 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.589 7f03a6f0e700 1 -- 172.21.15.22:0/3529094793 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a01bed50 con 0x7f03a01bb060 2022-04-28T14:38:55.597 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.589 7f039cff9700 1 -- 172.21.15.22:0/3529094793 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7f0388022070 con 0x7f03a01bb060 2022-04-28T14:38:55.597 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.589 7f039cff9700 1 -- 172.21.15.22:0/3529094793 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1063+0+0 (secure 0 0 0) 0x7f038801aae0 con 0x7f03a01bb060 2022-04-28T14:38:55.597 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.590 7f03a6f0e700 1 -- 172.21.15.22:0/3529094793 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a00f0400 con 0x7f03a01bb060 2022-04-28T14:38:55.597 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.592 7f039cff9700 1 -- 172.21.15.22:0/3529094793 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66062 (secure 0 0 0) 0x7f038800b610 con 0x7f03a01bb060 2022-04-28T14:38:55.671 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.666 7f03a6f0e700 1 -- 172.21.15.22:0/3529094793 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "osd new", "uuid": "7807bcd1-53f8-44b5-9992-57c328e5b299", "id": 3} v 0) v1 -- 0x7f03a0112a50 con 0x7f03a01bb060 2022-04-28T14:38:55.674 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.670 7f039cff9700 1 -- 172.21.15.22:0/3529094793 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7807bcd1-53f8-44b5-9992-57c328e5b299", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0388000c30 con 0x7f03a01bb060 2022-04-28T14:38:55.675 INFO:teuthology.orchestra.run.smithi022.stdout:3 2022-04-28T14:38:55.676 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.671 7f03a6f0e700 1 -- 172.21.15.22:0/3529094793 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f03a01bb060 msgr2=0x7f03a01c11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:55.676 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.671 7f03a6f0e700 1 --2- 172.21.15.22:0/3529094793 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f03a01bb060 0x7f03a01c11a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f03a00df3a0 tx=0x7f0388009cb0).stop 2022-04-28T14:38:55.676 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.671 7f03a6f0e700 1 -- 172.21.15.22:0/3529094793 shutdown_connections 2022-04-28T14:38:55.676 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.671 7f03a6f0e700 1 --2- 172.21.15.22:0/3529094793 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03a01bb4b0 0x7f03a01c17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.676 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.671 7f03a6f0e700 1 --2- 172.21.15.22:0/3529094793 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f03a00d3310 0x7f03a01baa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.676 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.671 7f03a6f0e700 1 --2- 172.21.15.22:0/3529094793 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f03a01bb060 0x7f03a01c11a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.676 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.671 7f03a6f0e700 1 -- 172.21.15.22:0/3529094793 >> 172.21.15.22:0/3529094793 conn(0x7f03a00d1100 msgr2=0x7f03a00e0840 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:38:55.677 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.671 7f03a6f0e700 1 -- 172.21.15.22:0/3529094793 shutdown_connections 2022-04-28T14:38:55.677 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.671 7f03a6f0e700 1 -- 172.21.15.22:0/3529094793 wait complete. 2022-04-28T14:38:55.687 INFO:tasks.ceph.osd.0:Restarting daemon 2022-04-28T14:38:55.688 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2022-04-28T14:38:55.690 INFO:tasks.ceph.osd.0:Started 2022-04-28T14:38:55.691 INFO:tasks.ceph.osd.1:Restarting daemon 2022-04-28T14:38:55.691 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2022-04-28T14:38:55.694 INFO:tasks.ceph.osd.1:Started 2022-04-28T14:38:55.694 INFO:tasks.ceph.osd.2:Restarting daemon 2022-04-28T14:38:55.694 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2022-04-28T14:38:55.697 INFO:tasks.ceph.osd.2:Started 2022-04-28T14:38:55.698 INFO:tasks.ceph.osd.3:Restarting daemon 2022-04-28T14:38:55.698 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2022-04-28T14:38:55.701 INFO:tasks.ceph.osd.3:Started 2022-04-28T14:38:55.702 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-28T14:38:55.895 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.889 7f4319758700 1 Processor -- start 2022-04-28T14:38:55.908 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.889 7f4319758700 1 -- start start 2022-04-28T14:38:55.908 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.890 7f4319758700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f43140f63d0 0x7f431410fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:55.908 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.890 7f4319758700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f43141101d0 0x7f43140f1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:55.909 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.890 7f4319758700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f43140f18a0 0x7f43141bfc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:55.909 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.890 7f4319758700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4314120d80 con 0x7f43140f63d0 2022-04-28T14:38:55.909 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.890 7f4319758700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43141210c0 con 0x7f43140f18a0 2022-04-28T14:38:55.909 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.890 7f4319758700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4314110a60 con 0x7f43141101d0 2022-04-28T14:38:55.909 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.890 7f4311ceb700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f43141101d0 0x7f43140f1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:55.909 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.891 7f4311ceb700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f43141101d0 0x7f43140f1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:45636/0 (socket says 172.21.15.22:45636) 2022-04-28T14:38:55.909 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.891 7f4311ceb700 1 -- 172.21.15.22:0/4037091130 learned_addr learned my addr 172.21.15.22:0/4037091130 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:38:55.911 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.891 7f43124ec700 1 --2- 172.21.15.22:0/4037091130 >> v2:172.21.15.22:3300/0 conn(0x7f43140f63d0 0x7f431410fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:55.911 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.891 7f4311ceb700 1 -- 172.21.15.22:0/4037091130 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f43140f18a0 msgr2=0x7f43141bfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:38:55.911 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.891 7f4311ceb700 1 --2- 172.21.15.22:0/4037091130 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f43140f18a0 0x7f43141bfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-04-28T14:38:55.911 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.891 7f4311ceb700 1 -- 172.21.15.22:0/4037091130 >> v2:172.21.15.22:3300/0 conn(0x7f43140f63d0 msgr2=0x7f431410fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:38:55.911 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.891 7f4311ceb700 1 --2- 172.21.15.22:0/4037091130 >> v2:172.21.15.22:3300/0 conn(0x7f43140f63d0 0x7f431410fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.911 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.891 7f4311ceb700 1 -- 172.21.15.22:0/4037091130 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43141110a0 con 0x7f43141101d0 2022-04-28T14:38:55.911 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.891 7f4311ceb700 1 --2- 172.21.15.22:0/4037091130 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f43141101d0 0x7f43140f1270 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f4314120940 tx=0x7f4304009a30).ready entity=mon.2 client_cookie=76e965074e2bcce3 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:38:55.911 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.892 7f43114ea700 1 -- 172.21.15.22:0/4037091130 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f43141110a0 con 0x7f43141101d0 2022-04-28T14:38:55.912 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.892 7f43114ea700 1 -- 172.21.15.22:0/4037091130 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430400f510 con 0x7f43141101d0 2022-04-28T14:38:55.912 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.892 7f43114ea700 1 -- 172.21.15.22:0/4037091130 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f430400f6f0 con 0x7f43141101d0 2022-04-28T14:38:55.912 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.892 7f4319758700 1 -- 172.21.15.22:0/4037091130 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f43141101d0 msgr2=0x7f43140f1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:55.912 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.892 7f4319758700 1 --2- 172.21.15.22:0/4037091130 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f43141101d0 0x7f43140f1270 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f4314120940 tx=0x7f4304009a30).stop 2022-04-28T14:38:55.912 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.893 7f4319758700 1 -- 172.21.15.22:0/4037091130 shutdown_connections 2022-04-28T14:38:55.912 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.893 7f4319758700 1 --2- 172.21.15.22:0/4037091130 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f43140f18a0 0x7f43141bfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-04-28T14:38:55.912 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.893 7f4319758700 1 --2- 172.21.15.22:0/4037091130 >> v2:172.21.15.22:3300/0 conn(0x7f43140f63d0 0x7f431410fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.912 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.893 7f4319758700 1 --2- 172.21.15.22:0/4037091130 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f43141101d0 0x7f43140f1270 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.912 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.893 7f4319758700 1 -- 172.21.15.22:0/4037091130 >> 172.21.15.22:0/4037091130 conn(0x7f4314117120 msgr2=0x7f43140f2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:38:55.912 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.894 7f4319758700 1 -- 172.21.15.22:0/4037091130 shutdown_connections 2022-04-28T14:38:55.913 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.894 7f4319758700 1 -- 172.21.15.22:0/4037091130 wait complete. 2022-04-28T14:38:55.943 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.938 7f4319758700 1 Processor -- start 2022-04-28T14:38:55.943 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.938 7f4319758700 1 -- start start 2022-04-28T14:38:55.945 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.939 7f4319758700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f43141bc4c0 0x7f43140b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:55.945 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.939 7f4319758700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f43140b7750 0x7f43140d1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:55.945 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.939 7f4319758700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43140d21a0 0x7f43141c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:55.945 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.939 7f4319758700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43140b6b40 con 0x7f43140d21a0 2022-04-28T14:38:55.946 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.939 7f4319758700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43140b6800 con 0x7f43140b7750 2022-04-28T14:38:55.946 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.939 7f4319758700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43141bcae0 con 0x7f43141bc4c0 2022-04-28T14:38:55.946 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.939 7f4311ceb700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f43140b7750 0x7f43140d1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:55.946 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.939 7f4311ceb700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f43140b7750 0x7f43140d1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:45858/0 (socket says 172.21.15.22:45858) 2022-04-28T14:38:55.946 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.939 7f4311ceb700 1 -- 172.21.15.22:0/3608375845 learned_addr learned my addr 172.21.15.22:0/3608375845 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:38:55.946 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.939 7f43124ec700 1 --2- 172.21.15.22:0/3608375845 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f43141bc4c0 0x7f43140b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:55.946 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.939 7f4312ced700 1 --2- 172.21.15.22:0/3608375845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43140d21a0 0x7f43141c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:55.946 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.939 7f4311ceb700 1 -- 172.21.15.22:0/3608375845 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f43141bc4c0 msgr2=0x7f43140b7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:55.946 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.939 7f4311ceb700 1 --2- 172.21.15.22:0/3608375845 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f43141bc4c0 0x7f43140b7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.946 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.939 7f4311ceb700 1 -- 172.21.15.22:0/3608375845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43140d21a0 msgr2=0x7f43141c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:55.947 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.939 7f4311ceb700 1 --2- 172.21.15.22:0/3608375845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43140d21a0 0x7f43141c9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:55.947 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.939 7f4311ceb700 1 -- 172.21.15.22:0/3608375845 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43140d25f0 con 0x7f43140b7750 2022-04-28T14:38:55.947 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.939 7f4312ced700 1 --2- 172.21.15.22:0/3608375845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43140d21a0 0x7f43141c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:38:55.947 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.939 7f4311ceb700 1 --2- 172.21.15.22:0/3608375845 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f43140b7750 0x7f43140d1b70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f43141bcdd0 tx=0x7f43040068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:38:55.947 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.940 7f43037fe700 1 -- 172.21.15.22:0/3608375845 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f43140d25f0 con 0x7f43140b7750 2022-04-28T14:38:55.947 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.940 7f43037fe700 1 -- 172.21.15.22:0/3608375845 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4304011a20 con 0x7f43140b7750 2022-04-28T14:38:55.947 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.940 7f43037fe700 1 -- 172.21.15.22:0/3608375845 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4304011df0 con 0x7f43140b7750 2022-04-28T14:38:55.947 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.940 7f4319758700 1 -- 172.21.15.22:0/3608375845 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43140d28b0 con 0x7f43140b7750 2022-04-28T14:38:55.947 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.940 7f4319758700 1 -- 172.21.15.22:0/3608375845 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43141c9f20 con 0x7f43140b7750 2022-04-28T14:38:55.948 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.940 7f43037fe700 1 -- 172.21.15.22:0/3608375845 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 1) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4304019030 con 0x7f43140b7750 2022-04-28T14:38:55.948 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.940 7f43037fe700 1 -- 172.21.15.22:0/3608375845 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1166+0+0 (secure 0 0 0) 0x7f4304018040 con 0x7f43140b7750 2022-04-28T14:38:55.948 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.941 7f4319758700 1 -- 172.21.15.22:0/3608375845 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43140f02c0 con 0x7f43140b7750 2022-04-28T14:38:55.949 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:55.944 7f43037fe700 1 -- 172.21.15.22:0/3608375845 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66062 (secure 0 0 0) 0x7f4304011810 con 0x7f43140b7750 2022-04-28T14:38:56.021 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:56.017 7f4319758700 1 -- 172.21.15.22:0/3608375845 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43140ab0b0 con 0x7f43140b7750 2022-04-28T14:38:56.022 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:56.017 7f43037fe700 1 -- 172.21.15.22:0/3608375845 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+3247 (secure 0 0 0) 0x7f430400f300 con 0x7f43140b7750 2022-04-28T14:38:56.022 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:38:56.023 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":6,"fsid":"3047163a-0285-4058-8e05-ce74c6fbb9c5","created":"2022-04-28 14:38:54.232890","modified":"2022-04-28 14:38:55.668797","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[],"osds":[{"osd":0,"uuid":"782ee638-1ada-48d9-9454-f9e0ca8a3135","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":1,"uuid":"61ca6f96-fb4f-4c0f-b68b-edf1e7011f1c","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":2,"uuid":"4b3043b9-50df-4b7f-a55a-ac8e6148c449","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":3,"uuid":"7807bcd1-53f8-44b5-9992-57c328e5b299","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-04-28T14:38:56.024 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:56.018 7f4319758700 1 -- 172.21.15.22:0/3608375845 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f43140b7750 msgr2=0x7f43140d1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:56.025 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:56.018 7f4319758700 1 --2- 172.21.15.22:0/3608375845 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f43140b7750 0x7f43140d1b70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f43141bcdd0 tx=0x7f43040068c0).stop 2022-04-28T14:38:56.025 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:56.018 7f4319758700 1 -- 172.21.15.22:0/3608375845 shutdown_connections 2022-04-28T14:38:56.025 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:56.018 7f4319758700 1 --2- 172.21.15.22:0/3608375845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43140d21a0 0x7f43141c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:56.025 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:56.018 7f4319758700 1 --2- 172.21.15.22:0/3608375845 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f43141bc4c0 0x7f43140b7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:56.025 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:56.018 7f4319758700 1 --2- 172.21.15.22:0/3608375845 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f43140b7750 0x7f43140d1b70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:56.026 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:56.018 7f4319758700 1 -- 172.21.15.22:0/3608375845 >> 172.21.15.22:0/3608375845 conn(0x7f43140bdb10 msgr2=0x7f43140ad220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:38:56.026 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:56.018 7f4319758700 1 -- 172.21.15.22:0/3608375845 shutdown_connections 2022-04-28T14:38:56.026 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:38:56.018 7f4319758700 1 -- 172.21.15.22:0/3608375845 wait complete. 2022-04-28T14:38:56.034 INFO:tasks.ceph.ceph_manager.ceph:[] 2022-04-28T14:38:56.035 INFO:tasks.ceph:Waiting for OSDs to come up 2022-04-28T14:38:56.163 INFO:tasks.ceph.osd.0.smithi022.stderr:2022-04-28 14:38:56.158 7ff6d8422dc0 -1 Falling back to public interface 2022-04-28T14:38:56.172 INFO:tasks.ceph.osd.1.smithi022.stderr:2022-04-28 14:38:56.167 7fb71cd8edc0 -1 Falling back to public interface 2022-04-28T14:38:56.430 INFO:tasks.ceph.osd.3.smithi022.stderr:2022-04-28 14:38:56.425 7f8b2df2bdc0 -1 Falling back to public interface 2022-04-28T14:38:56.435 INFO:tasks.ceph.osd.2.smithi022.stderr:2022-04-28 14:38:56.430 7f7539268dc0 -1 Falling back to public interface 2022-04-28T14:38:56.438 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-04-28T14:38:56.562 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.555 7f36ea95f700 1 Processor -- start 2022-04-28T14:38:56.563 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.555 7f36ea95f700 1 -- start start 2022-04-28T14:38:56.563 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.556 7f36ea95f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f36e40f6390 0x7f36e40fe970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:56.563 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.556 7f36ea95f700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36e40ff3f0 0x7f36e41b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:56.563 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.556 7f36ea95f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e40ab0b0 con 0x7f36e40fefa0 2022-04-28T14:38:56.563 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.556 7f36ea95f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e41b2290 con 0x7f36e40f6390 2022-04-28T14:38:56.563 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.556 7f36ea95f700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e4115dd0 con 0x7f36e40ff3f0 2022-04-28T14:38:56.563 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.556 7f36e2dea700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f36e40fefa0 0x7f36e41b1460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37708/0 (socket says 172.21.15.22:37708) 2022-04-28T14:38:56.563 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.556 7f36e2dea700 1 -- 172.21.15.22:0/2126837481 learned_addr learned my addr 172.21.15.22:0/2126837481 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:38:56.564 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.556 7f36e3dec700 1 --2- 172.21.15.22:0/2126837481 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36e40ff3f0 0x7f36e41b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:56.564 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.556 7f36e35eb700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f36e40f6390 0x7f36e40fe970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:56.564 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.556 7f36e25e9700 1 -- 172.21.15.22:0/2126837481 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642746045 0 0) 0x7f36d8001110 con 0x7f36e40fefa0 2022-04-28T14:38:56.564 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.556 7f36e25e9700 1 -- 172.21.15.22:0/2126837481 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36d0003270 con 0x7f36e40fefa0 2022-04-28T14:38:56.564 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.556 7f36e3dec700 1 -- 172.21.15.22:0/2126837481 >> v2:172.21.15.22:3300/0 conn(0x7f36e40f6390 msgr2=0x7f36e40fe970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:38:56.564 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.556 7f36e3dec700 1 --2- 172.21.15.22:0/2126837481 >> v2:172.21.15.22:3300/0 conn(0x7f36e40f6390 0x7f36e40fe970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:56.564 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.556 7f36e3dec700 1 -- 172.21.15.22:0/2126837481 >> v1:172.21.15.22:6789/0 conn(0x7f36e40fefa0 legacy=0x7f36e41b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:56.564 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.556 7f36e3dec700 1 -- 172.21.15.22:0/2126837481 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e410b7d0 con 0x7f36e40ff3f0 2022-04-28T14:38:56.564 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.556 7f36e35eb700 1 --2- 172.21.15.22:0/2126837481 >> v2:172.21.15.22:3300/0 conn(0x7f36e40f6390 0x7f36e40fe970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:38:56.565 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.556 7f36e3dec700 1 --2- 172.21.15.22:0/2126837481 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36e40ff3f0 0x7f36e41b1c60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f36dc002f70 tx=0x7f36dc00dbd0).ready entity=mon.1 client_cookie=4c095588c178e78c server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:38:56.565 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.557 7f36e25e9700 1 -- 172.21.15.22:0/2126837481 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f36e410b7d0 con 0x7f36e40ff3f0 2022-04-28T14:38:56.565 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.557 7f36e25e9700 1 -- 172.21.15.22:0/2126837481 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36dc00bbd0 con 0x7f36e40ff3f0 2022-04-28T14:38:56.565 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.557 7f36e25e9700 1 -- 172.21.15.22:0/2126837481 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f36dc015070 con 0x7f36e40ff3f0 2022-04-28T14:38:56.565 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.557 7f36ea95f700 1 -- 172.21.15.22:0/2126837481 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36e40ff3f0 msgr2=0x7f36e41b1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:56.565 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.557 7f36ea95f700 1 --2- 172.21.15.22:0/2126837481 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36e40ff3f0 0x7f36e41b1c60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f36dc002f70 tx=0x7f36dc00dbd0).stop 2022-04-28T14:38:56.565 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.557 7f36ea95f700 1 -- 172.21.15.22:0/2126837481 shutdown_connections 2022-04-28T14:38:56.565 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.557 7f36ea95f700 1 --2- 172.21.15.22:0/2126837481 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36e40ff3f0 0x7f36e41b1c60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:56.565 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.557 7f36ea95f700 1 --2- 172.21.15.22:0/2126837481 >> v2:172.21.15.22:3300/0 conn(0x7f36e40f6390 0x7f36e40fe970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:56.565 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.557 7f36ea95f700 1 -- 172.21.15.22:0/2126837481 >> 172.21.15.22:0/2126837481 conn(0x7f36e4117120 msgr2=0x7f36e40f2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:38:56.566 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.557 7f36ea95f700 1 -- 172.21.15.22:0/2126837481 shutdown_connections 2022-04-28T14:38:56.566 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.557 7f36ea95f700 1 -- 172.21.15.22:0/2126837481 wait complete. 2022-04-28T14:38:56.586 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.581 7f36ea95f700 1 Processor -- start 2022-04-28T14:38:56.586 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.581 7f36ea95f700 1 -- start start 2022-04-28T14:38:56.590 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.582 7f36ea95f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36e40dd6c0 0x7f36e41b2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:56.590 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.582 7f36ea95f700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f36e41b32d0 0x7f36e41b3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:56.591 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.582 7f36ea95f700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36e41b3d50 0x7f36e41c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:38:56.591 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.582 7f36ea95f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e40bdd20 con 0x7f36e40dd6c0 2022-04-28T14:38:56.591 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.582 7f36ea95f700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e40bd9e0 con 0x7f36e41b3d50 2022-04-28T14:38:56.591 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.582 7f36ea95f700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36e40de0f0 con 0x7f36e41b32d0 2022-04-28T14:38:56.591 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.582 7f36e35eb700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36e40dd6c0 0x7f36e41b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:56.591 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.582 7f36e35eb700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36e40dd6c0 0x7f36e41b2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48318/0 (socket says 172.21.15.22:48318) 2022-04-28T14:38:56.591 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.582 7f36e35eb700 1 -- 172.21.15.22:0/1093076382 learned_addr learned my addr 172.21.15.22:0/1093076382 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:38:56.591 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.582 7f36e3dec700 1 --2- 172.21.15.22:0/1093076382 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36e41b3d50 0x7f36e41c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:56.591 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.582 7f36e2dea700 1 --2- 172.21.15.22:0/1093076382 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f36e41b32d0 0x7f36e41b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:38:56.591 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.582 7f36e35eb700 1 -- 172.21.15.22:0/1093076382 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f36e41b32d0 msgr2=0x7f36e41b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:56.592 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.582 7f36e35eb700 1 --2- 172.21.15.22:0/1093076382 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f36e41b32d0 0x7f36e41b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:56.592 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.582 7f36e35eb700 1 -- 172.21.15.22:0/1093076382 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36e41b3d50 msgr2=0x7f36e41c77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:56.592 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.582 7f36e35eb700 1 --2- 172.21.15.22:0/1093076382 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36e41b3d50 0x7f36e41c77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:56.592 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.582 7f36e35eb700 1 -- 172.21.15.22:0/1093076382 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e41b2aa0 con 0x7f36e40dd6c0 2022-04-28T14:38:56.592 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.583 7f36e35eb700 1 --2- 172.21.15.22:0/1093076382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36e40dd6c0 0x7f36e41b2470 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f36e410bb10 tx=0x7f36d400b420).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:38:56.592 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.583 7f36e0de6700 1 -- 172.21.15.22:0/1093076382 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f36e41b2aa0 con 0x7f36e40dd6c0 2022-04-28T14:38:56.593 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.583 7f36e0de6700 1 -- 172.21.15.22:0/1093076382 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d401a420 con 0x7f36e40dd6c0 2022-04-28T14:38:56.593 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.583 7f36ea95f700 1 -- 172.21.15.22:0/1093076382 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e41b41a0 con 0x7f36e40dd6c0 2022-04-28T14:38:56.593 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.583 7f36e0de6700 1 -- 172.21.15.22:0/1093076382 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f36d4016030 con 0x7f36e40dd6c0 2022-04-28T14:38:56.593 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.583 7f36ea95f700 1 -- 172.21.15.22:0/1093076382 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e41c7dd0 con 0x7f36e40dd6c0 2022-04-28T14:38:56.593 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.583 7f36e0de6700 1 -- 172.21.15.22:0/1093076382 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 2) v1 ==== 11227+0+0 (secure 0 0 0) 0x7f36d4019380 con 0x7f36e40dd6c0 2022-04-28T14:38:56.593 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.583 7f36e0de6700 1 -- 172.21.15.22:0/1093076382 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1166+0+0 (secure 0 0 0) 0x7f36d400ad70 con 0x7f36e40dd6c0 2022-04-28T14:38:56.593 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.584 7f36ea95f700 1 -- 172.21.15.22:0/1093076382 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e40f02c0 con 0x7f36e40dd6c0 2022-04-28T14:38:56.594 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.588 7f36e0de6700 1 -- 172.21.15.22:0/1093076382 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+66062 (secure 0 0 0) 0x7f36d400ba60 con 0x7f36e40dd6c0 2022-04-28T14:38:56.652 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.647 7f36ea95f700 1 -- 172.21.15.22:0/1093076382 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36e40ef990 con 0x7f36e40dd6c0 2022-04-28T14:38:56.652 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.648 7f36e0de6700 1 -- 172.21.15.22:0/1093076382 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+3247 (secure 0 0 0) 0x7f36d4000fb0 con 0x7f36e40dd6c0 2022-04-28T14:38:56.653 INFO:teuthology.misc.health.smithi022.stdout: 2022-04-28T14:38:56.653 INFO:teuthology.misc.health.smithi022.stdout:{"epoch":6,"fsid":"3047163a-0285-4058-8e05-ce74c6fbb9c5","created":"2022-04-28 14:38:54.232890","modified":"2022-04-28 14:38:55.668797","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[],"osds":[{"osd":0,"uuid":"782ee638-1ada-48d9-9454-f9e0ca8a3135","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":1,"uuid":"61ca6f96-fb4f-4c0f-b68b-edf1e7011f1c","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":2,"uuid":"4b3043b9-50df-4b7f-a55a-ac8e6148c449","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":3,"uuid":"7807bcd1-53f8-44b5-9992-57c328e5b299","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-04-28T14:38:56.654 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.648 7f36ea95f700 1 -- 172.21.15.22:0/1093076382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36e40dd6c0 msgr2=0x7f36e41b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:38:56.654 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.648 7f36ea95f700 1 --2- 172.21.15.22:0/1093076382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36e40dd6c0 0x7f36e41b2470 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f36e410bb10 tx=0x7f36d400b420).stop 2022-04-28T14:38:56.654 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.648 7f36ea95f700 1 -- 172.21.15.22:0/1093076382 shutdown_connections 2022-04-28T14:38:56.654 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.648 7f36ea95f700 1 --2- 172.21.15.22:0/1093076382 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36e41b3d50 0x7f36e41c77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:56.654 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.648 7f36ea95f700 1 --2- 172.21.15.22:0/1093076382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36e40dd6c0 0x7f36e41b2470 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:56.655 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.648 7f36ea95f700 1 --2- 172.21.15.22:0/1093076382 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f36e41b32d0 0x7f36e41b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:38:56.655 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.648 7f36ea95f700 1 -- 172.21.15.22:0/1093076382 >> 172.21.15.22:0/1093076382 conn(0x7f36e40c8090 msgr2=0x7f36e411f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:38:56.655 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.649 7f36ea95f700 1 -- 172.21.15.22:0/1093076382 shutdown_connections 2022-04-28T14:38:56.655 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:38:56.649 7f36ea95f700 1 -- 172.21.15.22:0/1093076382 wait complete. 2022-04-28T14:38:56.663 DEBUG:teuthology.misc:0 of 4 OSDs are up 2022-04-28T14:38:57.483 INFO:tasks.ceph.osd.0.smithi022.stderr:2022-04-28 14:38:57.478 7ff6d8422dc0 -1 osd.0 0 log_to_monitors {default=true} 2022-04-28T14:38:57.489 INFO:tasks.ceph.osd.1.smithi022.stderr:2022-04-28 14:38:57.485 7fb71cd8edc0 -1 osd.1 0 log_to_monitors {default=true} 2022-04-28T14:38:57.767 INFO:tasks.ceph.osd.2.smithi022.stderr:2022-04-28 14:38:57.762 7f7539268dc0 -1 osd.2 0 log_to_monitors {default=true} 2022-04-28T14:38:57.767 INFO:tasks.ceph.osd.3.smithi022.stderr:2022-04-28 14:38:57.763 7f8b2df2bdc0 -1 osd.3 0 log_to_monitors {default=true} 2022-04-28T14:38:59.269 INFO:tasks.ceph.osd.0.smithi022.stderr:2022-04-28 14:38:59.264 7ff6be15f700 -1 osd.0 0 waiting for initial osdmap 2022-04-28T14:38:59.270 INFO:tasks.ceph.osd.3.smithi022.stderr:2022-04-28 14:38:59.265 7f8b13c68700 -1 osd.3 0 waiting for initial osdmap 2022-04-28T14:38:59.271 INFO:tasks.ceph.osd.1.smithi022.stderr:2022-04-28 14:38:59.265 7fb702acb700 -1 osd.1 0 waiting for initial osdmap 2022-04-28T14:38:59.271 INFO:tasks.ceph.osd.2.smithi022.stderr:2022-04-28 14:38:59.265 7f751efa5700 -1 osd.2 0 waiting for initial osdmap 2022-04-28T14:38:59.275 INFO:tasks.ceph.osd.2.smithi022.stderr:2022-04-28 14:38:59.270 7f752b1c3700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-04-28T14:38:59.276 INFO:tasks.ceph.osd.3.smithi022.stderr:2022-04-28 14:38:59.272 7f8b1fe86700 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-04-28T14:38:59.277 INFO:tasks.ceph.osd.1.smithi022.stderr:2022-04-28 14:38:59.272 7fb70ece9700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-04-28T14:38:59.284 INFO:tasks.ceph.osd.0.smithi022.stderr:2022-04-28 14:38:59.272 7ff6ca37d700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-04-28T14:39:03.068 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-04-28T14:39:03.203 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.196 7fcd9f81d700 1 Processor -- start 2022-04-28T14:39:03.203 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.196 7fcd9f81d700 1 -- start start 2022-04-28T14:39:03.203 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.196 7fcd9f81d700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fcd980f6390 0x7fcd980fe970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:03.203 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.196 7fcd9f81d700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fcd980ff3f0 0x7fcd981b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:03.203 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.196 7fcd9f81d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd980ab0b0 con 0x7fcd980fefa0 2022-04-28T14:39:03.204 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.196 7fcd9f81d700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd981b2290 con 0x7fcd980ff3f0 2022-04-28T14:39:03.204 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.196 7fcd9f81d700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd98115dd0 con 0x7fcd980f6390 2022-04-28T14:39:03.204 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.196 7fcd9ce1d700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fcd980ff3f0 0x7fcd981b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:03.204 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.196 7fcd97fff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fcd980f6390 0x7fcd980fe970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:03.204 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.196 7fcd977fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fcd980fefa0 0x7fcd981b1460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37860/0 (socket says 172.21.15.22:37860) 2022-04-28T14:39:03.204 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.196 7fcd977fe700 1 -- 172.21.15.22:0/3340708070 learned_addr learned my addr 172.21.15.22:0/3340708070 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:39:03.204 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.197 7fcd96ffd700 1 -- 172.21.15.22:0/3340708070 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 929301187 0 0) 0x7fcd8c001110 con 0x7fcd980fefa0 2022-04-28T14:39:03.204 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.197 7fcd9ce1d700 1 -- 172.21.15.22:0/3340708070 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fcd980f6390 msgr2=0x7fcd980fe970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:03.204 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.197 7fcd9ce1d700 1 --2- 172.21.15.22:0/3340708070 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fcd980f6390 0x7fcd980fe970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:03.204 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.197 7fcd9ce1d700 1 -- 172.21.15.22:0/3340708070 >> v1:172.21.15.22:6789/0 conn(0x7fcd980fefa0 legacy=0x7fcd981b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:03.205 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.197 7fcd9ce1d700 1 -- 172.21.15.22:0/3340708070 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9810b7d0 con 0x7fcd980ff3f0 2022-04-28T14:39:03.205 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.197 7fcd97fff700 1 --2- 172.21.15.22:0/3340708070 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fcd980f6390 0x7fcd980fe970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:03.205 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.197 7fcd9ce1d700 1 --2- 172.21.15.22:0/3340708070 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fcd980ff3f0 0x7fcd981b1c60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fcd98125870 tx=0x7fcd90009d70).ready entity=mon.1 client_cookie=5ac4ce98f29d66ee server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:03.205 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.197 7fcd96ffd700 1 -- 172.21.15.22:0/3340708070 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcd9810b7d0 con 0x7fcd980ff3f0 2022-04-28T14:39:03.205 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.197 7fcd96ffd700 1 -- 172.21.15.22:0/3340708070 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9000b7c0 con 0x7fcd980ff3f0 2022-04-28T14:39:03.205 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.197 7fcd96ffd700 1 -- 172.21.15.22:0/3340708070 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcd9000b9a0 con 0x7fcd980ff3f0 2022-04-28T14:39:03.205 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.197 7fcd9f81d700 1 -- 172.21.15.22:0/3340708070 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fcd980ff3f0 msgr2=0x7fcd981b1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:03.205 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.197 7fcd9f81d700 1 --2- 172.21.15.22:0/3340708070 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fcd980ff3f0 0x7fcd981b1c60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fcd98125870 tx=0x7fcd90009d70).stop 2022-04-28T14:39:03.205 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.198 7fcd9f81d700 1 -- 172.21.15.22:0/3340708070 shutdown_connections 2022-04-28T14:39:03.206 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.198 7fcd9f81d700 1 --2- 172.21.15.22:0/3340708070 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fcd980ff3f0 0x7fcd981b1c60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:03.206 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.198 7fcd9f81d700 1 --2- 172.21.15.22:0/3340708070 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fcd980f6390 0x7fcd980fe970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:03.206 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.198 7fcd9f81d700 1 -- 172.21.15.22:0/3340708070 >> 172.21.15.22:0/3340708070 conn(0x7fcd98117120 msgr2=0x7fcd980f2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:03.206 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.198 7fcd9f81d700 1 -- 172.21.15.22:0/3340708070 shutdown_connections 2022-04-28T14:39:03.206 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.198 7fcd9f81d700 1 -- 172.21.15.22:0/3340708070 wait complete. 2022-04-28T14:39:03.226 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.222 7fcd9f81d700 1 Processor -- start 2022-04-28T14:39:03.227 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.222 7fcd9f81d700 1 -- start start 2022-04-28T14:39:03.229 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.222 7fcd9f81d700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fcd980cc320 0x7fcd981211c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:03.229 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.222 7fcd9f81d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd980b76d0 0x7fcd980b7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:03.229 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.222 7fcd9f81d700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fcd980b8150 0x7fcd981c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:03.229 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.222 7fcd9f81d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd980e0790 con 0x7fcd980b76d0 2022-04-28T14:39:03.229 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.222 7fcd9f81d700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd980d7570 con 0x7fcd980b8150 2022-04-28T14:39:03.230 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.222 7fcd9f81d700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd980b85a0 con 0x7fcd980cc320 2022-04-28T14:39:03.230 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.222 7fcd97fff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fcd980cc320 0x7fcd981211c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:03.230 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.223 7fcd9ce1d700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fcd980b8150 0x7fcd981c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:03.230 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.223 7fcd977fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd980b76d0 0x7fcd980b7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:03.230 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.223 7fcd97fff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fcd980cc320 0x7fcd981211c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:45818/0 (socket says 172.21.15.22:45818) 2022-04-28T14:39:03.230 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.223 7fcd97fff700 1 -- 172.21.15.22:0/601808830 learned_addr learned my addr 172.21.15.22:0/601808830 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:03.230 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.223 7fcd97fff700 1 -- 172.21.15.22:0/601808830 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fcd980b8150 msgr2=0x7fcd981c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:03.230 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.223 7fcd97fff700 1 --2- 172.21.15.22:0/601808830 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fcd980b8150 0x7fcd981c9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:03.230 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.223 7fcd97fff700 1 -- 172.21.15.22:0/601808830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd980b76d0 msgr2=0x7fcd980b7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:03.231 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.223 7fcd97fff700 1 --2- 172.21.15.22:0/601808830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd980b76d0 0x7fcd980b7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:03.231 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.223 7fcd97fff700 1 -- 172.21.15.22:0/601808830 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd980cace0 con 0x7fcd980cc320 2022-04-28T14:39:03.231 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.223 7fcd9ce1d700 1 --2- 172.21.15.22:0/601808830 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fcd980b8150 0x7fcd981c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:03.231 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.223 7fcd97fff700 1 --2- 172.21.15.22:0/601808830 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fcd980cc320 0x7fcd981211c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fcd8800c000 tx=0x7fcd8800bf70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:03.231 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.223 7fcd957fa700 1 -- 172.21.15.22:0/601808830 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcd980cace0 con 0x7fcd980cc320 2022-04-28T14:39:03.231 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.223 7fcd957fa700 1 -- 172.21.15.22:0/601808830 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8800c870 con 0x7fcd980cc320 2022-04-28T14:39:03.231 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.223 7fcd957fa700 1 -- 172.21.15.22:0/601808830 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcd8800f040 con 0x7fcd980cc320 2022-04-28T14:39:03.231 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.223 7fcd9f81d700 1 -- 172.21.15.22:0/601808830 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd980cbe90 con 0x7fcd980cc320 2022-04-28T14:39:03.231 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.223 7fcd9f81d700 1 -- 172.21.15.22:0/601808830 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd981ba7e0 con 0x7fcd980cc320 2022-04-28T14:39:03.231 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.224 7fcd957fa700 1 -- 172.21.15.22:0/601808830 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fcd88011070 con 0x7fcd980cc320 2022-04-28T14:39:03.232 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.224 7fcd957fa700 1 -- 172.21.15.22:0/601808830 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2054+0+0 (secure 0 0 0) 0x7fcd88010040 con 0x7fcd980cc320 2022-04-28T14:39:03.232 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.224 7fcd9f81d700 1 -- 172.21.15.22:0/601808830 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd980f02c0 con 0x7fcd980cc320 2022-04-28T14:39:03.232 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.228 7fcd957fa700 1 -- 172.21.15.22:0/601808830 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fcd8800c470 con 0x7fcd980cc320 2022-04-28T14:39:03.328 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.324 7fcd9f81d700 1 -- 172.21.15.22:0/601808830 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd980a5b80 con 0x7fcd980cc320 2022-04-28T14:39:03.329 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.324 7fcd957fa700 1 -- 172.21.15.22:0/601808830 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) v1 ==== 74+0+4535 (secure 0 0 0) 0x7fcd88000c30 con 0x7fcd980cc320 2022-04-28T14:39:03.329 INFO:teuthology.misc.health.smithi022.stdout: 2022-04-28T14:39:03.330 INFO:teuthology.misc.health.smithi022.stdout:{"epoch":9,"fsid":"3047163a-0285-4058-8e05-ce74c6fbb9c5","created":"2022-04-28 14:38:54.232890","modified":"2022-04-28 14:39:00.269721","last_up_change":"2022-04-28 14:39:00.269721","last_in_change":"2022-04-28 14:39:00.269721","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[],"osds":[{"osd":0,"uuid":"782ee638-1ada-48d9-9454-f9e0ca8a3135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6800","nonce":87556}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":87556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":87556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":87556}]},"public_addr":"172.21.15.22:6800/87556","cluster_addr":"172.21.15.22:6801/87556","heartbeat_back_addr":"172.21.15.22:6803/87556","heartbeat_front_addr":"172.21.15.22:6802/87556","state":["exists","up"]},{"osd":1,"uuid":"61ca6f96-fb4f-4c0f-b68b-edf1e7011f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":87557}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":87557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":87557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":87557}]},"public_addr":"172.21.15.22:6804/87557","cluster_addr":"172.21.15.22:6805/87557","heartbeat_back_addr":"172.21.15.22:6807/87557","heartbeat_front_addr":"172.21.15.22:6806/87557","state":["exists","up"]},{"osd":2,"uuid":"4b3043b9-50df-4b7f-a55a-ac8e6148c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":87558}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":87558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":87558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":87558}]},"public_addr":"172.21.15.22:6813/87558","cluster_addr":"172.21.15.22:6814/87558","heartbeat_back_addr":"172.21.15.22:6816/87558","heartbeat_front_addr":"172.21.15.22:6815/87558","state":["exists","up"]},{"osd":3,"uuid":"7807bcd1-53f8-44b5-9992-57c328e5b299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":87561}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":87561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":87561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":87561}]},"public_addr":"172.21.15.22:6809/87561","cluster_addr":"172.21.15.22:6810/87561","heartbeat_back_addr":"172.21.15.22:6812/87561","heartbeat_front_addr":"172.21.15.22:6811/87561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-04-28T14:39:03.331 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.326 7fcd9f81d700 1 -- 172.21.15.22:0/601808830 >> v1:172.21.15.22:6808/86956 conn(0x7fcd7801c1b0 legacy=0x7fcd7801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:03.331 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.326 7fcd9f81d700 1 -- 172.21.15.22:0/601808830 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fcd980cc320 msgr2=0x7fcd981211c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:03.331 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.326 7fcd9f81d700 1 --2- 172.21.15.22:0/601808830 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fcd980cc320 0x7fcd981211c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fcd8800c000 tx=0x7fcd8800bf70).stop 2022-04-28T14:39:03.331 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.326 7fcd9f81d700 1 -- 172.21.15.22:0/601808830 shutdown_connections 2022-04-28T14:39:03.331 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.326 7fcd9f81d700 1 --2- 172.21.15.22:0/601808830 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fcd980b8150 0x7fcd981c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:03.331 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.326 7fcd9f81d700 1 --2- 172.21.15.22:0/601808830 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fcd980cc320 0x7fcd981211c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:03.331 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.326 7fcd9f81d700 1 --2- 172.21.15.22:0/601808830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd980b76d0 0x7fcd980b7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:03.332 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.326 7fcd9f81d700 1 -- 172.21.15.22:0/601808830 >> 172.21.15.22:0/601808830 conn(0x7fcd981b9640 msgr2=0x7fcd980b87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:03.332 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.326 7fcd9f81d700 1 -- 172.21.15.22:0/601808830 shutdown_connections 2022-04-28T14:39:03.332 INFO:teuthology.misc.health.smithi022.stderr:2022-04-28 14:39:03.326 7fcd9f81d700 1 -- 172.21.15.22:0/601808830 wait complete. 2022-04-28T14:39:03.340 DEBUG:teuthology.misc:4 of 4 OSDs are up 2022-04-28T14:39:03.340 INFO:tasks.ceph:Creating RBD pool 2022-04-28T14:39:03.340 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --cluster ceph osd pool create rbd 8 2022-04-28T14:39:03.474 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.465 7f49a2a5c700 1 Processor -- start 2022-04-28T14:39:03.474 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.465 7f49a2a5c700 1 -- start start 2022-04-28T14:39:03.474 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.466 7f49a2a5c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f499c0f62c0 0x7f499c0f1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:03.475 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.466 7f49a2a5c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f499c0f1950 0x7f499c1b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:03.475 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.466 7f49a2a5c700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f499c0f1da0 0x7f499c1b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:03.475 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.466 7f49a2a5c700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f499c10ec90 con 0x7f499c0f1950 2022-04-28T14:39:03.475 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.466 7f49a2a5c700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499c116ef0 con 0x7f499c0f1da0 2022-04-28T14:39:03.475 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.466 7f49a2a5c700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f499c0f6710 con 0x7f499c0f62c0 2022-04-28T14:39:03.476 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.466 7f499b7fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f499c0f62c0 0x7f499c0f1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:03.476 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.466 7f499bfff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f499c0f1da0 0x7f499c1b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:03.476 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.466 7f499bfff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f499c0f1da0 0x7f499c1b4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46044/0 (socket says 172.21.15.22:46044) 2022-04-28T14:39:03.476 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.466 7f499b7fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f499c0f62c0 0x7f499c0f1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:45826/0 (socket says 172.21.15.22:45826) 2022-04-28T14:39:03.476 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.466 7f499affd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f499c0f1950 0x7f499c1b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:03.477 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.466 7f499bfff700 1 -- 172.21.15.22:0/2872583177 learned_addr learned my addr 172.21.15.22:0/2872583177 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:03.477 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.466 7f499bfff700 1 -- 172.21.15.22:0/2872583177 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f499c0f62c0 msgr2=0x7f499c0f1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:03.477 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.466 7f499bfff700 1 --2- 172.21.15.22:0/2872583177 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f499c0f62c0 0x7f499c0f1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:03.477 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.466 7f499bfff700 1 -- 172.21.15.22:0/2872583177 >> v2:172.21.15.22:3300/0 conn(0x7f499c0f1950 msgr2=0x7f499c1b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:03.477 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.466 7f499bfff700 1 --2- 172.21.15.22:0/2872583177 >> v2:172.21.15.22:3300/0 conn(0x7f499c0f1950 0x7f499c1b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:03.477 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.466 7f499bfff700 1 -- 172.21.15.22:0/2872583177 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c1b5300 con 0x7f499c0f1da0 2022-04-28T14:39:03.478 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.466 7f499affd700 1 --2- 172.21.15.22:0/2872583177 >> v2:172.21.15.22:3300/0 conn(0x7f499c0f1950 0x7f499c1b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:03.478 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.466 7f499b7fe700 1 --2- 172.21.15.22:0/2872583177 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f499c0f62c0 0x7f499c0f1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:03.478 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.466 7f499bfff700 1 --2- 172.21.15.22:0/2872583177 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f499c0f1da0 0x7f499c1b4cd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f499c0f3f10 tx=0x7f4994009e10).ready entity=mon.1 client_cookie=6cacabb5c5c93aae server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:03.478 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.467 7f499a7fc700 1 -- 172.21.15.22:0/2872583177 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f499c1b5300 con 0x7f499c0f1da0 2022-04-28T14:39:03.478 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.467 7f499a7fc700 1 -- 172.21.15.22:0/2872583177 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499400b890 con 0x7f499c0f1da0 2022-04-28T14:39:03.478 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.467 7f499a7fc700 1 -- 172.21.15.22:0/2872583177 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f499400ba70 con 0x7f499c0f1da0 2022-04-28T14:39:03.479 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.467 7f49a2a5c700 1 -- 172.21.15.22:0/2872583177 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f499c0f1da0 msgr2=0x7f499c1b4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:03.479 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.467 7f49a2a5c700 1 --2- 172.21.15.22:0/2872583177 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f499c0f1da0 0x7f499c1b4cd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f499c0f3f10 tx=0x7f4994009e10).stop 2022-04-28T14:39:03.479 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.467 7f49a2a5c700 1 -- 172.21.15.22:0/2872583177 shutdown_connections 2022-04-28T14:39:03.479 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.467 7f49a2a5c700 1 --2- 172.21.15.22:0/2872583177 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f499c0f1da0 0x7f499c1b4cd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:03.479 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.467 7f49a2a5c700 1 --2- 172.21.15.22:0/2872583177 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f499c0f62c0 0x7f499c0f1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:03.479 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.467 7f49a2a5c700 1 --2- 172.21.15.22:0/2872583177 >> v2:172.21.15.22:3300/0 conn(0x7f499c0f1950 0x7f499c1b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:03.480 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.467 7f49a2a5c700 1 -- 172.21.15.22:0/2872583177 >> 172.21.15.22:0/2872583177 conn(0x7f499c1171d0 msgr2=0x7f499c0f2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:03.480 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.467 7f49a2a5c700 1 -- 172.21.15.22:0/2872583177 shutdown_connections 2022-04-28T14:39:03.480 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.467 7f49a2a5c700 1 -- 172.21.15.22:0/2872583177 wait complete. 2022-04-28T14:39:03.496 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.491 7f49a2a5c700 1 Processor -- start 2022-04-28T14:39:03.496 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.491 7f49a2a5c700 1 -- start start 2022-04-28T14:39:03.498 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.492 7f49a2a5c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f499c0bb390 0x7f499c0ba4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:03.499 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.492 7f49a2a5c700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f499c0baae0 0x7f499c0d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:03.499 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.492 7f49a2a5c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f499c0d0be0 0x7f499c1c5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:03.499 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.492 7f49a2a5c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c0f3110 con 0x7f499c0d0be0 2022-04-28T14:39:03.499 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.492 7f49a2a5c700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499c0b9cd0 con 0x7f499c0baae0 2022-04-28T14:39:03.500 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.492 7f49a2a5c700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f499c0bb100 con 0x7f499c0bb390 2022-04-28T14:39:03.500 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.492 7f499affd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f499c0baae0 0x7f499c0d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:03.500 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.492 7f499bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f499c0d0be0 0x7f499c1c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:03.500 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.492 7f499affd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f499c0baae0 0x7f499c0d05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46048/0 (socket says 172.21.15.22:46048) 2022-04-28T14:39:03.500 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.492 7f499bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f499c0d0be0 0x7f499c1c5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48482/0 (socket says 172.21.15.22:48482) 2022-04-28T14:39:03.500 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.492 7f499affd700 1 -- 172.21.15.22:0/3602314961 learned_addr learned my addr 172.21.15.22:0/3602314961 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:03.501 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.492 7f499b7fe700 1 --2- 172.21.15.22:0/3602314961 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f499c0bb390 0x7f499c0ba4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:03.501 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.492 7f499bfff700 1 -- 172.21.15.22:0/3602314961 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f499c0bb390 msgr2=0x7f499c0ba4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:03.501 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.492 7f499bfff700 1 --2- 172.21.15.22:0/3602314961 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f499c0bb390 0x7f499c0ba4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:03.501 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.492 7f499bfff700 1 -- 172.21.15.22:0/3602314961 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f499c0baae0 msgr2=0x7f499c0d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:03.501 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.492 7f499bfff700 1 --2- 172.21.15.22:0/3602314961 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f499c0baae0 0x7f499c0d05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:03.501 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.492 7f499bfff700 1 -- 172.21.15.22:0/3602314961 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c0d1030 con 0x7f499c0d0be0 2022-04-28T14:39:03.502 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.492 7f499b7fe700 1 --2- 172.21.15.22:0/3602314961 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f499c0bb390 0x7f499c0ba4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:03.502 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.492 7f499affd700 1 --2- 172.21.15.22:0/3602314961 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f499c0baae0 0x7f499c0d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:03.502 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.492 7f499bfff700 1 --2- 172.21.15.22:0/3602314961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f499c0d0be0 0x7f499c1c5670 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f499c0e0820 tx=0x7f4994006c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:03.502 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.492 7f4998ff9700 1 -- 172.21.15.22:0/3602314961 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f499c0d1030 con 0x7f499c0d0be0 2022-04-28T14:39:03.502 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.493 7f4998ff9700 1 -- 172.21.15.22:0/3602314961 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4994011960 con 0x7f499c0d0be0 2022-04-28T14:39:03.503 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.493 7f49a2a5c700 1 -- 172.21.15.22:0/3602314961 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f499c0d1290 con 0x7f499c0d0be0 2022-04-28T14:39:03.503 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.493 7f4998ff9700 1 -- 172.21.15.22:0/3602314961 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4994021020 con 0x7f499c0d0be0 2022-04-28T14:39:03.503 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.493 7f49a2a5c700 1 -- 172.21.15.22:0/3602314961 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f499c1c5ca0 con 0x7f499c0d0be0 2022-04-28T14:39:03.503 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.493 7f4998ff9700 1 -- 172.21.15.22:0/3602314961 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f499401c470 con 0x7f499c0d0be0 2022-04-28T14:39:03.503 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.493 7f4998ff9700 1 -- 172.21.15.22:0/3602314961 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2054+0+0 (secure 0 0 0) 0x7f4994018030 con 0x7f499c0d0be0 2022-04-28T14:39:03.504 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.494 7f49a2a5c700 1 -- 172.21.15.22:0/3602314961 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f499c0f0370 con 0x7f499c0d0be0 2022-04-28T14:39:03.504 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.496 7f4998ff9700 1 -- 172.21.15.22:0/3602314961 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f4994011750 con 0x7f499c0d0be0 2022-04-28T14:39:03.598 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:03.593 7f49a2a5c700 1 -- 172.21.15.22:0/3602314961 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f499c0cfe30 con 0x7f499c0d0be0 2022-04-28T14:39:04.385 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.380 7f4998ff9700 1 -- 172.21.15.22:0/3602314961 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v10) v1 ==== 109+0+0 (secure 0 0 0) 0x7f499400b680 con 0x7f499c0d0be0 2022-04-28T14:39:04.390 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.384 7f49a2a5c700 1 -- 172.21.15.22:0/3602314961 >> v1:172.21.15.22:6808/86956 conn(0x7f497c01c1b0 legacy=0x7f497c01e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:04.390 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.384 7f49a2a5c700 1 -- 172.21.15.22:0/3602314961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f499c0d0be0 msgr2=0x7f499c1c5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:04.390 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.384 7f49a2a5c700 1 --2- 172.21.15.22:0/3602314961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f499c0d0be0 0x7f499c1c5670 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f499c0e0820 tx=0x7f4994006c40).stop 2022-04-28T14:39:04.390 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.384 7f49a2a5c700 1 -- 172.21.15.22:0/3602314961 shutdown_connections 2022-04-28T14:39:04.390 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.384 7f49a2a5c700 1 --2- 172.21.15.22:0/3602314961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f499c0d0be0 0x7f499c1c5670 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:04.390 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.384 7f49a2a5c700 1 --2- 172.21.15.22:0/3602314961 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f499c0bb390 0x7f499c0ba4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:04.390 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.384 7f49a2a5c700 1 --2- 172.21.15.22:0/3602314961 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f499c0baae0 0x7f499c0d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:04.391 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.385 7f49a2a5c700 1 -- 172.21.15.22:0/3602314961 >> 172.21.15.22:0/3602314961 conn(0x7f499c0ae080 msgr2=0x7f499c124ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:04.391 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.385 7f49a2a5c700 1 -- 172.21.15.22:0/3602314961 shutdown_connections 2022-04-28T14:39:04.391 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.385 7f49a2a5c700 1 -- 172.21.15.22:0/3602314961 wait complete. 2022-04-28T14:39:04.391 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'rbd' created 2022-04-28T14:39:04.403 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2022-04-28T14:39:04.541 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.534 7f0fd6507700 1 Processor -- start 2022-04-28T14:39:04.541 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.534 7f0fd6507700 1 -- start start 2022-04-28T14:39:04.541 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.534 7f0fd6507700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0fd00f1a60 0x7f0fd01b9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:04.541 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.534 7f0fd6507700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0fd01b9f60 0x7f0fd01bc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:04.541 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.534 7f0fd6507700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd00ab020 con 0x7f0fd00f6220 2022-04-28T14:39:04.542 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.534 7f0fd6507700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd010ebd0 con 0x7f0fd00f1a60 2022-04-28T14:39:04.542 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.534 7f0fd6507700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd010f160 con 0x7f0fd01b9f60 2022-04-28T14:39:04.542 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.534 7f0fcf2c1700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0fd00f6220 0x7f0fd00f1260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37882/0 (socket says 172.21.15.22:37882) 2022-04-28T14:39:04.542 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.534 7f0fcfac2700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0fd01b9f60 0x7f0fd01bc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:04.542 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.534 7f0fcf2c1700 1 -- 172.21.15.22:0/3229665107 learned_addr learned my addr 172.21.15.22:0/3229665107 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:39:04.542 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.534 7f0fceac0700 1 --2- 172.21.15.22:0/3229665107 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0fd00f1a60 0x7f0fd01b9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:04.542 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.535 7f0fce2bf700 1 -- 172.21.15.22:0/3229665107 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203996415 0 0) 0x7f0fb8001110 con 0x7f0fd00f6220 2022-04-28T14:39:04.542 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.535 7f0fce2bf700 1 -- 172.21.15.22:0/3229665107 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fb0003270 con 0x7f0fd00f6220 2022-04-28T14:39:04.542 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.535 7f0fcfac2700 1 -- 172.21.15.22:0/3229665107 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0fd00f1a60 msgr2=0x7f0fd01b9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:04.543 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.535 7f0fcfac2700 1 --2- 172.21.15.22:0/3229665107 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0fd00f1a60 0x7f0fd01b9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:04.543 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.535 7f0fcfac2700 1 -- 172.21.15.22:0/3229665107 >> v1:172.21.15.22:6789/0 conn(0x7f0fd00f6220 legacy=0x7f0fd00f1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:04.543 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.535 7f0fcfac2700 1 -- 172.21.15.22:0/3229665107 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd01160f0 con 0x7f0fd01b9f60 2022-04-28T14:39:04.543 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.535 7f0fceac0700 1 --2- 172.21.15.22:0/3229665107 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0fd00f1a60 0x7f0fd01b9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:04.543 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.535 7f0fcfac2700 1 --2- 172.21.15.22:0/3229665107 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0fd01b9f60 0x7f0fd01bc3c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f0fd0114c50 tx=0x7f0fc8009cf0).ready entity=mon.2 client_cookie=e72abdfd31972163 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:04.543 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.535 7f0fce2bf700 1 -- 172.21.15.22:0/3229665107 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0fd01160f0 con 0x7f0fd01b9f60 2022-04-28T14:39:04.543 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.535 7f0fce2bf700 1 -- 172.21.15.22:0/3229665107 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc800b840 con 0x7f0fd01b9f60 2022-04-28T14:39:04.543 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.535 7f0fce2bf700 1 -- 172.21.15.22:0/3229665107 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0fc800ba20 con 0x7f0fd01b9f60 2022-04-28T14:39:04.544 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.535 7f0fd6507700 1 -- 172.21.15.22:0/3229665107 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0fd01b9f60 msgr2=0x7f0fd01bc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:04.544 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.535 7f0fd6507700 1 --2- 172.21.15.22:0/3229665107 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0fd01b9f60 0x7f0fd01bc3c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f0fd0114c50 tx=0x7f0fc8009cf0).stop 2022-04-28T14:39:04.544 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.536 7f0fd6507700 1 -- 172.21.15.22:0/3229665107 shutdown_connections 2022-04-28T14:39:04.544 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.536 7f0fd6507700 1 --2- 172.21.15.22:0/3229665107 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0fd01b9f60 0x7f0fd01bc3c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:04.544 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.536 7f0fd6507700 1 --2- 172.21.15.22:0/3229665107 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0fd00f1a60 0x7f0fd01b9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:04.544 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.536 7f0fd6507700 1 -- 172.21.15.22:0/3229665107 >> 172.21.15.22:0/3229665107 conn(0x7f0fd0117110 msgr2=0x7f0fd00f2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:04.544 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.536 7f0fd6507700 1 -- 172.21.15.22:0/3229665107 shutdown_connections 2022-04-28T14:39:04.544 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.536 7f0fd6507700 1 -- 172.21.15.22:0/3229665107 wait complete. 2022-04-28T14:39:04.564 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.559 7f0fd6507700 1 Processor -- start 2022-04-28T14:39:04.564 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.560 7f0fd6507700 1 -- start start 2022-04-28T14:39:04.566 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.560 7f0fd6507700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fd00b2ea0 0x7f0fd00d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:04.567 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.560 7f0fd6507700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0fd00b32f0 0x7f0fd00d2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:04.567 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.560 7f0fd6507700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0fd01c5210 0x7f0fd01c5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:04.567 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.560 7f0fd6507700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd00b3740 con 0x7f0fd00b2ea0 2022-04-28T14:39:04.567 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.560 7f0fd6507700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd01b7c20 con 0x7f0fd00b32f0 2022-04-28T14:39:04.567 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.560 7f0fd6507700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd01b8570 con 0x7f0fd01c5210 2022-04-28T14:39:04.567 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.560 7f0fcf2c1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fd00b2ea0 0x7f0fd00d1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:04.567 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.560 7f0fceac0700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0fd00b32f0 0x7f0fd00d2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:04.567 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.560 7f0fcf2c1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fd00b2ea0 0x7f0fd00d1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48492/0 (socket says 172.21.15.22:48492) 2022-04-28T14:39:04.568 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.560 7f0fcfac2700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0fd01c5210 0x7f0fd01c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:04.568 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.560 7f0fcf2c1700 1 -- 172.21.15.22:0/2348267458 learned_addr learned my addr 172.21.15.22:0/2348267458 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:04.568 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.560 7f0fcf2c1700 1 -- 172.21.15.22:0/2348267458 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0fd01c5210 msgr2=0x7f0fd01c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:04.568 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.560 7f0fcf2c1700 1 --2- 172.21.15.22:0/2348267458 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0fd01c5210 0x7f0fd01c5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:04.568 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.560 7f0fcf2c1700 1 -- 172.21.15.22:0/2348267458 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0fd00b32f0 msgr2=0x7f0fd00d2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:04.568 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.560 7f0fcf2c1700 1 --2- 172.21.15.22:0/2348267458 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0fd00b32f0 0x7f0fd00d2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:04.568 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.560 7f0fcf2c1700 1 -- 172.21.15.22:0/2348267458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd01b81b0 con 0x7f0fd00b2ea0 2022-04-28T14:39:04.568 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.561 7f0fcfac2700 1 --2- 172.21.15.22:0/2348267458 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0fd01c5210 0x7f0fd01c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:04.568 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.561 7f0fceac0700 1 --2- 172.21.15.22:0/2348267458 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0fd00b32f0 0x7f0fd00d2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:04.568 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.561 7f0fcf2c1700 1 --2- 172.21.15.22:0/2348267458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fd00b2ea0 0x7f0fd00d1be0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f0fb8000ed0 tx=0x7f0fb800c7b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:04.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.561 7f0fccabc700 1 -- 172.21.15.22:0/2348267458 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0fd01b81b0 con 0x7f0fd00b2ea0 2022-04-28T14:39:04.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.561 7f0fccabc700 1 -- 172.21.15.22:0/2348267458 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb80072e0 con 0x7f0fd00b2ea0 2022-04-28T14:39:04.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.561 7f0fccabc700 1 -- 172.21.15.22:0/2348267458 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0fb8005810 con 0x7f0fd00b2ea0 2022-04-28T14:39:04.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.561 7f0fd6507700 1 -- 172.21.15.22:0/2348267458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd01b7e90 con 0x7f0fd00b2ea0 2022-04-28T14:39:04.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.561 7f0fd6507700 1 -- 172.21.15.22:0/2348267458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd01c5c90 con 0x7f0fd00b2ea0 2022-04-28T14:39:04.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.561 7f0fccabc700 1 -- 172.21.15.22:0/2348267458 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f0fb8005a10 con 0x7f0fd00b2ea0 2022-04-28T14:39:04.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.561 7f0fccabc700 1 -- 172.21.15.22:0/2348267458 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2396+0+0 (secure 0 0 0) 0x7f0fb8028d70 con 0x7f0fd00b2ea0 2022-04-28T14:39:04.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.562 7f0fd6507700 1 -- 172.21.15.22:0/2348267458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd00f02b0 con 0x7f0fd00b2ea0 2022-04-28T14:39:04.570 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.565 7f0fccabc700 1 -- 172.21.15.22:0/2348267458 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f0fb80070d0 con 0x7f0fd00b2ea0 2022-04-28T14:39:04.667 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:04.662 7f0fd6507700 1 -- 172.21.15.22:0/2348267458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0fd00a5af0 con 0x7f0fd00b2ea0 2022-04-28T14:39:05.386 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.381 7f0fccabc700 1 -- 172.21.15.22:0/2348267458 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v11) v1 ==== 173+0+0 (secure 0 0 0) 0x7f0fd0114900 con 0x7f0fd00b2ea0 2022-04-28T14:39:05.388 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.384 7f0fd6507700 1 -- 172.21.15.22:0/2348267458 >> v1:172.21.15.22:6808/86956 conn(0x7f0fb401c1b0 legacy=0x7f0fb401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:05.389 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.384 7f0fd6507700 1 -- 172.21.15.22:0/2348267458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fd00b2ea0 msgr2=0x7f0fd00d1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:05.389 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.384 7f0fd6507700 1 --2- 172.21.15.22:0/2348267458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fd00b2ea0 0x7f0fd00d1be0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f0fb8000ed0 tx=0x7f0fb800c7b0).stop 2022-04-28T14:39:05.389 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.384 7f0fd6507700 1 -- 172.21.15.22:0/2348267458 shutdown_connections 2022-04-28T14:39:05.389 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.384 7f0fd6507700 1 --2- 172.21.15.22:0/2348267458 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0fd01c5210 0x7f0fd01c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:05.389 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.384 7f0fd6507700 1 --2- 172.21.15.22:0/2348267458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fd00b2ea0 0x7f0fd00d1be0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:05.389 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.384 7f0fd6507700 1 --2- 172.21.15.22:0/2348267458 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0fd00b32f0 0x7f0fd00d2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:05.389 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.384 7f0fd6507700 1 -- 172.21.15.22:0/2348267458 >> 172.21.15.22:0/2348267458 conn(0x7f0fd00e09f0 msgr2=0x7f0fd00ad340 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:05.390 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.384 7f0fd6507700 1 -- 172.21.15.22:0/2348267458 shutdown_connections 2022-04-28T14:39:05.390 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.384 7f0fd6507700 1 -- 172.21.15.22:0/2348267458 wait complete. 2022-04-28T14:39:05.395 INFO:teuthology.orchestra.run.smithi022.stderr:enabled application 'rbd' on pool 'rbd' 2022-04-28T14:39:05.406 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2022-04-28T14:39:05.406 INFO:tasks.ceph.mds.a:Restarting daemon 2022-04-28T14:39:05.406 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-04-28T14:39:05.408 INFO:tasks.ceph.mds.a:Started 2022-04-28T14:39:05.409 INFO:tasks.ceph.mds.b:Restarting daemon 2022-04-28T14:39:05.409 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-04-28T14:39:05.411 INFO:tasks.ceph.mds.b:Started 2022-04-28T14:39:05.411 INFO:tasks.ceph.mds.c:Restarting daemon 2022-04-28T14:39:05.412 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-04-28T14:39:05.414 INFO:tasks.ceph.mds.c:Started 2022-04-28T14:39:05.414 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2022-04-28T14:39:05.414 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-28T14:39:05.544 INFO:tasks.ceph.mds.b.smithi022.stdout:starting mds.b at 2022-04-28T14:39:05.548 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2022-04-28T14:39:05.548 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2022-04-28T14:39:05.562 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.558 7f0471cc1700 1 Processor -- start 2022-04-28T14:39:05.562 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.558 7f0471cc1700 1 -- start start 2022-04-28T14:39:05.565 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.558 7f0471cc1700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f046c0f6370 0x7f046c0f1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:05.565 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.558 7f0471cc1700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f046c0f67c0 0x7f046c0f18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:05.565 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.558 7f0471cc1700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f046c0ab0b0 con 0x7f046c1b2470 2022-04-28T14:39:05.565 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.558 7f0471cc1700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f046c111c20 con 0x7f046c0f67c0 2022-04-28T14:39:05.565 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.558 7f0471cc1700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f046c10cb00 con 0x7f046c0f6370 2022-04-28T14:39:05.565 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.558 7f046a2b1700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f046c0f67c0 0x7f046c0f18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:05.566 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.558 7f046a2b1700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f046c0f67c0 0x7f046c0f18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46104/0 (socket says 172.21.15.22:46104) 2022-04-28T14:39:05.566 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.558 7f046aab2700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f046c0f6370 0x7f046c0f1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:05.566 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.558 7f046b2b3700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f046c1b2470 0x7f046c1b28c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37934/0 (socket says 172.21.15.22:37934) 2022-04-28T14:39:05.566 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.558 7f046a2b1700 1 -- 172.21.15.22:0/127344892 learned_addr learned my addr 172.21.15.22:0/127344892 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:05.566 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.559 7f046aab2700 1 -- 172.21.15.22:0/127344892 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f046c0f67c0 msgr2=0x7f046c0f18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:05.566 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.559 7f046aab2700 1 --2- 172.21.15.22:0/127344892 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f046c0f67c0 0x7f046c0f18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:05.566 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.559 7f046aab2700 1 -- 172.21.15.22:0/127344892 >> v1:172.21.15.22:6789/0 conn(0x7f046c1b2470 legacy=0x7f046c1b28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:05.566 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.559 7f0469ab0700 1 -- 172.21.15.22:0/127344892 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 663722024 0 0) 0x7f0464001490 con 0x7f046c1b2470 2022-04-28T14:39:05.566 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.559 7f046aab2700 1 -- 172.21.15.22:0/127344892 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f046c10d3e0 con 0x7f046c0f6370 2022-04-28T14:39:05.567 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.559 7f046a2b1700 1 --2- 172.21.15.22:0/127344892 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f046c0f67c0 0x7f046c0f18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:05.567 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.559 7f046aab2700 1 --2- 172.21.15.22:0/127344892 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f046c0f6370 0x7f046c0f1270 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f0460002f70 tx=0x7f046000b9a0).ready entity=mon.2 client_cookie=86028d5c8b15873e server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:05.567 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.559 7f0469ab0700 1 -- 172.21.15.22:0/127344892 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f046c10d3e0 con 0x7f046c0f6370 2022-04-28T14:39:05.567 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.559 7f0469ab0700 1 -- 172.21.15.22:0/127344892 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046000d5c0 con 0x7f046c0f6370 2022-04-28T14:39:05.567 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.559 7f0469ab0700 1 -- 172.21.15.22:0/127344892 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f046000d990 con 0x7f046c0f6370 2022-04-28T14:39:05.567 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.559 7f0471cc1700 1 -- 172.21.15.22:0/127344892 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f046c0f6370 msgr2=0x7f046c0f1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:05.567 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.559 7f0471cc1700 1 --2- 172.21.15.22:0/127344892 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f046c0f6370 0x7f046c0f1270 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f0460002f70 tx=0x7f046000b9a0).stop 2022-04-28T14:39:05.567 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.560 7f0471cc1700 1 -- 172.21.15.22:0/127344892 shutdown_connections 2022-04-28T14:39:05.567 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.560 7f0471cc1700 1 --2- 172.21.15.22:0/127344892 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f046c0f6370 0x7f046c0f1270 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:05.567 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.560 7f0471cc1700 1 --2- 172.21.15.22:0/127344892 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f046c0f67c0 0x7f046c0f18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:05.568 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.560 7f0471cc1700 1 -- 172.21.15.22:0/127344892 >> 172.21.15.22:0/127344892 conn(0x7f046c117120 msgr2=0x7f046c0f2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:05.568 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.560 7f0471cc1700 1 -- 172.21.15.22:0/127344892 shutdown_connections 2022-04-28T14:39:05.568 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.560 7f0471cc1700 1 -- 172.21.15.22:0/127344892 wait complete. 2022-04-28T14:39:05.590 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.584 7f0471cc1700 1 Processor -- start 2022-04-28T14:39:05.591 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.584 7f0471cc1700 1 -- start start 2022-04-28T14:39:05.591 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.584 7f0471cc1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f046c11f770 0x7f046c1c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:05.591 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.584 7f0471cc1700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f046c1c1c00 0x7f046c1b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:05.591 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.584 7f0471cc1700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f046c1c2050 0x7f046c1b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:05.591 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.584 7f0471cc1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046c0dd4f0 con 0x7f046c11f770 2022-04-28T14:39:05.591 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.584 7f0471cc1700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f046c0dded0 con 0x7f046c1c2050 2022-04-28T14:39:05.591 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.584 7f0471cc1700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f046c0d3140 con 0x7f046c1c1c00 2022-04-28T14:39:05.591 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.584 7f046aab2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f046c11f770 0x7f046c1c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:05.592 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.584 7f046aab2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f046c11f770 0x7f046c1c15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48540/0 (socket says 172.21.15.22:48540) 2022-04-28T14:39:05.592 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.584 7f046b2b3700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f046c1c2050 0x7f046c1b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:05.592 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.584 7f046aab2700 1 -- 172.21.15.22:0/1370827012 learned_addr learned my addr 172.21.15.22:0/1370827012 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:05.592 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.584 7f046a2b1700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f046c1c1c00 0x7f046c1b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:05.592 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.585 7f046aab2700 1 -- 172.21.15.22:0/1370827012 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f046c1c1c00 msgr2=0x7f046c1b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:05.592 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.585 7f046aab2700 1 --2- 172.21.15.22:0/1370827012 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f046c1c1c00 0x7f046c1b3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:05.592 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.585 7f046aab2700 1 -- 172.21.15.22:0/1370827012 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f046c1c2050 msgr2=0x7f046c1b4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:05.593 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.585 7f046aab2700 1 --2- 172.21.15.22:0/1370827012 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f046c1c2050 0x7f046c1b4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:05.593 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.585 7f046aab2700 1 -- 172.21.15.22:0/1370827012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f046c0ac320 con 0x7f046c11f770 2022-04-28T14:39:05.593 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.585 7f046aab2700 1 --2- 172.21.15.22:0/1370827012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f046c11f770 0x7f046c1c15d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f046c0d3970 tx=0x7f04600068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:05.593 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.585 7f045bfff700 1 -- 172.21.15.22:0/1370827012 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f046c0ac320 con 0x7f046c11f770 2022-04-28T14:39:05.593 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.585 7f045bfff700 1 -- 172.21.15.22:0/1370827012 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0460006ab0 con 0x7f046c11f770 2022-04-28T14:39:05.593 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.585 7f0471cc1700 1 -- 172.21.15.22:0/1370827012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f046c0ddaf0 con 0x7f046c11f770 2022-04-28T14:39:05.593 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.585 7f045bfff700 1 -- 172.21.15.22:0/1370827012 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0460022020 con 0x7f046c11f770 2022-04-28T14:39:05.593 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.585 7f0471cc1700 1 -- 172.21.15.22:0/1370827012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f046c1b4980 con 0x7f046c11f770 2022-04-28T14:39:05.593 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.585 7f045bfff700 1 -- 172.21.15.22:0/1370827012 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f0460011b40 con 0x7f046c11f770 2022-04-28T14:39:05.594 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.586 7f045bfff700 1 -- 172.21.15.22:0/1370827012 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2407+0+0 (secure 0 0 0) 0x7f0460028a40 con 0x7f046c11f770 2022-04-28T14:39:05.594 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.586 7f0471cc1700 1 -- 172.21.15.22:0/1370827012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f046c0f02c0 con 0x7f046c11f770 2022-04-28T14:39:05.594 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.589 7f045bfff700 1 -- 172.21.15.22:0/1370827012 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f046000d3b0 con 0x7f046c11f770 2022-04-28T14:39:05.692 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.687 7f0471cc1700 1 -- 172.21.15.22:0/1370827012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f046c1c2780 con 0x7f046c11f770 2022-04-28T14:39:05.692 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.687 7f045bfff700 1 -- 172.21.15.22:0/1370827012 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+5916 (secure 0 0 0) 0x7f0460011740 con 0x7f046c11f770 2022-04-28T14:39:05.692 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:05.693 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":11,"fsid":"3047163a-0285-4058-8e05-ce74c6fbb9c5","created":"2022-04-28 14:38:54.232890","modified":"2022-04-28 14:39:05.378763","last_up_change":"2022-04-28 14:39:00.269721","last_in_change":"2022-04-28 14:39:00.269721","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-04-28 14:39:03.639717","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"782ee638-1ada-48d9-9454-f9e0ca8a3135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6800","nonce":87556}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":87556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":87556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":87556}]},"public_addr":"172.21.15.22:6800/87556","cluster_addr":"172.21.15.22:6801/87556","heartbeat_back_addr":"172.21.15.22:6803/87556","heartbeat_front_addr":"172.21.15.22:6802/87556","state":["exists","up"]},{"osd":1,"uuid":"61ca6f96-fb4f-4c0f-b68b-edf1e7011f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":87557}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":87557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":87557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":87557}]},"public_addr":"172.21.15.22:6804/87557","cluster_addr":"172.21.15.22:6805/87557","heartbeat_back_addr":"172.21.15.22:6807/87557","heartbeat_front_addr":"172.21.15.22:6806/87557","state":["exists","up"]},{"osd":2,"uuid":"4b3043b9-50df-4b7f-a55a-ac8e6148c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":87558}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":87558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":87558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":87558}]},"public_addr":"172.21.15.22:6813/87558","cluster_addr":"172.21.15.22:6814/87558","heartbeat_back_addr":"172.21.15.22:6816/87558","heartbeat_front_addr":"172.21.15.22:6815/87558","state":["exists","up"]},{"osd":3,"uuid":"7807bcd1-53f8-44b5-9992-57c328e5b299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":87561}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":87561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":87561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":87561}]},"public_addr":"172.21.15.22:6809/87561","cluster_addr":"172.21.15.22:6810/87561","heartbeat_back_addr":"172.21.15.22:6812/87561","heartbeat_front_addr":"172.21.15.22:6811/87561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-04-28T14:39:05.694 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.688 7f0471cc1700 1 -- 172.21.15.22:0/1370827012 >> v1:172.21.15.22:6808/86956 conn(0x7f044801c1b0 legacy=0x7f044801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:05.694 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.688 7f0471cc1700 1 -- 172.21.15.22:0/1370827012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f046c11f770 msgr2=0x7f046c1c15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:05.694 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.688 7f0471cc1700 1 --2- 172.21.15.22:0/1370827012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f046c11f770 0x7f046c1c15d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f046c0d3970 tx=0x7f04600068c0).stop 2022-04-28T14:39:05.694 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.689 7f0471cc1700 1 -- 172.21.15.22:0/1370827012 shutdown_connections 2022-04-28T14:39:05.694 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.689 7f0471cc1700 1 --2- 172.21.15.22:0/1370827012 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f046c1c2050 0x7f046c1b4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:05.694 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.689 7f0471cc1700 1 --2- 172.21.15.22:0/1370827012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f046c11f770 0x7f046c1c15d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:05.694 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.689 7f0471cc1700 1 --2- 172.21.15.22:0/1370827012 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f046c1c1c00 0x7f046c1b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:05.694 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.689 7f0471cc1700 1 -- 172.21.15.22:0/1370827012 >> 172.21.15.22:0/1370827012 conn(0x7f046c0ad130 msgr2=0x7f046c121a90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:05.695 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.689 7f0471cc1700 1 -- 172.21.15.22:0/1370827012 shutdown_connections 2022-04-28T14:39:05.695 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.689 7f0471cc1700 1 -- 172.21.15.22:0/1370827012 wait complete. 2022-04-28T14:39:05.704 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2022-04-28 14:39:03.639717', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-04-28T14:39:05.705 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-04-28T14:39:05.838 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.832 7ff0349b3700 1 Processor -- start 2022-04-28T14:39:05.839 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.832 7ff0349b3700 1 -- start start 2022-04-28T14:39:05.839 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.832 7ff0349b3700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff0300f6220 0x7ff0300f6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:05.839 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.832 7ff0349b3700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff0301b24d0 0x7ff0301b2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:05.839 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.832 7ff0349b3700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0300ab080 con 0x7ff0301b2f50 2022-04-28T14:39:05.839 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.832 7ff0349b3700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff030111c20 con 0x7ff0300f6220 2022-04-28T14:39:05.839 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.832 7ff0349b3700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0301115b0 con 0x7ff0301b24d0 2022-04-28T14:39:05.839 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.832 7ff02d5ff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff0300f6220 0x7ff0300f6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:05.839 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.832 7ff02de00700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff0301b2f50 0x7ff0300f1240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37946/0 (socket says 172.21.15.22:37946) 2022-04-28T14:39:05.840 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.832 7ff027fff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff0301b24d0 0x7ff0301b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:05.840 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.832 7ff02de00700 1 -- 172.21.15.22:0/4137292041 learned_addr learned my addr 172.21.15.22:0/4137292041 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:39:05.840 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.833 7ff027fff700 1 -- 172.21.15.22:0/4137292041 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff0300f6220 msgr2=0x7ff0300f6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:05.840 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.833 7ff027fff700 1 --2- 172.21.15.22:0/4137292041 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff0300f6220 0x7ff0300f6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:05.840 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.833 7ff027fff700 1 -- 172.21.15.22:0/4137292041 >> v1:172.21.15.22:6789/0 conn(0x7ff0301b2f50 legacy=0x7ff0300f1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:05.840 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.833 7ff02cdfe700 1 -- 172.21.15.22:0/4137292041 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2858142517 0 0) 0x7ff028001490 con 0x7ff0301b2f50 2022-04-28T14:39:05.840 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.833 7ff027fff700 1 -- 172.21.15.22:0/4137292041 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff03010d4d0 con 0x7ff0301b24d0 2022-04-28T14:39:05.840 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.833 7ff02d5ff700 1 --2- 172.21.15.22:0/4137292041 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff0300f6220 0x7ff0300f6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:05.840 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.833 7ff027fff700 1 --2- 172.21.15.22:0/4137292041 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff0301b24d0 0x7ff0301b2920 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff018002f70 tx=0x7ff01800b9a0).ready entity=mon.2 client_cookie=13322d5139b22367 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:05.841 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.833 7ff02cdfe700 1 -- 172.21.15.22:0/4137292041 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff03010d4d0 con 0x7ff0301b24d0 2022-04-28T14:39:05.841 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.833 7ff02cdfe700 1 -- 172.21.15.22:0/4137292041 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01800d5c0 con 0x7ff0301b24d0 2022-04-28T14:39:05.841 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.833 7ff02cdfe700 1 -- 172.21.15.22:0/4137292041 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff01800d990 con 0x7ff0301b24d0 2022-04-28T14:39:05.841 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.833 7ff0349b3700 1 -- 172.21.15.22:0/4137292041 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff0301b24d0 msgr2=0x7ff0301b2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:05.841 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.833 7ff0349b3700 1 --2- 172.21.15.22:0/4137292041 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff0301b24d0 0x7ff0301b2920 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7ff018002f70 tx=0x7ff01800b9a0).stop 2022-04-28T14:39:05.841 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.834 7ff0349b3700 1 -- 172.21.15.22:0/4137292041 shutdown_connections 2022-04-28T14:39:05.841 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.834 7ff0349b3700 1 --2- 172.21.15.22:0/4137292041 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff0300f6220 0x7ff0300f6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:05.841 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.834 7ff0349b3700 1 --2- 172.21.15.22:0/4137292041 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff0301b24d0 0x7ff0301b2920 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:05.841 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.834 7ff0349b3700 1 -- 172.21.15.22:0/4137292041 >> 172.21.15.22:0/4137292041 conn(0x7ff0301170f0 msgr2=0x7ff0300f2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:05.841 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.834 7ff0349b3700 1 -- 172.21.15.22:0/4137292041 shutdown_connections 2022-04-28T14:39:05.841 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.834 7ff0349b3700 1 -- 172.21.15.22:0/4137292041 wait complete. 2022-04-28T14:39:05.862 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.858 7ff0349b3700 1 Processor -- start 2022-04-28T14:39:05.862 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.858 7ff0349b3700 1 -- start start 2022-04-28T14:39:05.865 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.858 7ff0349b3700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff0300b7160 0x7ff0300d1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:05.865 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.858 7ff0349b3700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff0300b75b0 0x7ff0300d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:05.865 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.858 7ff0349b3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0301c3050 0x7ff0301c34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:05.865 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.858 7ff0349b3700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0300e54e0 con 0x7ff0301c3050 2022-04-28T14:39:05.865 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.858 7ff0349b3700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0300b6cd0 con 0x7ff0300b75b0 2022-04-28T14:39:05.866 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.858 7ff0349b3700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0300b6f00 con 0x7ff0300b7160 2022-04-28T14:39:05.866 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.858 7ff02d5ff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff0300b7160 0x7ff0300d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:05.866 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.858 7ff02de00700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0301c3050 0x7ff0301c34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:05.866 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.858 7ff02d5ff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff0300b7160 0x7ff0300d1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:45906/0 (socket says 172.21.15.22:45906) 2022-04-28T14:39:05.866 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.858 7ff02d5ff700 1 -- 172.21.15.22:0/1261620348 learned_addr learned my addr 172.21.15.22:0/1261620348 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:05.867 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.858 7ff02de00700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0301c3050 0x7ff0301c34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48558/0 (socket says 172.21.15.22:48558) 2022-04-28T14:39:05.867 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.858 7ff027fff700 1 --2- 172.21.15.22:0/1261620348 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff0300b75b0 0x7ff0300d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:05.867 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.859 7ff02d5ff700 1 -- 172.21.15.22:0/1261620348 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff0300b75b0 msgr2=0x7ff0300d1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:05.867 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.859 7ff02d5ff700 1 --2- 172.21.15.22:0/1261620348 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff0300b75b0 0x7ff0300d1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:05.867 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.859 7ff02d5ff700 1 -- 172.21.15.22:0/1261620348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0301c3050 msgr2=0x7ff0301c34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:05.867 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.859 7ff02d5ff700 1 --2- 172.21.15.22:0/1261620348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0301c3050 0x7ff0301c34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:05.867 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.859 7ff02d5ff700 1 -- 172.21.15.22:0/1261620348 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0301b5bb0 con 0x7ff0300b7160 2022-04-28T14:39:05.867 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.859 7ff02d5ff700 1 --2- 172.21.15.22:0/1261620348 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff0300b7160 0x7ff0300d1990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff02000c000 tx=0x7ff02000bf70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:05.868 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.859 7ff0267fc700 1 -- 172.21.15.22:0/1261620348 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff0301b5bb0 con 0x7ff0300b7160 2022-04-28T14:39:05.868 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.859 7ff0267fc700 1 -- 172.21.15.22:0/1261620348 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02000c870 con 0x7ff0300b7160 2022-04-28T14:39:05.868 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.859 7ff0349b3700 1 -- 172.21.15.22:0/1261620348 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0301b63d0 con 0x7ff0300b7160 2022-04-28T14:39:05.868 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.859 7ff0267fc700 1 -- 172.21.15.22:0/1261620348 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7ff02000f040 con 0x7ff0300b7160 2022-04-28T14:39:05.868 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.859 7ff0349b3700 1 -- 172.21.15.22:0/1261620348 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0300d25f0 con 0x7ff0300b7160 2022-04-28T14:39:05.868 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.860 7ff0267fc700 1 -- 172.21.15.22:0/1261620348 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7ff020011070 con 0x7ff0300b7160 2022-04-28T14:39:05.869 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.860 7ff0267fc700 1 -- 172.21.15.22:0/1261620348 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2407+0+0 (secure 0 0 0) 0x7ff020010040 con 0x7ff0300b7160 2022-04-28T14:39:05.869 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.860 7ff0349b3700 1 -- 172.21.15.22:0/1261620348 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0300f0290 con 0x7ff0300b7160 2022-04-28T14:39:05.870 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.863 7ff0267fc700 1 -- 172.21.15.22:0/1261620348 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7ff02000c470 con 0x7ff0300b7160 2022-04-28T14:39:05.965 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.960 7ff0349b3700 1 -- 172.21.15.22:0/1261620348 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff0301128e0 con 0x7ff0300b7160 2022-04-28T14:39:05.966 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.961 7ff0267fc700 1 -- 172.21.15.22:0/1261620348 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v11) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff020000c30 con 0x7ff0300b7160 2022-04-28T14:39:05.966 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2022-04-28T14:39:05.967 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.962 7ff0349b3700 1 -- 172.21.15.22:0/1261620348 >> v1:172.21.15.22:6808/86956 conn(0x7ff01401c1b0 legacy=0x7ff01401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:05.967 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.962 7ff0349b3700 1 -- 172.21.15.22:0/1261620348 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff0300b7160 msgr2=0x7ff0300d1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:05.967 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.962 7ff0349b3700 1 --2- 172.21.15.22:0/1261620348 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff0300b7160 0x7ff0300d1990 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7ff02000c000 tx=0x7ff02000bf70).stop 2022-04-28T14:39:05.967 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.962 7ff0349b3700 1 -- 172.21.15.22:0/1261620348 shutdown_connections 2022-04-28T14:39:05.968 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.962 7ff0349b3700 1 --2- 172.21.15.22:0/1261620348 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0301c3050 0x7ff0301c34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:05.968 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.962 7ff0349b3700 1 --2- 172.21.15.22:0/1261620348 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff0300b7160 0x7ff0300d1990 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:05.968 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.962 7ff0349b3700 1 --2- 172.21.15.22:0/1261620348 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff0300b75b0 0x7ff0300d1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:05.968 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.962 7ff0349b3700 1 -- 172.21.15.22:0/1261620348 >> 172.21.15.22:0/1261620348 conn(0x7ff0300adb80 msgr2=0x7ff030120590 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:05.968 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.962 7ff0349b3700 1 -- 172.21.15.22:0/1261620348 shutdown_connections 2022-04-28T14:39:05.968 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:05.962 7ff0349b3700 1 -- 172.21.15.22:0/1261620348 wait complete. 2022-04-28T14:39:05.978 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-04-28T14:39:06.107 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.102 7f47b1106700 1 Processor -- start 2022-04-28T14:39:06.107 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.103 7f47b1106700 1 -- start start 2022-04-28T14:39:06.110 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.103 7f47b1106700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f47ac0f6460 0x7f47ac0fea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:06.110 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.103 7f47b1106700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f47ac0ff070 0x7f47ac1b1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:06.110 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.103 7f47b1106700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47ac0ab2b0 con 0x7f47ac0ff4c0 2022-04-28T14:39:06.110 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.103 7f47b1106700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac1b2360 con 0x7f47ac0f6460 2022-04-28T14:39:06.110 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.103 7f47b1106700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac115ea0 con 0x7f47ac0ff070 2022-04-28T14:39:06.110 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.103 7f47a9e00700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f47ac0f6460 0x7f47ac0fea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:06.110 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.103 7f47a95ff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f47ac0ff070 0x7f47ac1b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:06.111 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.103 7f47a9e00700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f47ac0f6460 0x7f47ac0fea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46130/0 (socket says 172.21.15.22:46130) 2022-04-28T14:39:06.111 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.103 7f47a95ff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f47ac0ff070 0x7f47ac1b1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:45916/0 (socket says 172.21.15.22:45916) 2022-04-28T14:39:06.111 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.103 7f47a9e00700 1 -- 172.21.15.22:0/2735587469 learned_addr learned my addr 172.21.15.22:0/2735587469 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:06.111 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.104 7f47a95ff700 1 -- 172.21.15.22:0/2735587469 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f47ac0f6460 msgr2=0x7f47ac0fea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:06.111 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.104 7f47a8dfe700 1 -- 172.21.15.22:0/2735587469 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1219260067 0 0) 0x7f47a4001490 con 0x7f47ac0ff4c0 2022-04-28T14:39:06.111 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.104 7f47a95ff700 1 --2- 172.21.15.22:0/2735587469 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f47ac0f6460 0x7f47ac0fea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:06.111 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.104 7f47a95ff700 1 -- 172.21.15.22:0/2735587469 >> v1:172.21.15.22:6789/0 conn(0x7f47ac0ff4c0 legacy=0x7f47ac1b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:06.111 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.104 7f47a95ff700 1 -- 172.21.15.22:0/2735587469 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ac10b8a0 con 0x7f47ac0ff070 2022-04-28T14:39:06.111 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.104 7f47a9e00700 1 --2- 172.21.15.22:0/2735587469 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f47ac0f6460 0x7f47ac0fea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:06.111 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.104 7f47a95ff700 1 --2- 172.21.15.22:0/2735587469 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f47ac0ff070 0x7f47ac1b1530 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f47a0002f70 tx=0x7f47a000b9a0).ready entity=mon.2 client_cookie=37334386b06055f2 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:06.112 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.104 7f47a8dfe700 1 -- 172.21.15.22:0/2735587469 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f47ac10b8a0 con 0x7f47ac0ff070 2022-04-28T14:39:06.112 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.104 7f47a8dfe700 1 -- 172.21.15.22:0/2735587469 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a000d570 con 0x7f47ac0ff070 2022-04-28T14:39:06.112 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.104 7f47a8dfe700 1 -- 172.21.15.22:0/2735587469 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f47a000d940 con 0x7f47ac0ff070 2022-04-28T14:39:06.112 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.104 7f47b1106700 1 -- 172.21.15.22:0/2735587469 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f47ac0ff070 msgr2=0x7f47ac1b1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:06.112 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.104 7f47b1106700 1 --2- 172.21.15.22:0/2735587469 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f47ac0ff070 0x7f47ac1b1530 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f47a0002f70 tx=0x7f47a000b9a0).stop 2022-04-28T14:39:06.112 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.105 7f47b1106700 1 -- 172.21.15.22:0/2735587469 shutdown_connections 2022-04-28T14:39:06.112 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.105 7f47b1106700 1 --2- 172.21.15.22:0/2735587469 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f47ac0f6460 0x7f47ac0fea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:06.112 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.105 7f47b1106700 1 --2- 172.21.15.22:0/2735587469 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f47ac0ff070 0x7f47ac1b1530 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:06.112 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.105 7f47b1106700 1 -- 172.21.15.22:0/2735587469 >> 172.21.15.22:0/2735587469 conn(0x7f47ac1171f0 msgr2=0x7f47ac0f2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:06.113 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.105 7f47b1106700 1 -- 172.21.15.22:0/2735587469 shutdown_connections 2022-04-28T14:39:06.113 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.105 7f47b1106700 1 -- 172.21.15.22:0/2735587469 wait complete. 2022-04-28T14:39:06.136 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.129 7f47b1106700 1 Processor -- start 2022-04-28T14:39:06.136 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.129 7f47b1106700 1 -- start start 2022-04-28T14:39:06.136 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.129 7f47b1106700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f47ac1c4b10 0x7f47ac1c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:06.136 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.129 7f47b1106700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f47ac1c5590 0x7f47ac0cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:06.136 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.129 7f47b1106700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47ac0cc6e0 0x7f47ac0ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:06.136 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.129 7f47b1106700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac0a2d70 con 0x7f47ac0cc6e0 2022-04-28T14:39:06.137 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.129 7f47b1106700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac11d4b0 con 0x7f47ac1c5590 2022-04-28T14:39:06.137 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.129 7f47b1106700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac0dabf0 con 0x7f47ac1c4b10 2022-04-28T14:39:06.137 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.129 7f47a95ff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f47ac1c5590 0x7f47ac0cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:06.137 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.129 7f47a9e00700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f47ac1c4b10 0x7f47ac1c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:06.137 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.129 7f47aa601700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47ac0cc6e0 0x7f47ac0ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:06.137 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.129 7f47a95ff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f47ac1c5590 0x7f47ac0cc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46138/0 (socket says 172.21.15.22:46138) 2022-04-28T14:39:06.137 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.129 7f47a95ff700 1 -- 172.21.15.22:0/1277284470 learned_addr learned my addr 172.21.15.22:0/1277284470 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:06.137 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.130 7f47a95ff700 1 -- 172.21.15.22:0/1277284470 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f47ac1c4b10 msgr2=0x7f47ac1c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:06.137 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.130 7f47a95ff700 1 --2- 172.21.15.22:0/1277284470 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f47ac1c4b10 0x7f47ac1c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:06.137 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.130 7f47a95ff700 1 -- 172.21.15.22:0/1277284470 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47ac0cc6e0 msgr2=0x7f47ac0ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:06.138 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.130 7f47a95ff700 1 --2- 172.21.15.22:0/1277284470 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47ac0cc6e0 0x7f47ac0ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:06.138 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.130 7f47a95ff700 1 -- 172.21.15.22:0/1277284470 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ac0cdf20 con 0x7f47ac1c5590 2022-04-28T14:39:06.138 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.130 7f47aa601700 1 --2- 172.21.15.22:0/1277284470 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47ac0cc6e0 0x7f47ac0ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:06.138 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.130 7f47a9e00700 1 --2- 172.21.15.22:0/1277284470 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f47ac1c4b10 0x7f47ac1c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:06.138 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.130 7f47a95ff700 1 --2- 172.21.15.22:0/1277284470 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f47ac1c5590 0x7f47ac0cc0b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f47ac10bbe0 tx=0x7f47a00068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:06.138 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.130 7f479affd700 1 -- 172.21.15.22:0/1277284470 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f47ac0cdf20 con 0x7f47ac1c5590 2022-04-28T14:39:06.138 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.130 7f479affd700 1 -- 172.21.15.22:0/1277284470 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a0011760 con 0x7f47ac1c5590 2022-04-28T14:39:06.138 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.130 7f47b1106700 1 -- 172.21.15.22:0/1277284470 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47ac0da2a0 con 0x7f47ac1c5590 2022-04-28T14:39:06.138 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.130 7f479affd700 1 -- 172.21.15.22:0/1277284470 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f47a0022020 con 0x7f47ac1c5590 2022-04-28T14:39:06.139 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.130 7f47b1106700 1 -- 172.21.15.22:0/1277284470 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47ac0cd160 con 0x7f47ac1c5590 2022-04-28T14:39:06.139 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.131 7f479affd700 1 -- 172.21.15.22:0/1277284470 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f47a0011b30 con 0x7f47ac1c5590 2022-04-28T14:39:06.139 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.131 7f479affd700 1 -- 172.21.15.22:0/1277284470 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2407+0+0 (secure 0 0 0) 0x7f47a000ea50 con 0x7f47ac1c5590 2022-04-28T14:39:06.139 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.131 7f47b1106700 1 -- 172.21.15.22:0/1277284470 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47ac0f0390 con 0x7f47ac1c5590 2022-04-28T14:39:06.139 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.134 7f479affd700 1 -- 172.21.15.22:0/1277284470 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f47a0011550 con 0x7f47ac1c5590 2022-04-28T14:39:06.259 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.254 7f47b1106700 1 -- 172.21.15.22:0/1277284470 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47ac0a5b80 con 0x7f47ac1c5590 2022-04-28T14:39:06.260 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.255 7f479affd700 1 -- 172.21.15.22:0/1277284470 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+503 (secure 0 0 0) 0x7f47a0035210 con 0x7f47ac1c5590 2022-04-28T14:39:06.260 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:06.260 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[]} 2022-04-28T14:39:06.261 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.256 7f47b1106700 1 -- 172.21.15.22:0/1277284470 >> v1:172.21.15.22:6808/86956 conn(0x7f478801c1b0 legacy=0x7f478801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:06.261 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.256 7f47b1106700 1 -- 172.21.15.22:0/1277284470 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f47ac1c5590 msgr2=0x7f47ac0cc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:06.261 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.256 7f47b1106700 1 --2- 172.21.15.22:0/1277284470 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f47ac1c5590 0x7f47ac0cc0b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f47ac10bbe0 tx=0x7f47a00068c0).stop 2022-04-28T14:39:06.262 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.256 7f47b1106700 1 -- 172.21.15.22:0/1277284470 shutdown_connections 2022-04-28T14:39:06.262 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.256 7f47b1106700 1 --2- 172.21.15.22:0/1277284470 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47ac0cc6e0 0x7f47ac0ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:06.262 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.256 7f47b1106700 1 --2- 172.21.15.22:0/1277284470 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f47ac1c4b10 0x7f47ac1c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:06.262 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.256 7f47b1106700 1 --2- 172.21.15.22:0/1277284470 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f47ac1c5590 0x7f47ac0cc0b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:06.262 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.256 7f47b1106700 1 -- 172.21.15.22:0/1277284470 >> 172.21.15.22:0/1277284470 conn(0x7f47ac0d1560 msgr2=0x7f47ac0cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:06.262 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.256 7f47b1106700 1 -- 172.21.15.22:0/1277284470 shutdown_connections 2022-04-28T14:39:06.262 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:06.256 7f47b1106700 1 -- 172.21.15.22:0/1277284470 wait complete. 2022-04-28T14:39:06.263 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 1 2022-04-28T14:39:08.273 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-04-28T14:39:08.416 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.411 7f5d714c7700 1 Processor -- start 2022-04-28T14:39:08.416 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.411 7f5d714c7700 1 -- start start 2022-04-28T14:39:08.419 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.412 7f5d714c7700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5d6c0ff170 0x7f5d6c1b67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:08.419 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.412 7f5d714c7700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5d6c1b6de0 0x7f5d6c1b9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:08.419 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.412 7f5d714c7700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d6c0ab0b0 con 0x7f5d6c0f6390 2022-04-28T14:39:08.419 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.412 7f5d714c7700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c115dd0 con 0x7f5d6c1b6de0 2022-04-28T14:39:08.419 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.412 7f5d714c7700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c10b7d0 con 0x7f5d6c0ff170 2022-04-28T14:39:08.419 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.412 7f5d6aab2700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5d6c1b6de0 0x7f5d6c1b9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:08.419 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.412 7f5d6a2b1700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5d6c0f6390 0x7f5d6c0fe970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37972/0 (socket says 172.21.15.22:37972) 2022-04-28T14:39:08.420 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.412 7f5d6a2b1700 1 -- 172.21.15.22:0/2009272096 learned_addr learned my addr 172.21.15.22:0/2009272096 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:39:08.420 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.412 7f5d69ab0700 1 --2- 172.21.15.22:0/2009272096 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5d6c0ff170 0x7f5d6c1b67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:08.420 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.412 7f5d69ab0700 1 -- 172.21.15.22:0/2009272096 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5d6c1b6de0 msgr2=0x7f5d6c1b9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:08.420 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.412 7f5d692af700 1 -- 172.21.15.22:0/2009272096 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2843703757 0 0) 0x7f5d5c001110 con 0x7f5d6c0f6390 2022-04-28T14:39:08.420 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.412 7f5d69ab0700 1 --2- 172.21.15.22:0/2009272096 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5d6c1b6de0 0x7f5d6c1b9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:08.420 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.412 7f5d69ab0700 1 -- 172.21.15.22:0/2009272096 >> v1:172.21.15.22:6789/0 conn(0x7f5d6c0f6390 legacy=0x7f5d6c0fe970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:08.420 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.412 7f5d69ab0700 1 -- 172.21.15.22:0/2009272096 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c0f67e0 con 0x7f5d6c0ff170 2022-04-28T14:39:08.420 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.412 7f5d6aab2700 1 --2- 172.21.15.22:0/2009272096 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5d6c1b6de0 0x7f5d6c1b9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:08.420 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.413 7f5d69ab0700 1 --2- 172.21.15.22:0/2009272096 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5d6c0ff170 0x7f5d6c1b67b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f5d6c116180 tx=0x7f5d6000b9d0).ready entity=mon.2 client_cookie=a10c6f77eaa5116d server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:08.420 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.413 7f5d692af700 1 -- 172.21.15.22:0/2009272096 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5d6c0f67e0 con 0x7f5d6c0ff170 2022-04-28T14:39:08.421 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.413 7f5d692af700 1 -- 172.21.15.22:0/2009272096 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6000d570 con 0x7f5d6c0ff170 2022-04-28T14:39:08.421 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.413 7f5d692af700 1 -- 172.21.15.22:0/2009272096 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5d6000d940 con 0x7f5d6c0ff170 2022-04-28T14:39:08.421 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.413 7f5d714c7700 1 -- 172.21.15.22:0/2009272096 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5d6c0ff170 msgr2=0x7f5d6c1b67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:08.421 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.413 7f5d714c7700 1 --2- 172.21.15.22:0/2009272096 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5d6c0ff170 0x7f5d6c1b67b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f5d6c116180 tx=0x7f5d6000b9d0).stop 2022-04-28T14:39:08.421 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.413 7f5d714c7700 1 -- 172.21.15.22:0/2009272096 shutdown_connections 2022-04-28T14:39:08.421 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.413 7f5d714c7700 1 --2- 172.21.15.22:0/2009272096 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5d6c1b6de0 0x7f5d6c1b9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:08.421 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.413 7f5d714c7700 1 --2- 172.21.15.22:0/2009272096 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5d6c0ff170 0x7f5d6c1b67b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:08.421 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.414 7f5d714c7700 1 -- 172.21.15.22:0/2009272096 >> 172.21.15.22:0/2009272096 conn(0x7f5d6c117120 msgr2=0x7f5d6c0f2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:08.421 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.414 7f5d714c7700 1 -- 172.21.15.22:0/2009272096 shutdown_connections 2022-04-28T14:39:08.421 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.414 7f5d714c7700 1 -- 172.21.15.22:0/2009272096 wait complete. 2022-04-28T14:39:08.442 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.437 7f5d714c7700 1 Processor -- start 2022-04-28T14:39:08.442 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.437 7f5d714c7700 1 -- start start 2022-04-28T14:39:08.445 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.438 7f5d714c7700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5d6c0d13e0 0x7f5d6c0b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:08.445 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.438 7f5d714c7700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5d6c0b5410 0x7f5d6c1c3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:08.445 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.438 7f5d714c7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d6c1c3e40 0x7f5d6c0b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:08.445 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.438 7f5d714c7700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c0ef9c0 con 0x7f5d6c1c3e40 2022-04-28T14:39:08.445 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.438 7f5d714c7700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c0b4940 con 0x7f5d6c0d13e0 2022-04-28T14:39:08.445 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.438 7f5d714c7700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c0d1e10 con 0x7f5d6c0b5410 2022-04-28T14:39:08.445 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.438 7f5d69ab0700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5d6c0b5410 0x7f5d6c1c3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:08.446 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.438 7f5d6aab2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d6c1c3e40 0x7f5d6c0b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:08.446 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.438 7f5d69ab0700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5d6c0b5410 0x7f5d6c1c3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:45936/0 (socket says 172.21.15.22:45936) 2022-04-28T14:39:08.446 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.438 7f5d69ab0700 1 -- 172.21.15.22:0/2595778949 learned_addr learned my addr 172.21.15.22:0/2595778949 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:08.446 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.438 7f5d6a2b1700 1 --2- 172.21.15.22:0/2595778949 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5d6c0d13e0 0x7f5d6c0b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:08.446 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.438 7f5d69ab0700 1 -- 172.21.15.22:0/2595778949 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5d6c0d13e0 msgr2=0x7f5d6c0b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:08.446 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.438 7f5d69ab0700 1 --2- 172.21.15.22:0/2595778949 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5d6c0d13e0 0x7f5d6c0b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:08.446 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.438 7f5d69ab0700 1 -- 172.21.15.22:0/2595778949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d6c1c3e40 msgr2=0x7f5d6c0b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:08.446 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.438 7f5d69ab0700 1 --2- 172.21.15.22:0/2595778949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d6c1c3e40 0x7f5d6c0b5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:08.446 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.438 7f5d69ab0700 1 -- 172.21.15.22:0/2595778949 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c1c4290 con 0x7f5d6c0b5410 2022-04-28T14:39:08.446 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.438 7f5d6aab2700 1 --2- 172.21.15.22:0/2595778949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d6c1c3e40 0x7f5d6c0b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:08.447 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.439 7f5d69ab0700 1 --2- 172.21.15.22:0/2595778949 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5d6c0b5410 0x7f5d6c1c3810 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f5d6c116180 tx=0x7f5d600068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:08.447 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.439 7f5d5b7fe700 1 -- 172.21.15.22:0/2595778949 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5d6c1c4290 con 0x7f5d6c0b5410 2022-04-28T14:39:08.447 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.439 7f5d5b7fe700 1 -- 172.21.15.22:0/2595778949 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d60011760 con 0x7f5d6c0b5410 2022-04-28T14:39:08.447 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.439 7f5d714c7700 1 -- 172.21.15.22:0/2595778949 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d6c1c44f0 con 0x7f5d6c0b5410 2022-04-28T14:39:08.447 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.439 7f5d5b7fe700 1 -- 172.21.15.22:0/2595778949 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5d60011b30 con 0x7f5d6c0b5410 2022-04-28T14:39:08.447 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.439 7f5d714c7700 1 -- 172.21.15.22:0/2595778949 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6c0b64d0 con 0x7f5d6c0b5410 2022-04-28T14:39:08.447 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.439 7f5d5b7fe700 1 -- 172.21.15.22:0/2595778949 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f5d60027460 con 0x7f5d6c0b5410 2022-04-28T14:39:08.447 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.439 7f5d5b7fe700 1 -- 172.21.15.22:0/2595778949 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2407+0+0 (secure 0 0 0) 0x7f5d6000ea50 con 0x7f5d6c0b5410 2022-04-28T14:39:08.447 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.440 7f5d714c7700 1 -- 172.21.15.22:0/2595778949 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d6c0b5a30 con 0x7f5d6c0b5410 2022-04-28T14:39:08.448 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.443 7f5d5b7fe700 1 -- 172.21.15.22:0/2595778949 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f5d60011550 con 0x7f5d6c0b5410 2022-04-28T14:39:08.568 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.563 7f5d714c7700 1 -- 172.21.15.22:0/2595778949 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d6c0f02c0 con 0x7f5d6c0b5410 2022-04-28T14:39:08.568 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.564 7f5d5b7fe700 1 -- 172.21.15.22:0/2595778949 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+503 (secure 0 0 0) 0x7f5d60035210 con 0x7f5d6c0b5410 2022-04-28T14:39:08.569 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:08.569 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[]} 2022-04-28T14:39:08.570 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.565 7f5d714c7700 1 -- 172.21.15.22:0/2595778949 >> v1:172.21.15.22:6808/86956 conn(0x7f5d4801c1b0 legacy=0x7f5d4801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:08.570 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.565 7f5d714c7700 1 -- 172.21.15.22:0/2595778949 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5d6c0b5410 msgr2=0x7f5d6c1c3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:08.570 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.565 7f5d714c7700 1 --2- 172.21.15.22:0/2595778949 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5d6c0b5410 0x7f5d6c1c3810 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f5d6c116180 tx=0x7f5d600068c0).stop 2022-04-28T14:39:08.570 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.565 7f5d714c7700 1 -- 172.21.15.22:0/2595778949 shutdown_connections 2022-04-28T14:39:08.571 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.565 7f5d714c7700 1 --2- 172.21.15.22:0/2595778949 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d6c1c3e40 0x7f5d6c0b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:08.571 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.565 7f5d714c7700 1 --2- 172.21.15.22:0/2595778949 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5d6c0d13e0 0x7f5d6c0b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:08.571 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.565 7f5d714c7700 1 --2- 172.21.15.22:0/2595778949 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5d6c0b5410 0x7f5d6c1c3810 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:08.571 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.565 7f5d714c7700 1 -- 172.21.15.22:0/2595778949 >> 172.21.15.22:0/2595778949 conn(0x7f5d6c0e0b10 msgr2=0x7f5d6c0f1320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:08.571 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.565 7f5d714c7700 1 -- 172.21.15.22:0/2595778949 shutdown_connections 2022-04-28T14:39:08.571 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:08.565 7f5d714c7700 1 -- 172.21.15.22:0/2595778949 wait complete. 2022-04-28T14:39:08.572 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 1 2022-04-28T14:39:10.582 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-04-28T14:39:10.722 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.714 7f5f4d709700 1 Processor -- start 2022-04-28T14:39:10.722 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.715 7f5f4d709700 1 -- start start 2022-04-28T14:39:10.722 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.715 7f5f4d709700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5f480fcf10 0x7f5f481b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:10.722 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.715 7f5f4d709700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5f481ba300 0x7f5f481bc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:10.722 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.715 7f5f4d709700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f480ab0b0 con 0x7f5f480f6df0 2022-04-28T14:39:10.722 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.715 7f5f4d709700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f4810f4b0 con 0x7f5f481ba300 2022-04-28T14:39:10.722 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.715 7f5f4d709700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f480f7240 con 0x7f5f480fcf10 2022-04-28T14:39:10.723 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.715 7f5f464ec700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5f480f6df0 0x7f5f480fc710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37992/0 (socket says 172.21.15.22:37992) 2022-04-28T14:39:10.723 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.715 7f5f464ec700 1 -- 172.21.15.22:0/420582844 learned_addr learned my addr 172.21.15.22:0/420582844 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:39:10.723 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.715 7f5f45ceb700 1 --2- 172.21.15.22:0/420582844 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5f480fcf10 0x7f5f481b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:10.723 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.715 7f5f46ced700 1 --2- 172.21.15.22:0/420582844 >> v2:172.21.15.22:3300/0 conn(0x7f5f481ba300 0x7f5f481bc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:10.723 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.716 7f5f454ea700 1 -- 172.21.15.22:0/420582844 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 685148496 0 0) 0x7f5f38001110 con 0x7f5f480f6df0 2022-04-28T14:39:10.723 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.716 7f5f454ea700 1 -- 172.21.15.22:0/420582844 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f28003270 con 0x7f5f480f6df0 2022-04-28T14:39:10.723 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.716 7f5f45ceb700 1 -- 172.21.15.22:0/420582844 >> v2:172.21.15.22:3300/0 conn(0x7f5f481ba300 msgr2=0x7f5f481bc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:10.723 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.716 7f5f45ceb700 1 --2- 172.21.15.22:0/420582844 >> v2:172.21.15.22:3300/0 conn(0x7f5f481ba300 0x7f5f481bc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:10.723 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.716 7f5f45ceb700 1 -- 172.21.15.22:0/420582844 >> v1:172.21.15.22:6789/0 conn(0x7f5f480f6df0 legacy=0x7f5f480fc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:10.723 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.716 7f5f45ceb700 1 -- 172.21.15.22:0/420582844 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f48126710 con 0x7f5f480fcf10 2022-04-28T14:39:10.724 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.716 7f5f46ced700 1 --2- 172.21.15.22:0/420582844 >> v2:172.21.15.22:3300/0 conn(0x7f5f481ba300 0x7f5f481bc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:10.724 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.716 7f5f45ceb700 1 --2- 172.21.15.22:0/420582844 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5f480fcf10 0x7f5f481b9cd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f5f30002f70 tx=0x7f5f3000b970).ready entity=mon.1 client_cookie=c843955d78fb6370 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:10.724 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.716 7f5f454ea700 1 -- 172.21.15.22:0/420582844 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5f48126710 con 0x7f5f480fcf10 2022-04-28T14:39:10.724 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.716 7f5f454ea700 1 -- 172.21.15.22:0/420582844 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3000d5c0 con 0x7f5f480fcf10 2022-04-28T14:39:10.724 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.716 7f5f454ea700 1 -- 172.21.15.22:0/420582844 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5f3000d990 con 0x7f5f480fcf10 2022-04-28T14:39:10.724 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.716 7f5f4d709700 1 -- 172.21.15.22:0/420582844 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5f480fcf10 msgr2=0x7f5f481b9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:10.724 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.716 7f5f4d709700 1 --2- 172.21.15.22:0/420582844 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5f480fcf10 0x7f5f481b9cd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f5f30002f70 tx=0x7f5f3000b970).stop 2022-04-28T14:39:10.724 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.717 7f5f4d709700 1 -- 172.21.15.22:0/420582844 shutdown_connections 2022-04-28T14:39:10.724 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.717 7f5f4d709700 1 --2- 172.21.15.22:0/420582844 >> v2:172.21.15.22:3300/0 conn(0x7f5f481ba300 0x7f5f481bc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:10.725 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.717 7f5f4d709700 1 --2- 172.21.15.22:0/420582844 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5f480fcf10 0x7f5f481b9cd0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:10.725 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.717 7f5f4d709700 1 -- 172.21.15.22:0/420582844 >> 172.21.15.22:0/420582844 conn(0x7f5f481181d0 msgr2=0x7f5f48125870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:10.725 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.717 7f5f4d709700 1 -- 172.21.15.22:0/420582844 shutdown_connections 2022-04-28T14:39:10.725 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.717 7f5f4d709700 1 -- 172.21.15.22:0/420582844 wait complete. 2022-04-28T14:39:10.747 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.740 7f5f4d709700 1 Processor -- start 2022-04-28T14:39:10.747 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.741 7f5f4d709700 1 -- start start 2022-04-28T14:39:10.748 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.741 7f5f4d709700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f480b5280 0x7f5f481c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:10.748 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.741 7f5f4d709700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5f481c4e40 0x7f5f481c5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:10.748 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.741 7f5f4d709700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5f481c58c0 0x7f5f481c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:10.748 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.741 7f5f4d709700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f480cb9b0 con 0x7f5f480b5280 2022-04-28T14:39:10.748 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.741 7f5f4d709700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f481b4140 con 0x7f5f481c4e40 2022-04-28T14:39:10.748 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.741 7f5f4d709700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f481b3e00 con 0x7f5f481c58c0 2022-04-28T14:39:10.748 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.741 7f5f464ec700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f480b5280 0x7f5f481c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:10.748 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.741 7f5f45ceb700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5f481c4e40 0x7f5f481c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:10.748 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.741 7f5f464ec700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f480b5280 0x7f5f481c4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48602/0 (socket says 172.21.15.22:48602) 2022-04-28T14:39:10.749 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.741 7f5f464ec700 1 -- 172.21.15.22:0/3901315222 learned_addr learned my addr 172.21.15.22:0/3901315222 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:10.749 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.741 7f5f46ced700 1 --2- 172.21.15.22:0/3901315222 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5f481c58c0 0x7f5f481c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:10.749 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.741 7f5f464ec700 1 -- 172.21.15.22:0/3901315222 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5f481c58c0 msgr2=0x7f5f481c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:10.749 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.741 7f5f464ec700 1 --2- 172.21.15.22:0/3901315222 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5f481c58c0 0x7f5f481c5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:10.749 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.741 7f5f464ec700 1 -- 172.21.15.22:0/3901315222 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5f481c4e40 msgr2=0x7f5f481c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:10.749 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.741 7f5f464ec700 1 --2- 172.21.15.22:0/3901315222 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5f481c4e40 0x7f5f481c5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:10.749 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.741 7f5f464ec700 1 -- 172.21.15.22:0/3901315222 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f481c6340 con 0x7f5f480b5280 2022-04-28T14:39:10.749 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.741 7f5f45ceb700 1 --2- 172.21.15.22:0/3901315222 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5f481c4e40 0x7f5f481c5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:10.750 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.741 7f5f46ced700 1 --2- 172.21.15.22:0/3901315222 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5f481c58c0 0x7f5f481c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:10.750 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.742 7f5f464ec700 1 --2- 172.21.15.22:0/3901315222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f480b5280 0x7f5f481c4810 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f5f38000bc0 tx=0x7f5f3800c7e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:10.750 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.742 7f5f3f7fe700 1 -- 172.21.15.22:0/3901315222 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5f481c6340 con 0x7f5f480b5280 2022-04-28T14:39:10.750 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.742 7f5f3f7fe700 1 -- 172.21.15.22:0/3901315222 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f380072e0 con 0x7f5f480b5280 2022-04-28T14:39:10.750 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.742 7f5f4d709700 1 -- 172.21.15.22:0/3901315222 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f480cb6b0 con 0x7f5f480b5280 2022-04-28T14:39:10.750 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.742 7f5f3f7fe700 1 -- 172.21.15.22:0/3901315222 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5f38005810 con 0x7f5f480b5280 2022-04-28T14:39:10.750 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.742 7f5f4d709700 1 -- 172.21.15.22:0/3901315222 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f481b6a60 con 0x7f5f480b5280 2022-04-28T14:39:10.750 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.742 7f5f3f7fe700 1 -- 172.21.15.22:0/3901315222 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f5f38005a10 con 0x7f5f480b5280 2022-04-28T14:39:10.751 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.742 7f5f3f7fe700 1 -- 172.21.15.22:0/3901315222 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2407+0+0 (secure 0 0 0) 0x7f5f380287c0 con 0x7f5f480b5280 2022-04-28T14:39:10.751 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.743 7f5f4d709700 1 -- 172.21.15.22:0/3901315222 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f480eeaa0 con 0x7f5f480b5280 2022-04-28T14:39:10.751 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.746 7f5f3f7fe700 1 -- 172.21.15.22:0/3901315222 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f5f380070d0 con 0x7f5f480b5280 2022-04-28T14:39:10.871 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.866 7f5f4d709700 1 -- 172.21.15.22:0/3901315222 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f480cdb10 con 0x7f5f480b5280 2022-04-28T14:39:10.871 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.866 7f5f3f7fe700 1 -- 172.21.15.22:0/3901315222 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1326 (secure 0 0 0) 0x7f5f481159c0 con 0x7f5f480b5280 2022-04-28T14:39:10.871 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:10.871 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4184,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.22:6819/356491488","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6819","nonce":356491488}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":2},{"gid":4198,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.22:6817/401565232","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6817","nonce":401565232}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3},{"gid":4201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.22:6818/2291514211","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6818","nonce":2291514211}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[]} 2022-04-28T14:39:10.872 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.867 7f5f4d709700 1 -- 172.21.15.22:0/3901315222 >> v1:172.21.15.22:6808/86956 conn(0x7f5f2c01c1b0 legacy=0x7f5f2c01e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:10.872 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.867 7f5f4d709700 1 -- 172.21.15.22:0/3901315222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f480b5280 msgr2=0x7f5f481c4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:10.873 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.867 7f5f4d709700 1 --2- 172.21.15.22:0/3901315222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f480b5280 0x7f5f481c4810 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f5f38000bc0 tx=0x7f5f3800c7e0).stop 2022-04-28T14:39:10.873 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.867 7f5f4d709700 1 -- 172.21.15.22:0/3901315222 shutdown_connections 2022-04-28T14:39:10.873 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.867 7f5f4d709700 1 --2- 172.21.15.22:0/3901315222 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5f481c58c0 0x7f5f481c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:10.873 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.867 7f5f4d709700 1 --2- 172.21.15.22:0/3901315222 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f480b5280 0x7f5f481c4810 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:10.873 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.867 7f5f4d709700 1 --2- 172.21.15.22:0/3901315222 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5f481c4e40 0x7f5f481c5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:10.873 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.867 7f5f4d709700 1 -- 172.21.15.22:0/3901315222 >> 172.21.15.22:0/3901315222 conn(0x7f5f480b6fd0 msgr2=0x7f5f481b8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:10.873 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.867 7f5f4d709700 1 -- 172.21.15.22:0/3901315222 shutdown_connections 2022-04-28T14:39:10.873 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:10.867 7f5f4d709700 1 -- 172.21.15.22:0/3901315222 wait complete. 2022-04-28T14:39:10.874 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 3 2022-04-28T14:39:10.883 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-28T14:39:11.015 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.007 7f9bb8efa700 1 Processor -- start 2022-04-28T14:39:11.015 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.007 7f9bb8efa700 1 -- start start 2022-04-28T14:39:11.015 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.008 7f9bb8efa700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9bb40f6210 0x7f9bb40f1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:11.015 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.008 7f9bb8efa700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9bb40f18a0 0x7f9bb41b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:11.015 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.008 7f9bb8efa700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9bb40f1cf0 0x7f9bb41b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:11.015 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.008 7f9bb8efa700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb410ebe0 con 0x7f9bb40f18a0 2022-04-28T14:39:11.016 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.008 7f9bb8efa700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb4116e40 con 0x7f9bb40f1cf0 2022-04-28T14:39:11.016 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.008 7f9bb8efa700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb40f6660 con 0x7f9bb40f6210 2022-04-28T14:39:11.016 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.008 7f9bb1b64700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9bb40f6210 0x7f9bb40f1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:11.016 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.008 7f9bb2365700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9bb40f1cf0 0x7f9bb41b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:11.016 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.008 7f9bb1363700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9bb40f18a0 0x7f9bb41b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:11.016 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.008 7f9bb1b64700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9bb40f6210 0x7f9bb40f1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:45962/0 (socket says 172.21.15.22:45962) 2022-04-28T14:39:11.016 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.008 7f9bb1b64700 1 -- 172.21.15.22:0/2402051064 learned_addr learned my addr 172.21.15.22:0/2402051064 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:11.017 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.008 7f9bb1363700 1 -- 172.21.15.22:0/2402051064 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9bb40f6210 msgr2=0x7f9bb40f1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:11.017 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.008 7f9bb1363700 1 --2- 172.21.15.22:0/2402051064 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9bb40f6210 0x7f9bb40f1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.017 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.008 7f9bb1363700 1 -- 172.21.15.22:0/2402051064 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9bb40f1cf0 msgr2=0x7f9bb41b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:11.017 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.008 7f9bb1363700 1 --2- 172.21.15.22:0/2402051064 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9bb40f1cf0 0x7f9bb41b4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.017 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.008 7f9bb1363700 1 -- 172.21.15.22:0/2402051064 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb41b5250 con 0x7f9bb40f18a0 2022-04-28T14:39:11.017 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.008 7f9bb1b64700 1 --2- 172.21.15.22:0/2402051064 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9bb40f6210 0x7f9bb40f1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:11.017 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.009 7f9bb1363700 1 --2- 172.21.15.22:0/2402051064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9bb40f18a0 0x7f9bb41b45f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f9ba4002f70 tx=0x7f9ba400b9f0).ready entity=mon.0 client_cookie=61661e3b68fe9a34 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:11.017 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.009 7f9bb0b62700 1 -- 172.21.15.22:0/2402051064 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9bb41b5250 con 0x7f9bb40f18a0 2022-04-28T14:39:11.018 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.009 7f9bb0b62700 1 -- 172.21.15.22:0/2402051064 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba400d570 con 0x7f9bb40f18a0 2022-04-28T14:39:11.018 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.009 7f9bb0b62700 1 -- 172.21.15.22:0/2402051064 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9ba400d940 con 0x7f9bb40f18a0 2022-04-28T14:39:11.018 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.009 7f9bb8efa700 1 -- 172.21.15.22:0/2402051064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9bb40f18a0 msgr2=0x7f9bb41b45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:11.018 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.009 7f9bb8efa700 1 --2- 172.21.15.22:0/2402051064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9bb40f18a0 0x7f9bb41b45f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f9ba4002f70 tx=0x7f9ba400b9f0).stop 2022-04-28T14:39:11.018 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.009 7f9bb8efa700 1 -- 172.21.15.22:0/2402051064 shutdown_connections 2022-04-28T14:39:11.018 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.009 7f9bb8efa700 1 --2- 172.21.15.22:0/2402051064 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9bb40f1cf0 0x7f9bb41b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.018 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.009 7f9bb8efa700 1 --2- 172.21.15.22:0/2402051064 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9bb40f6210 0x7f9bb40f1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.019 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.009 7f9bb8efa700 1 --2- 172.21.15.22:0/2402051064 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9bb40f18a0 0x7f9bb41b45f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.019 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.009 7f9bb8efa700 1 -- 172.21.15.22:0/2402051064 >> 172.21.15.22:0/2402051064 conn(0x7f9bb4117120 msgr2=0x7f9bb40f2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:11.019 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.009 7f9bb8efa700 1 -- 172.21.15.22:0/2402051064 shutdown_connections 2022-04-28T14:39:11.019 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.009 7f9bb8efa700 1 -- 172.21.15.22:0/2402051064 wait complete. 2022-04-28T14:39:11.038 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.033 7f9bb8efa700 1 Processor -- start 2022-04-28T14:39:11.038 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.033 7f9bb8efa700 1 -- start start 2022-04-28T14:39:11.040 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.034 7f9bb8efa700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9bb40df850 0x7f9bb40d0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:11.041 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.034 7f9bb8efa700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9bb40d1300 0x7f9bb41c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:11.041 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.034 7f9bb8efa700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9bb40d1750 0x7f9bb41c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:11.041 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.034 7f9bb8efa700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb4116ba0 con 0x7f9bb40d1750 2022-04-28T14:39:11.041 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.034 7f9bb8efa700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb40e00b0 con 0x7f9bb40df850 2022-04-28T14:39:11.041 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.034 7f9bb8efa700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb41bc630 con 0x7f9bb40d1300 2022-04-28T14:39:11.041 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.034 7f9bb1b64700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9bb40df850 0x7f9bb40d0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:11.041 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.034 7f9bb2365700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9bb40d1750 0x7f9bb41c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:11.041 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.034 7f9bb1363700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9bb40d1300 0x7f9bb41c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:11.042 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.034 7f9bb2365700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9bb40d1750 0x7f9bb41c9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48620/0 (socket says 172.21.15.22:48620) 2022-04-28T14:39:11.042 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.034 7f9bb2365700 1 -- 172.21.15.22:0/1736374859 learned_addr learned my addr 172.21.15.22:0/1736374859 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:11.042 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.034 7f9bb1b64700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9bb40df850 0x7f9bb40d0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46184/0 (socket says 172.21.15.22:46184) 2022-04-28T14:39:11.042 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.034 7f9bb1b64700 1 -- 172.21.15.22:0/1736374859 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9bb40d1300 msgr2=0x7f9bb41c9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:11.042 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.034 7f9bb1b64700 1 --2- 172.21.15.22:0/1736374859 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9bb40d1300 0x7f9bb41c9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.042 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.034 7f9bb1b64700 1 -- 172.21.15.22:0/1736374859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9bb40d1750 msgr2=0x7f9bb41c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:11.042 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.034 7f9bb1b64700 1 --2- 172.21.15.22:0/1736374859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9bb40d1750 0x7f9bb41c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.042 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.034 7f9bb1b64700 1 -- 172.21.15.22:0/1736374859 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb41bc9f0 con 0x7f9bb40df850 2022-04-28T14:39:11.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.034 7f9bb2365700 1 --2- 172.21.15.22:0/1736374859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9bb40d1750 0x7f9bb41c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:11.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.034 7f9bb1363700 1 --2- 172.21.15.22:0/1736374859 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9bb40d1300 0x7f9bb41c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:11.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.034 7f9bb1b64700 1 --2- 172.21.15.22:0/1736374859 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9bb40df850 0x7f9bb40d0cd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f9bb410f0f0 tx=0x7f9b9c009f70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:11.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.034 7f9baaffd700 1 -- 172.21.15.22:0/1736374859 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9bb41bc9f0 con 0x7f9bb40df850 2022-04-28T14:39:11.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.034 7f9baaffd700 1 -- 172.21.15.22:0/1736374859 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9c012600 con 0x7f9bb40df850 2022-04-28T14:39:11.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.034 7f9bb8efa700 1 -- 172.21.15.22:0/1736374859 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb40b47e0 con 0x7f9bb40df850 2022-04-28T14:39:11.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.034 7f9baaffd700 1 -- 172.21.15.22:0/1736374859 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9b9c00f040 con 0x7f9bb40df850 2022-04-28T14:39:11.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.035 7f9bb8efa700 1 -- 172.21.15.22:0/1736374859 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb41bbe90 con 0x7f9bb40df850 2022-04-28T14:39:11.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.035 7f9baaffd700 1 -- 172.21.15.22:0/1736374859 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f9b9c011070 con 0x7f9bb40df850 2022-04-28T14:39:11.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.035 7f9baaffd700 1 -- 172.21.15.22:0/1736374859 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2407+0+0 (secure 0 0 0) 0x7f9b9c010040 con 0x7f9bb40df850 2022-04-28T14:39:11.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.036 7f9bb8efa700 1 -- 172.21.15.22:0/1736374859 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb40f02c0 con 0x7f9bb40df850 2022-04-28T14:39:11.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.038 7f9baaffd700 1 -- 172.21.15.22:0/1736374859 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f9b9c0123f0 con 0x7f9bb40df850 2022-04-28T14:39:11.140 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.136 7f9bb8efa700 1 -- 172.21.15.22:0/1736374859 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9bb40a5b80 con 0x7f9bb40df850 2022-04-28T14:39:11.141 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.136 7f9baaffd700 1 -- 172.21.15.22:0/1736374859 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+5903 (secure 0 0 0) 0x7f9b9c000c30 con 0x7f9bb40df850 2022-04-28T14:39:11.141 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:11.142 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":12,"fsid":"3047163a-0285-4058-8e05-ce74c6fbb9c5","created":"2022-04-28 14:38:54.232890","modified":"2022-04-28 14:39:06.388200","last_up_change":"2022-04-28 14:39:00.269721","last_in_change":"2022-04-28 14:39:00.269721","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-04-28 14:39:03.639717","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"782ee638-1ada-48d9-9454-f9e0ca8a3135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6800","nonce":87556}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":87556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":87556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":87556}]},"public_addr":"172.21.15.22:6800/87556","cluster_addr":"172.21.15.22:6801/87556","heartbeat_back_addr":"172.21.15.22:6803/87556","heartbeat_front_addr":"172.21.15.22:6802/87556","state":["exists","up"]},{"osd":1,"uuid":"61ca6f96-fb4f-4c0f-b68b-edf1e7011f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":87557}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":87557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":87557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":87557}]},"public_addr":"172.21.15.22:6804/87557","cluster_addr":"172.21.15.22:6805/87557","heartbeat_back_addr":"172.21.15.22:6807/87557","heartbeat_front_addr":"172.21.15.22:6806/87557","state":["exists","up"]},{"osd":2,"uuid":"4b3043b9-50df-4b7f-a55a-ac8e6148c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":87558}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":87558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":87558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":87558}]},"public_addr":"172.21.15.22:6813/87558","cluster_addr":"172.21.15.22:6814/87558","heartbeat_back_addr":"172.21.15.22:6816/87558","heartbeat_front_addr":"172.21.15.22:6815/87558","state":["exists","up"]},{"osd":3,"uuid":"7807bcd1-53f8-44b5-9992-57c328e5b299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":87561}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":87561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":87561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":87561}]},"public_addr":"172.21.15.22:6809/87561","cluster_addr":"172.21.15.22:6810/87561","heartbeat_back_addr":"172.21.15.22:6812/87561","heartbeat_front_addr":"172.21.15.22:6811/87561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-04-28T14:39:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.137 7f9bb8efa700 1 -- 172.21.15.22:0/1736374859 >> v1:172.21.15.22:6808/86956 conn(0x7f9b9801c1b0 legacy=0x7f9b9801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.137 7f9bb8efa700 1 -- 172.21.15.22:0/1736374859 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9bb40df850 msgr2=0x7f9bb40d0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.137 7f9bb8efa700 1 --2- 172.21.15.22:0/1736374859 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9bb40df850 0x7f9bb40d0cd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f9bb410f0f0 tx=0x7f9b9c009f70).stop 2022-04-28T14:39:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.137 7f9bb8efa700 1 -- 172.21.15.22:0/1736374859 shutdown_connections 2022-04-28T14:39:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.137 7f9bb8efa700 1 --2- 172.21.15.22:0/1736374859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9bb40d1750 0x7f9bb41c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.137 7f9bb8efa700 1 --2- 172.21.15.22:0/1736374859 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9bb40df850 0x7f9bb40d0cd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.137 7f9bb8efa700 1 --2- 172.21.15.22:0/1736374859 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9bb40d1300 0x7f9bb41c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.137 7f9bb8efa700 1 -- 172.21.15.22:0/1736374859 >> 172.21.15.22:0/1736374859 conn(0x7f9bb40e0b10 msgr2=0x7f9bb40ad390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:11.143 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.138 7f9bb8efa700 1 -- 172.21.15.22:0/1736374859 shutdown_connections 2022-04-28T14:39:11.144 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.138 7f9bb8efa700 1 -- 172.21.15.22:0/1736374859 wait complete. 2022-04-28T14:39:11.153 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2022-04-28 14:39:03.639717', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-04-28T14:39:11.153 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-04-28T14:39:11.287 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.281 7f069f437700 1 Processor -- start 2022-04-28T14:39:11.288 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.281 7f069f437700 1 -- start start 2022-04-28T14:39:11.288 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.281 7f069f437700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f06980f1a40 0x7f06981b9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:11.288 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.281 7f069f437700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f06981b9f40 0x7f06981bc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:11.288 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.281 7f069f437700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06980ab080 con 0x7f06980f61e0 2022-04-28T14:39:11.288 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.281 7f069f437700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069810ebb0 con 0x7f06981b9f40 2022-04-28T14:39:11.288 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.281 7f069f437700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0698116e10 con 0x7f06980f1a40 2022-04-28T14:39:11.288 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.281 7f0697fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f06980f61e0 0x7f06980f1240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38020/0 (socket says 172.21.15.22:38020) 2022-04-28T14:39:11.288 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.281 7f069ca37700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f06981b9f40 0x7f06981bc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:11.288 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.281 7f0697fff700 1 -- 172.21.15.22:0/3073744111 learned_addr learned my addr 172.21.15.22:0/3073744111 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:39:11.289 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.281 7f068ffff700 1 --2- 172.21.15.22:0/3073744111 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f06980f1a40 0x7f06981b9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:11.289 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.282 7f069ca37700 1 -- 172.21.15.22:0/3073744111 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f06980f1a40 msgr2=0x7f06981b9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:11.289 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.281 7f06977fe700 1 -- 172.21.15.22:0/3073744111 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 241716718 0 0) 0x7f0688001110 con 0x7f06980f61e0 2022-04-28T14:39:11.289 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.282 7f069ca37700 1 --2- 172.21.15.22:0/3073744111 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f06980f1a40 0x7f06981b9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.289 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.282 7f069ca37700 1 -- 172.21.15.22:0/3073744111 >> v1:172.21.15.22:6789/0 conn(0x7f06980f61e0 legacy=0x7f06980f1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:11.289 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.282 7f069ca37700 1 -- 172.21.15.22:0/3073744111 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06980f6630 con 0x7f06981b9f40 2022-04-28T14:39:11.289 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.282 7f069ca37700 1 --2- 172.21.15.22:0/3073744111 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f06981b9f40 0x7f06981bc3a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f06900032f0 tx=0x7f0690009d40).ready entity=mon.1 client_cookie=14b58797e0dc50d5 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:11.289 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.282 7f06977fe700 1 -- 172.21.15.22:0/3073744111 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f06980f6630 con 0x7f06981b9f40 2022-04-28T14:39:11.290 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.282 7f06977fe700 1 -- 172.21.15.22:0/3073744111 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069000b800 con 0x7f06981b9f40 2022-04-28T14:39:11.290 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.282 7f06977fe700 1 -- 172.21.15.22:0/3073744111 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f069000b9e0 con 0x7f06981b9f40 2022-04-28T14:39:11.290 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.282 7f069f437700 1 -- 172.21.15.22:0/3073744111 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f06981b9f40 msgr2=0x7f06981bc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:11.290 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.282 7f069f437700 1 --2- 172.21.15.22:0/3073744111 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f06981b9f40 0x7f06981bc3a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f06900032f0 tx=0x7f0690009d40).stop 2022-04-28T14:39:11.290 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.283 7f069f437700 1 -- 172.21.15.22:0/3073744111 shutdown_connections 2022-04-28T14:39:11.290 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.283 7f069f437700 1 --2- 172.21.15.22:0/3073744111 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f06981b9f40 0x7f06981bc3a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.290 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.283 7f069f437700 1 --2- 172.21.15.22:0/3073744111 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f06980f1a40 0x7f06981b9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.290 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.283 7f069f437700 1 -- 172.21.15.22:0/3073744111 >> 172.21.15.22:0/3073744111 conn(0x7f06981170f0 msgr2=0x7f06980f2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:11.290 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.283 7f069f437700 1 -- 172.21.15.22:0/3073744111 shutdown_connections 2022-04-28T14:39:11.291 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.283 7f069f437700 1 -- 172.21.15.22:0/3073744111 wait complete. 2022-04-28T14:39:11.311 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.306 7f069f437700 1 Processor -- start 2022-04-28T14:39:11.311 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.306 7f069f437700 1 -- start start 2022-04-28T14:39:11.313 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.307 7f069f437700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f06980b1750 0x7f06980d2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:11.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.307 7f069f437700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06980b1ba0 0x7f06981c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:11.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.307 7f069f437700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f06980d2880 0x7f06981c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:11.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.307 7f069f437700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0698115c90 con 0x7f06980b1ba0 2022-04-28T14:39:11.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.307 7f069f437700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06980b0f70 con 0x7f06980b1750 2022-04-28T14:39:11.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.307 7f069f437700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06981bc270 con 0x7f06980d2880 2022-04-28T14:39:11.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.307 7f0697fff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f06980b1750 0x7f06980d2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:11.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.307 7f068ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06980b1ba0 0x7f06981c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:11.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.307 7f069ca37700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f06980d2880 0x7f06981c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:11.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.307 7f0697fff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f06980b1750 0x7f06980d2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46198/0 (socket says 172.21.15.22:46198) 2022-04-28T14:39:11.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.307 7f068ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06980b1ba0 0x7f06981c9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48632/0 (socket says 172.21.15.22:48632) 2022-04-28T14:39:11.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.307 7f0697fff700 1 -- 172.21.15.22:0/6788515 learned_addr learned my addr 172.21.15.22:0/6788515 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:11.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.307 7f0697fff700 1 -- 172.21.15.22:0/6788515 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f06980d2880 msgr2=0x7f06981c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:11.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.307 7f0697fff700 1 --2- 172.21.15.22:0/6788515 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f06980d2880 0x7f06981c9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.307 7f0697fff700 1 -- 172.21.15.22:0/6788515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06980b1ba0 msgr2=0x7f06981c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:11.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.307 7f0697fff700 1 --2- 172.21.15.22:0/6788515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06980b1ba0 0x7f06981c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.307 7f0697fff700 1 -- 172.21.15.22:0/6788515 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06981bc6d0 con 0x7f06980b1750 2022-04-28T14:39:11.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.307 7f069ca37700 1 --2- 172.21.15.22:0/6788515 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f06980d2880 0x7f06981c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:11.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.307 7f0697fff700 1 --2- 172.21.15.22:0/6788515 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f06980b1750 0x7f06980d2250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f0688000bc0 tx=0x7f068800c830).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:11.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.308 7f0695ffb700 1 -- 172.21.15.22:0/6788515 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f06981bc6d0 con 0x7f06980b1750 2022-04-28T14:39:11.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.308 7f0695ffb700 1 -- 172.21.15.22:0/6788515 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06880072e0 con 0x7f06980b1750 2022-04-28T14:39:11.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.308 7f069f437700 1 -- 172.21.15.22:0/6788515 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06981bca90 con 0x7f06980b1750 2022-04-28T14:39:11.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.308 7f0695ffb700 1 -- 172.21.15.22:0/6788515 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0688005810 con 0x7f06980b1750 2022-04-28T14:39:11.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.308 7f069f437700 1 -- 172.21.15.22:0/6788515 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06981ca5b0 con 0x7f06980b1750 2022-04-28T14:39:11.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.308 7f0695ffb700 1 -- 172.21.15.22:0/6788515 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f0688005a10 con 0x7f06980b1750 2022-04-28T14:39:11.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.308 7f0695ffb700 1 -- 172.21.15.22:0/6788515 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2407+0+0 (secure 0 0 0) 0x7f06880287c0 con 0x7f06980b1750 2022-04-28T14:39:11.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.309 7f069f437700 1 -- 172.21.15.22:0/6788515 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06980f0290 con 0x7f06980b1750 2022-04-28T14:39:11.317 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.312 7f0695ffb700 1 -- 172.21.15.22:0/6788515 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f06880070d0 con 0x7f06980b1750 2022-04-28T14:39:11.413 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.408 7f069f437700 1 -- 172.21.15.22:0/6788515 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f06980a5b50 con 0x7f06980b1750 2022-04-28T14:39:11.413 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.409 7f0695ffb700 1 -- 172.21.15.22:0/6788515 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v12) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0688000c30 con 0x7f06980b1750 2022-04-28T14:39:11.414 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2022-04-28T14:39:11.415 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.410 7f069f437700 1 -- 172.21.15.22:0/6788515 >> v1:172.21.15.22:6808/86956 conn(0x7f067c01c1b0 legacy=0x7f067c01e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:11.415 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.410 7f069f437700 1 -- 172.21.15.22:0/6788515 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f06980b1750 msgr2=0x7f06980d2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:11.415 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.410 7f069f437700 1 --2- 172.21.15.22:0/6788515 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f06980b1750 0x7f06980d2250 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f0688000bc0 tx=0x7f068800c830).stop 2022-04-28T14:39:11.415 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.410 7f069f437700 1 -- 172.21.15.22:0/6788515 shutdown_connections 2022-04-28T14:39:11.415 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.410 7f069f437700 1 --2- 172.21.15.22:0/6788515 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f06980d2880 0x7f06981c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.415 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.410 7f069f437700 1 --2- 172.21.15.22:0/6788515 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f06980b1750 0x7f06980d2250 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.415 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.410 7f069f437700 1 --2- 172.21.15.22:0/6788515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06980b1ba0 0x7f06981c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.415 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.410 7f069f437700 1 -- 172.21.15.22:0/6788515 >> 172.21.15.22:0/6788515 conn(0x7f06980acf30 msgr2=0x7f0698124e80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:11.416 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.410 7f069f437700 1 -- 172.21.15.22:0/6788515 shutdown_connections 2022-04-28T14:39:11.416 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.410 7f069f437700 1 -- 172.21.15.22:0/6788515 wait complete. 2022-04-28T14:39:11.425 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-04-28T14:39:11.557 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.549 7f5056e36700 1 Processor -- start 2022-04-28T14:39:11.557 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.549 7f5056e36700 1 -- start start 2022-04-28T14:39:11.557 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.550 7f5056e36700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f50500f6300 0x7f50500f1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:11.557 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.550 7f5056e36700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f50500f1970 0x7f50501b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:11.557 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.550 7f5056e36700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f50500f1dc0 0x7f50501b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:11.557 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.550 7f5056e36700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f505010ecb0 con 0x7f50500f1dc0 2022-04-28T14:39:11.557 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.550 7f5056e36700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505010f240 con 0x7f50500f6300 2022-04-28T14:39:11.557 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.550 7f5056e36700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50501151f0 con 0x7f50500f1970 2022-04-28T14:39:11.558 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.550 7f504ffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f50500f1dc0 0x7f50501b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:11.558 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.550 7f504effd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f50500f1970 0x7f50501b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:11.558 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.550 7f504f7fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f50500f6300 0x7f50500f1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:11.558 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.550 7f504effd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f50500f1970 0x7f50501b46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:45990/0 (socket says 172.21.15.22:45990) 2022-04-28T14:39:11.558 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.550 7f504ffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f50500f1dc0 0x7f50501b4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48642/0 (socket says 172.21.15.22:48642) 2022-04-28T14:39:11.558 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.550 7f504effd700 1 -- 172.21.15.22:0/4026929104 learned_addr learned my addr 172.21.15.22:0/4026929104 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:11.558 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.550 7f504ffff700 1 -- 172.21.15.22:0/4026929104 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f50500f1970 msgr2=0x7f50501b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:11.558 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.550 7f504ffff700 1 --2- 172.21.15.22:0/4026929104 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f50500f1970 0x7f50501b46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.558 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.550 7f504ffff700 1 -- 172.21.15.22:0/4026929104 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f50500f6300 msgr2=0x7f50500f1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:11.559 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.550 7f504ffff700 1 --2- 172.21.15.22:0/4026929104 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f50500f6300 0x7f50500f1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.559 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.550 7f504ffff700 1 -- 172.21.15.22:0/4026929104 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50501161d0 con 0x7f50500f1dc0 2022-04-28T14:39:11.559 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.550 7f504f7fe700 1 --2- 172.21.15.22:0/4026929104 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f50500f6300 0x7f50500f1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:11.559 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.550 7f504effd700 1 --2- 172.21.15.22:0/4026929104 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f50500f1970 0x7f50501b46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:11.559 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.551 7f504ffff700 1 --2- 172.21.15.22:0/4026929104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50500f1dc0 0x7f50501b4cf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f505010f3f0 tx=0x7f5048009d70).ready entity=mon.0 client_cookie=e3f60364c8dd2484 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:11.559 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.551 7f504e7fc700 1 -- 172.21.15.22:0/4026929104 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f50501161d0 con 0x7f50500f1dc0 2022-04-28T14:39:11.559 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.551 7f504e7fc700 1 -- 172.21.15.22:0/4026929104 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504800b720 con 0x7f50500f1dc0 2022-04-28T14:39:11.559 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.551 7f504e7fc700 1 -- 172.21.15.22:0/4026929104 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f504800b900 con 0x7f50500f1dc0 2022-04-28T14:39:11.559 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.551 7f5056e36700 1 -- 172.21.15.22:0/4026929104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50500f1dc0 msgr2=0x7f50501b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:11.559 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.551 7f5056e36700 1 --2- 172.21.15.22:0/4026929104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50500f1dc0 0x7f50501b4cf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f505010f3f0 tx=0x7f5048009d70).stop 2022-04-28T14:39:11.560 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.551 7f5056e36700 1 -- 172.21.15.22:0/4026929104 shutdown_connections 2022-04-28T14:39:11.560 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.551 7f5056e36700 1 --2- 172.21.15.22:0/4026929104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50500f1dc0 0x7f50501b4cf0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.560 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.551 7f5056e36700 1 --2- 172.21.15.22:0/4026929104 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f50500f6300 0x7f50500f1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.560 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.551 7f5056e36700 1 --2- 172.21.15.22:0/4026929104 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f50500f1970 0x7f50501b46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.560 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.551 7f5056e36700 1 -- 172.21.15.22:0/4026929104 >> 172.21.15.22:0/4026929104 conn(0x7f50501171f0 msgr2=0x7f50500f2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:11.560 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.551 7f5056e36700 1 -- 172.21.15.22:0/4026929104 shutdown_connections 2022-04-28T14:39:11.560 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.551 7f5056e36700 1 -- 172.21.15.22:0/4026929104 wait complete. 2022-04-28T14:39:11.580 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.576 7f5056e36700 1 Processor -- start 2022-04-28T14:39:11.580 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.576 7f5056e36700 1 -- start start 2022-04-28T14:39:11.582 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.576 7f5056e36700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f50500d5620 0x7f50501c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:11.583 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.576 7f5056e36700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f50501c6090 0x7f50500b8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:11.583 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.576 7f5056e36700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50501c64e0 0x7f50500b9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:11.583 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.576 7f5056e36700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50500d1a60 con 0x7f50501c64e0 2022-04-28T14:39:11.583 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.576 7f5056e36700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50500cfc60 con 0x7f50500d5620 2022-04-28T14:39:11.583 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.576 7f5056e36700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50500d5da0 con 0x7f50501c6090 2022-04-28T14:39:11.583 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.576 7f504effd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f50501c6090 0x7f50500b8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:11.583 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.576 7f504f7fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f50500d5620 0x7f50501c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:11.583 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.576 7f504ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50501c64e0 0x7f50500b9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:11.584 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.576 7f504effd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f50501c6090 0x7f50500b8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:45998/0 (socket says 172.21.15.22:45998) 2022-04-28T14:39:11.584 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.576 7f504f7fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f50500d5620 0x7f50501c5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46212/0 (socket says 172.21.15.22:46212) 2022-04-28T14:39:11.584 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.576 7f504effd700 1 -- 172.21.15.22:0/3903396215 learned_addr learned my addr 172.21.15.22:0/3903396215 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:11.584 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.577 7f504ffff700 1 -- 172.21.15.22:0/3903396215 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f50501c6090 msgr2=0x7f50500b8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:11.584 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.577 7f504ffff700 1 --2- 172.21.15.22:0/3903396215 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f50501c6090 0x7f50500b8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.584 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.577 7f504ffff700 1 -- 172.21.15.22:0/3903396215 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f50500d5620 msgr2=0x7f50501c5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:11.584 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.577 7f504ffff700 1 --2- 172.21.15.22:0/3903396215 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f50500d5620 0x7f50501c5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.584 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.577 7f504ffff700 1 -- 172.21.15.22:0/3903396215 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50500d0100 con 0x7f50501c64e0 2022-04-28T14:39:11.584 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.577 7f504effd700 1 --2- 172.21.15.22:0/3903396215 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f50501c6090 0x7f50500b8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:11.584 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.577 7f504ffff700 1 --2- 172.21.15.22:0/3903396215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50501c64e0 0x7f50500b9170 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f50500d6b10 tx=0x7f5048006c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:11.585 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.577 7f504cff9700 1 -- 172.21.15.22:0/3903396215 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5048017040 con 0x7f50501c64e0 2022-04-28T14:39:11.585 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.577 7f504cff9700 1 -- 172.21.15.22:0/3903396215 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5048011940 con 0x7f50501c64e0 2022-04-28T14:39:11.585 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.577 7f5056e36700 1 -- 172.21.15.22:0/3903396215 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50500d5a70 con 0x7f50501c64e0 2022-04-28T14:39:11.585 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.577 7f504cff9700 1 -- 172.21.15.22:0/3903396215 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5048011d10 con 0x7f50501c64e0 2022-04-28T14:39:11.585 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.577 7f5056e36700 1 -- 172.21.15.22:0/3903396215 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50500b97a0 con 0x7f50501c64e0 2022-04-28T14:39:11.585 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.578 7f504cff9700 1 -- 172.21.15.22:0/3903396215 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f504801c470 con 0x7f50501c64e0 2022-04-28T14:39:11.585 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.578 7f504cff9700 1 -- 172.21.15.22:0/3903396215 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2407+0+0 (secure 0 0 0) 0x7f5048018030 con 0x7f50501c64e0 2022-04-28T14:39:11.585 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.578 7f5056e36700 1 -- 172.21.15.22:0/3903396215 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50500ab2b0 con 0x7f50501c64e0 2022-04-28T14:39:11.586 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.581 7f504cff9700 1 -- 172.21.15.22:0/3903396215 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f5048011730 con 0x7f50501c64e0 2022-04-28T14:39:11.684 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.679 7f5056e36700 1 -- 172.21.15.22:0/3903396215 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f50500a5b80 con 0x7f50501c64e0 2022-04-28T14:39:11.684 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.680 7f504cff9700 1 -- 172.21.15.22:0/3903396215 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v12) v1 ==== 84+0+64 (secure 0 0 0) 0x7f504800b510 con 0x7f50501c64e0 2022-04-28T14:39:11.685 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:11.685 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2022-04-28T14:39:11.685 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:39:11.685 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2022-04-28T14:39:11.685 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": "rbd" 2022-04-28T14:39:11.685 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:39:11.685 INFO:teuthology.orchestra.run.smithi022.stdout:] 2022-04-28T14:39:11.686 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.681 7f5056e36700 1 -- 172.21.15.22:0/3903396215 >> v1:172.21.15.22:6808/86956 conn(0x7f503401c1b0 legacy=0x7f503401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:11.686 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.681 7f5056e36700 1 -- 172.21.15.22:0/3903396215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50501c64e0 msgr2=0x7f50500b9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:11.687 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.681 7f5056e36700 1 --2- 172.21.15.22:0/3903396215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50501c64e0 0x7f50500b9170 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f50500d6b10 tx=0x7f5048006c40).stop 2022-04-28T14:39:11.687 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.681 7f5056e36700 1 -- 172.21.15.22:0/3903396215 shutdown_connections 2022-04-28T14:39:11.687 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.681 7f5056e36700 1 --2- 172.21.15.22:0/3903396215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50501c64e0 0x7f50500b9170 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.687 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.681 7f5056e36700 1 --2- 172.21.15.22:0/3903396215 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f50500d5620 0x7f50501c5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.687 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.681 7f5056e36700 1 --2- 172.21.15.22:0/3903396215 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f50501c6090 0x7f50500b8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.687 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.681 7f5056e36700 1 -- 172.21.15.22:0/3903396215 >> 172.21.15.22:0/3903396215 conn(0x7f50500e0c70 msgr2=0x7f50500bb120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:11.687 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.681 7f5056e36700 1 -- 172.21.15.22:0/3903396215 shutdown_connections 2022-04-28T14:39:11.687 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.681 7f5056e36700 1 -- 172.21.15.22:0/3903396215 wait complete. 2022-04-28T14:39:11.696 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2022-04-28T14:39:11.696 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2022-04-28T14:39:11.833 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.825 7f73d9597700 1 Processor -- start 2022-04-28T14:39:11.833 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.825 7f73d9597700 1 -- start start 2022-04-28T14:39:11.833 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.826 7f73d9597700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f73d40f6200 0x7f73d40f1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:11.833 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.826 7f73d9597700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f73d40f1ce0 0x7f73d41b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:11.834 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.826 7f73d9597700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d40ab020 con 0x7f73d40f1890 2022-04-28T14:39:11.834 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.826 7f73d9597700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d410ebd0 con 0x7f73d40f1ce0 2022-04-28T14:39:11.834 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.826 7f73d9597700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73d41b5410 con 0x7f73d40f6200 2022-04-28T14:39:11.834 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.826 7f73d2ab2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f73d40f1ce0 0x7f73d41b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:11.834 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.826 7f73d22b1700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f73d40f6200 0x7f73d40f1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:11.834 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.826 7f73d1ab0700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f73d40f1890 0x7f73d41b45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38050/0 (socket says 172.21.15.22:38050) 2022-04-28T14:39:11.834 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.826 7f73d1ab0700 1 -- 172.21.15.22:0/3386907765 learned_addr learned my addr 172.21.15.22:0/3386907765 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:39:11.834 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.826 7f73d12af700 1 -- 172.21.15.22:0/3386907765 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1599839480 0 0) 0x7f73bc001110 con 0x7f73d40f1890 2022-04-28T14:39:11.834 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.826 7f73d22b1700 1 -- 172.21.15.22:0/3386907765 >> v2:172.21.15.22:3300/0 conn(0x7f73d40f1ce0 msgr2=0x7f73d41b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:11.835 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.826 7f73d22b1700 1 --2- 172.21.15.22:0/3386907765 >> v2:172.21.15.22:3300/0 conn(0x7f73d40f1ce0 0x7f73d41b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.835 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.826 7f73d22b1700 1 -- 172.21.15.22:0/3386907765 >> v1:172.21.15.22:6789/0 conn(0x7f73d40f1890 legacy=0x7f73d41b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:11.835 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.826 7f73d22b1700 1 -- 172.21.15.22:0/3386907765 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d4116e30 con 0x7f73d40f6200 2022-04-28T14:39:11.835 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.826 7f73d2ab2700 1 --2- 172.21.15.22:0/3386907765 >> v2:172.21.15.22:3300/0 conn(0x7f73d40f1ce0 0x7f73d41b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:11.835 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.826 7f73d22b1700 1 --2- 172.21.15.22:0/3386907765 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f73d40f6200 0x7f73d40f1260 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f73c4002f70 tx=0x7f73c400b970).ready entity=mon.2 client_cookie=e504f6fbbdd5d440 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:11.835 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.826 7f73d12af700 1 -- 172.21.15.22:0/3386907765 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f73d4116e30 con 0x7f73d40f6200 2022-04-28T14:39:11.835 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.827 7f73d12af700 1 -- 172.21.15.22:0/3386907765 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c400d610 con 0x7f73d40f6200 2022-04-28T14:39:11.835 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.827 7f73d12af700 1 -- 172.21.15.22:0/3386907765 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f73c400d9e0 con 0x7f73d40f6200 2022-04-28T14:39:11.835 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.827 7f73d9597700 1 -- 172.21.15.22:0/3386907765 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f73d40f6200 msgr2=0x7f73d40f1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:11.836 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.827 7f73d9597700 1 --2- 172.21.15.22:0/3386907765 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f73d40f6200 0x7f73d40f1260 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f73c4002f70 tx=0x7f73c400b970).stop 2022-04-28T14:39:11.836 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.827 7f73d9597700 1 -- 172.21.15.22:0/3386907765 shutdown_connections 2022-04-28T14:39:11.836 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.827 7f73d9597700 1 --2- 172.21.15.22:0/3386907765 >> v2:172.21.15.22:3300/0 conn(0x7f73d40f1ce0 0x7f73d41b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.836 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.827 7f73d9597700 1 --2- 172.21.15.22:0/3386907765 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f73d40f6200 0x7f73d40f1260 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.836 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.827 7f73d9597700 1 -- 172.21.15.22:0/3386907765 >> 172.21.15.22:0/3386907765 conn(0x7f73d4117110 msgr2=0x7f73d40f2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:11.836 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.827 7f73d9597700 1 -- 172.21.15.22:0/3386907765 shutdown_connections 2022-04-28T14:39:11.836 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.827 7f73d9597700 1 -- 172.21.15.22:0/3386907765 wait complete. 2022-04-28T14:39:11.858 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.851 7f73d9597700 1 Processor -- start 2022-04-28T14:39:11.858 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.852 7f73d9597700 1 -- start start 2022-04-28T14:39:11.858 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.852 7f73d9597700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f73d40df940 0x7f73d41c33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:11.858 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.852 7f73d9597700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73d41c39f0 0x7f73d41c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:11.858 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.852 7f73d9597700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f73d41c9db0 0x7f73d41ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:11.859 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.852 7f73d9597700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d40ba700 con 0x7f73d41c39f0 2022-04-28T14:39:11.859 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.852 7f73d9597700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d41c73a0 con 0x7f73d40df940 2022-04-28T14:39:11.859 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.852 7f73d9597700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73d40d1250 con 0x7f73d41c9db0 2022-04-28T14:39:11.859 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.852 7f73d2ab2700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f73d41c9db0 0x7f73d41ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:11.859 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.852 7f73d1ab0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73d41c39f0 0x7f73d41c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:11.859 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.852 7f73d22b1700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f73d40df940 0x7f73d41c33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:11.859 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.852 7f73d2ab2700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f73d41c9db0 0x7f73d41ca200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46014/0 (socket says 172.21.15.22:46014) 2022-04-28T14:39:11.859 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.852 7f73d2ab2700 1 -- 172.21.15.22:0/2041013595 learned_addr learned my addr 172.21.15.22:0/2041013595 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:11.860 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.852 7f73d1ab0700 1 -- 172.21.15.22:0/2041013595 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f73d41c9db0 msgr2=0x7f73d41ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:11.860 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.852 7f73d1ab0700 1 --2- 172.21.15.22:0/2041013595 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f73d41c9db0 0x7f73d41ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.860 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.852 7f73d1ab0700 1 -- 172.21.15.22:0/2041013595 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f73d40df940 msgr2=0x7f73d41c33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:11.860 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.852 7f73d1ab0700 1 --2- 172.21.15.22:0/2041013595 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f73d40df940 0x7f73d41c33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:11.860 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.852 7f73d1ab0700 1 -- 172.21.15.22:0/2041013595 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d40dfd90 con 0x7f73d41c39f0 2022-04-28T14:39:11.860 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.852 7f73d22b1700 1 --2- 172.21.15.22:0/2041013595 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f73d40df940 0x7f73d41c33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:11.860 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.853 7f73d1ab0700 1 --2- 172.21.15.22:0/2041013595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73d41c39f0 0x7f73d41c9780 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f73d410f0e0 tx=0x7f73bc00c830).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:11.860 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.853 7f73cb7fe700 1 -- 172.21.15.22:0/2041013595 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f73d40dfd90 con 0x7f73d41c39f0 2022-04-28T14:39:11.861 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.853 7f73cb7fe700 1 -- 172.21.15.22:0/2041013595 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73bc0070d0 con 0x7f73d41c39f0 2022-04-28T14:39:11.861 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.853 7f73d9597700 1 -- 172.21.15.22:0/2041013595 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d40ba0c0 con 0x7f73d41c39f0 2022-04-28T14:39:11.861 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.853 7f73cb7fe700 1 -- 172.21.15.22:0/2041013595 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f73bc005620 con 0x7f73d41c39f0 2022-04-28T14:39:11.861 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.853 7f73d9597700 1 -- 172.21.15.22:0/2041013595 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d41d0c60 con 0x7f73d41c39f0 2022-04-28T14:39:11.861 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.853 7f73cb7fe700 1 -- 172.21.15.22:0/2041013595 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f73bc005820 con 0x7f73d41c39f0 2022-04-28T14:39:11.861 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.853 7f73cb7fe700 1 -- 172.21.15.22:0/2041013595 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2407+0+0 (secure 0 0 0) 0x7f73bc0287c0 con 0x7f73d41c39f0 2022-04-28T14:39:11.862 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.854 7f73d9597700 1 -- 172.21.15.22:0/2041013595 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d40f63d0 con 0x7f73d41c39f0 2022-04-28T14:39:11.862 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.857 7f73cb7fe700 1 -- 172.21.15.22:0/2041013595 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f73bc00cda0 con 0x7f73d41c39f0 2022-04-28T14:39:11.958 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:11.954 7f73d9597700 1 -- 172.21.15.22:0/2041013595 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f73d40f02b0 con 0x7f73d41c39f0 2022-04-28T14:39:12.580 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.575 7f73cb7fe700 1 -- 172.21.15.22:0/2041013595 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v13) v1 ==== 152+0+0 (secure 0 0 0) 0x7f73bc000c30 con 0x7f73d41c39f0 2022-04-28T14:39:12.583 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.578 7f73d9597700 1 -- 172.21.15.22:0/2041013595 >> v1:172.21.15.22:6808/86956 conn(0x7f73b801c1b0 legacy=0x7f73b801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:12.583 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.578 7f73d9597700 1 -- 172.21.15.22:0/2041013595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73d41c39f0 msgr2=0x7f73d41c9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:12.583 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.578 7f73d9597700 1 --2- 172.21.15.22:0/2041013595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73d41c39f0 0x7f73d41c9780 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f73d410f0e0 tx=0x7f73bc00c830).stop 2022-04-28T14:39:12.585 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.580 7f73d9597700 1 -- 172.21.15.22:0/2041013595 shutdown_connections 2022-04-28T14:39:12.585 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.580 7f73d9597700 1 --2- 172.21.15.22:0/2041013595 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f73d41c9db0 0x7f73d41ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:12.585 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.580 7f73d9597700 1 --2- 172.21.15.22:0/2041013595 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f73d40df940 0x7f73d41c33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:12.585 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.580 7f73d9597700 1 --2- 172.21.15.22:0/2041013595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73d41c39f0 0x7f73d41c9780 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:12.585 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.580 7f73d9597700 1 -- 172.21.15.22:0/2041013595 >> 172.21.15.22:0/2041013595 conn(0x7f73d40d6150 msgr2=0x7f73d40d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:12.588 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.584 7f73d9597700 1 -- 172.21.15.22:0/2041013595 shutdown_connections 2022-04-28T14:39:12.590 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.585 7f73d9597700 1 -- 172.21.15.22:0/2041013595 wait complete. 2022-04-28T14:39:12.593 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2022-04-28T14:39:12.606 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2022-04-28T14:39:12.746 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.741 7f2273b6c700 1 Processor -- start 2022-04-28T14:39:12.746 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.741 7f2273b6c700 1 -- start start 2022-04-28T14:39:12.749 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.742 7f2273b6c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f226c0f6340 0x7f226c0f1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:12.749 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.742 7f2273b6c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f226c0f6790 0x7f226c0f1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:12.749 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.742 7f2273b6c700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f226c0ab080 con 0x7f226c1b2440 2022-04-28T14:39:12.749 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.742 7f2273b6c700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f226c111bf0 con 0x7f226c0f6790 2022-04-28T14:39:12.749 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.742 7f2273b6c700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f226c10cad0 con 0x7f226c0f6340 2022-04-28T14:39:12.749 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.742 7f227096b700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f226c0f6340 0x7f226c0f1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:12.749 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.742 7f227096b700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f226c0f6340 0x7f226c0f1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46018/0 (socket says 172.21.15.22:46018) 2022-04-28T14:39:12.750 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.742 7f227096b700 1 -- 172.21.15.22:0/2678684773 learned_addr learned my addr 172.21.15.22:0/2678684773 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:12.750 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.742 7f226bfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f226c0f6790 0x7f226c0f1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:12.750 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.742 7f227096b700 1 -- 172.21.15.22:0/2678684773 >> v2:172.21.15.22:3300/0 conn(0x7f226c0f6790 msgr2=0x7f226c0f1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:12.750 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.742 7f227096b700 1 --2- 172.21.15.22:0/2678684773 >> v2:172.21.15.22:3300/0 conn(0x7f226c0f6790 0x7f226c0f1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:12.750 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.742 7f227096b700 1 -- 172.21.15.22:0/2678684773 >> v1:172.21.15.22:6789/0 conn(0x7f226c1b2440 legacy=0x7f226c1b2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:12.750 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.742 7f227096b700 1 -- 172.21.15.22:0/2678684773 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c10d3b0 con 0x7f226c0f6340 2022-04-28T14:39:12.750 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.743 7f227096b700 1 --2- 172.21.15.22:0/2678684773 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f226c0f6340 0x7f226c0f1240 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f225c002f70 tx=0x7f225c0099d0).ready entity=mon.2 client_cookie=211afa9ee00c3292 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:12.750 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.743 7f226b7fe700 1 -- 172.21.15.22:0/2678684773 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f226c10d3b0 con 0x7f226c0f6340 2022-04-28T14:39:12.750 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.743 7f226b7fe700 1 -- 172.21.15.22:0/2678684773 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225c00f510 con 0x7f226c0f6340 2022-04-28T14:39:12.750 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.743 7f226b7fe700 1 -- 172.21.15.22:0/2678684773 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f225c00f6f0 con 0x7f226c0f6340 2022-04-28T14:39:12.751 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.743 7f2273b6c700 1 -- 172.21.15.22:0/2678684773 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f226c0f6340 msgr2=0x7f226c0f1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:12.751 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.743 7f2273b6c700 1 --2- 172.21.15.22:0/2678684773 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f226c0f6340 0x7f226c0f1240 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f225c002f70 tx=0x7f225c0099d0).stop 2022-04-28T14:39:12.751 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.743 7f2273b6c700 1 -- 172.21.15.22:0/2678684773 shutdown_connections 2022-04-28T14:39:12.751 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.743 7f2273b6c700 1 --2- 172.21.15.22:0/2678684773 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f226c0f6340 0x7f226c0f1240 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:12.751 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.743 7f2273b6c700 1 --2- 172.21.15.22:0/2678684773 >> v2:172.21.15.22:3300/0 conn(0x7f226c0f6790 0x7f226c0f1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:12.751 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.743 7f2273b6c700 1 -- 172.21.15.22:0/2678684773 >> 172.21.15.22:0/2678684773 conn(0x7f226c1170f0 msgr2=0x7f226c0f2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:12.751 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.743 7f2273b6c700 1 -- 172.21.15.22:0/2678684773 shutdown_connections 2022-04-28T14:39:12.751 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.743 7f2273b6c700 1 -- 172.21.15.22:0/2678684773 wait complete. 2022-04-28T14:39:12.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.767 7f2273b6c700 1 Processor -- start 2022-04-28T14:39:12.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.767 7f2273b6c700 1 -- start start 2022-04-28T14:39:12.774 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.768 7f2273b6c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f226c0b8130 0x7f226c0b8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:12.774 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.768 7f2273b6c700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f226c0df440 0x7f226c0df890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:12.775 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.768 7f2273b6c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f226c0dfec0 0x7f226c1c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:12.775 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.768 7f2273b6c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c0bebf0 con 0x7f226c0b8130 2022-04-28T14:39:12.775 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.768 7f2273b6c700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226c0b7c30 con 0x7f226c0df440 2022-04-28T14:39:12.775 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.768 7f2273b6c700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f226c0b2c20 con 0x7f226c0dfec0 2022-04-28T14:39:12.775 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.768 7f227096b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f226c0b8130 0x7f226c0b8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:12.775 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.768 7f227096b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f226c0b8130 0x7f226c0b8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48672/0 (socket says 172.21.15.22:48672) 2022-04-28T14:39:12.775 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.768 7f227096b700 1 -- 172.21.15.22:0/870893151 learned_addr learned my addr 172.21.15.22:0/870893151 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:12.775 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.768 7f227116c700 1 --2- 172.21.15.22:0/870893151 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f226c0dfec0 0x7f226c1c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:12.775 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.768 7f226bfff700 1 --2- 172.21.15.22:0/870893151 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f226c0df440 0x7f226c0df890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:12.776 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.768 7f227096b700 1 -- 172.21.15.22:0/870893151 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f226c0dfec0 msgr2=0x7f226c1c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:12.776 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.768 7f227096b700 1 --2- 172.21.15.22:0/870893151 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f226c0dfec0 0x7f226c1c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:12.776 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.768 7f227096b700 1 -- 172.21.15.22:0/870893151 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f226c0df440 msgr2=0x7f226c0df890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:12.776 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.768 7f227096b700 1 --2- 172.21.15.22:0/870893151 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f226c0df440 0x7f226c0df890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:12.776 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.768 7f227096b700 1 -- 172.21.15.22:0/870893151 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c0d1a60 con 0x7f226c0b8130 2022-04-28T14:39:12.776 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.768 7f227116c700 1 --2- 172.21.15.22:0/870893151 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f226c0dfec0 0x7f226c1c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:12.776 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.768 7f226bfff700 1 --2- 172.21.15.22:0/870893151 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f226c0df440 0x7f226c0df890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:12.776 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.768 7f227096b700 1 --2- 172.21.15.22:0/870893151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f226c0b8130 0x7f226c0b8580 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f226c0d3a30 tx=0x7f225c0068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:12.776 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.768 7f2269ffb700 1 -- 172.21.15.22:0/870893151 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f225c011610 con 0x7f226c0b8130 2022-04-28T14:39:12.777 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.769 7f2269ffb700 1 -- 172.21.15.22:0/870893151 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225c011810 con 0x7f226c0b8130 2022-04-28T14:39:12.777 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.769 7f2273b6c700 1 -- 172.21.15.22:0/870893151 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226c0d1740 con 0x7f226c0b8130 2022-04-28T14:39:12.777 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.769 7f2269ffb700 1 -- 172.21.15.22:0/870893151 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f225c011be0 con 0x7f226c0b8130 2022-04-28T14:39:12.777 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.769 7f2273b6c700 1 -- 172.21.15.22:0/870893151 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226c1c59c0 con 0x7f226c0b8130 2022-04-28T14:39:12.777 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.769 7f2269ffb700 1 -- 172.21.15.22:0/870893151 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f225c027460 con 0x7f226c0b8130 2022-04-28T14:39:12.777 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.769 7f2269ffb700 1 -- 172.21.15.22:0/870893151 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2777+0+0 (secure 0 0 0) 0x7f225c029bb0 con 0x7f226c0b8130 2022-04-28T14:39:12.777 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.770 7f2273b6c700 1 -- 172.21.15.22:0/870893151 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f226c0f0290 con 0x7f226c0b8130 2022-04-28T14:39:12.778 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.773 7f2269ffb700 1 -- 172.21.15.22:0/870893151 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f225c011400 con 0x7f226c0b8130 2022-04-28T14:39:12.873 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:12.869 7f2273b6c700 1 -- 172.21.15.22:0/870893151 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f226c0a5b50 con 0x7f226c0b8130 2022-04-28T14:39:13.585 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.580 7f2269ffb700 1 -- 172.21.15.22:0/870893151 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v14) v1 ==== 170+0+0 (secure 0 0 0) 0x7f225c00f300 con 0x7f226c0b8130 2022-04-28T14:39:13.602 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.597 7f2273b6c700 1 -- 172.21.15.22:0/870893151 >> v1:172.21.15.22:6808/86956 conn(0x7f225001c1b0 legacy=0x7f225001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:13.602 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.597 7f2273b6c700 1 -- 172.21.15.22:0/870893151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f226c0b8130 msgr2=0x7f226c0b8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:13.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.597 7f2273b6c700 1 --2- 172.21.15.22:0/870893151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f226c0b8130 0x7f226c0b8580 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f226c0d3a30 tx=0x7f225c0068c0).stop 2022-04-28T14:39:13.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.597 7f2273b6c700 1 -- 172.21.15.22:0/870893151 shutdown_connections 2022-04-28T14:39:13.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.597 7f2273b6c700 1 --2- 172.21.15.22:0/870893151 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f226c0dfec0 0x7f226c1c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:13.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.597 7f2273b6c700 1 --2- 172.21.15.22:0/870893151 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f226c0b8130 0x7f226c0b8580 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:13.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.597 7f2273b6c700 1 --2- 172.21.15.22:0/870893151 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f226c0df440 0x7f226c0df890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:13.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.597 7f2273b6c700 1 -- 172.21.15.22:0/870893151 >> 172.21.15.22:0/870893151 conn(0x7f226c0ab560 msgr2=0x7f226c0d1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:13.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.597 7f2273b6c700 1 -- 172.21.15.22:0/870893151 shutdown_connections 2022-04-28T14:39:13.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.598 7f2273b6c700 1 -- 172.21.15.22:0/870893151 wait complete. 2022-04-28T14:39:13.605 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2022-04-28T14:39:13.631 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2022-04-28T14:39:13.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.764 7f6b2e24d700 1 Processor -- start 2022-04-28T14:39:13.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.764 7f6b2e24d700 1 -- start start 2022-04-28T14:39:13.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.765 7f6b2e24d700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6b280f6360 0x7f6b280fe940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:13.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.765 7f6b2e24d700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6b280fef70 0x7f6b281b1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:13.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.765 7f6b2e24d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b280ab080 con 0x7f6b280ff3c0 2022-04-28T14:39:13.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.765 7f6b2e24d700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b281b2260 con 0x7f6b280fef70 2022-04-28T14:39:13.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.765 7f6b2e24d700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b28115da0 con 0x7f6b280f6360 2022-04-28T14:39:13.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.766 7f6b26800700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6b280fef70 0x7f6b281b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:13.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.766 7f6b26800700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6b280fef70 0x7f6b281b1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46250/0 (socket says 172.21.15.22:46250) 2022-04-28T14:39:13.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.766 7f6b26800700 1 -- 172.21.15.22:0/131731823 learned_addr learned my addr 172.21.15.22:0/131731823 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:13.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.766 7f6b27001700 1 --2- 172.21.15.22:0/131731823 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6b280f6360 0x7f6b280fe940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:13.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.766 7f6b27802700 1 --1- 172.21.15.22:0/131731823 >> v1:172.21.15.22:6789/0 conn(0x7f6b280ff3c0 0x7f6b281b1a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38080/0 (socket says 172.21.15.22:38080) 2022-04-28T14:39:13.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.766 7f6b26800700 1 -- 172.21.15.22:0/131731823 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6b280f6360 msgr2=0x7f6b280fe940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:13.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.766 7f6b26800700 1 --2- 172.21.15.22:0/131731823 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6b280f6360 0x7f6b280fe940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:13.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.766 7f6b26800700 1 -- 172.21.15.22:0/131731823 >> v1:172.21.15.22:6789/0 conn(0x7f6b280ff3c0 legacy=0x7f6b281b1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:13.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.766 7f6b25fff700 1 -- 172.21.15.22:0/131731823 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3299703220 0 0) 0x7f6b20001490 con 0x7f6b280ff3c0 2022-04-28T14:39:13.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.766 7f6b26800700 1 -- 172.21.15.22:0/131731823 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2810b7a0 con 0x7f6b280fef70 2022-04-28T14:39:13.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.766 7f6b27001700 1 --2- 172.21.15.22:0/131731823 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6b280f6360 0x7f6b280fe940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:13.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.766 7f6b26800700 1 --2- 172.21.15.22:0/131731823 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6b280fef70 0x7f6b281b1430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f6b10002f70 tx=0x7f6b10009a80).ready entity=mon.1 client_cookie=2c15a923d3d100ed server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:13.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.766 7f6b25fff700 1 -- 172.21.15.22:0/131731823 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6b2810b7a0 con 0x7f6b280fef70 2022-04-28T14:39:13.774 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.766 7f6b25fff700 1 -- 172.21.15.22:0/131731823 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1000f510 con 0x7f6b280fef70 2022-04-28T14:39:13.774 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.766 7f6b25fff700 1 -- 172.21.15.22:0/131731823 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6b1000f6f0 con 0x7f6b280fef70 2022-04-28T14:39:13.774 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.766 7f6b2e24d700 1 -- 172.21.15.22:0/131731823 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6b280fef70 msgr2=0x7f6b281b1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:13.774 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.766 7f6b2e24d700 1 --2- 172.21.15.22:0/131731823 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6b280fef70 0x7f6b281b1430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f6b10002f70 tx=0x7f6b10009a80).stop 2022-04-28T14:39:13.774 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.767 7f6b2e24d700 1 -- 172.21.15.22:0/131731823 shutdown_connections 2022-04-28T14:39:13.774 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.767 7f6b2e24d700 1 --2- 172.21.15.22:0/131731823 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6b280f6360 0x7f6b280fe940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:13.774 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.767 7f6b2e24d700 1 --2- 172.21.15.22:0/131731823 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6b280fef70 0x7f6b281b1430 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:13.774 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.767 7f6b2e24d700 1 -- 172.21.15.22:0/131731823 >> 172.21.15.22:0/131731823 conn(0x7f6b281170f0 msgr2=0x7f6b280f2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:13.774 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.767 7f6b2e24d700 1 -- 172.21.15.22:0/131731823 shutdown_connections 2022-04-28T14:39:13.774 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.767 7f6b2e24d700 1 -- 172.21.15.22:0/131731823 wait complete. 2022-04-28T14:39:13.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.791 7f6b2e24d700 1 Processor -- start 2022-04-28T14:39:13.822 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.791 7f6b2e24d700 1 -- start start 2022-04-28T14:39:13.822 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.791 7f6b2e24d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b280bd7c0 0x7f6b280bdc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:13.822 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.791 7f6b2e24d700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6b281c2b00 0x7f6b281c2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:13.822 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.791 7f6b2e24d700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6b281c3580 0x7f6b280bad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:13.822 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.791 7f6b2e24d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b280ba160 con 0x7f6b280bd7c0 2022-04-28T14:39:13.823 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.791 7f6b2e24d700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b280bc100 con 0x7f6b281c3580 2022-04-28T14:39:13.823 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.791 7f6b2e24d700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b280bb3b0 con 0x7f6b281c2b00 2022-04-28T14:39:13.823 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.792 7f6b26800700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6b281c2b00 0x7f6b281c2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:13.823 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.792 7f6b27001700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b280bd7c0 0x7f6b280bdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:13.823 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.792 7f6b26800700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6b281c2b00 0x7f6b281c2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46038/0 (socket says 172.21.15.22:46038) 2022-04-28T14:39:13.823 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.792 7f6b26800700 1 -- 172.21.15.22:0/3781302512 learned_addr learned my addr 172.21.15.22:0/3781302512 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:13.823 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.792 7f6b27001700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b280bd7c0 0x7f6b280bdc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48688/0 (socket says 172.21.15.22:48688) 2022-04-28T14:39:13.823 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.792 7f6b27802700 1 --2- 172.21.15.22:0/3781302512 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6b281c3580 0x7f6b280bad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:13.823 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.792 7f6b26800700 1 -- 172.21.15.22:0/3781302512 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6b281c3580 msgr2=0x7f6b280bad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:13.823 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.792 7f6b26800700 1 --2- 172.21.15.22:0/3781302512 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6b281c3580 0x7f6b280bad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:13.824 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.792 7f6b26800700 1 -- 172.21.15.22:0/3781302512 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b280bd7c0 msgr2=0x7f6b280bdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:13.824 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.792 7f6b26800700 1 --2- 172.21.15.22:0/3781302512 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b280bd7c0 0x7f6b280bdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:13.824 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.792 7f6b26800700 1 -- 172.21.15.22:0/3781302512 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b280bb5e0 con 0x7f6b281c2b00 2022-04-28T14:39:13.824 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.792 7f6b27001700 1 --2- 172.21.15.22:0/3781302512 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b280bd7c0 0x7f6b280bdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:13.824 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.792 7f6b26800700 1 --2- 172.21.15.22:0/3781302512 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6b281c2b00 0x7f6b281c2f50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f6b280bc490 tx=0x7f6b100068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:13.824 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.792 7f6b1ffff700 1 -- 172.21.15.22:0/3781302512 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6b280bb5e0 con 0x7f6b281c2b00 2022-04-28T14:39:13.824 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.792 7f6b1ffff700 1 -- 172.21.15.22:0/3781302512 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b100119c0 con 0x7f6b281c2b00 2022-04-28T14:39:13.824 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.792 7f6b2e24d700 1 -- 172.21.15.22:0/3781302512 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b280bb8a0 con 0x7f6b281c2b00 2022-04-28T14:39:13.824 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.792 7f6b1ffff700 1 -- 172.21.15.22:0/3781302512 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6b10011dd0 con 0x7f6b281c2b00 2022-04-28T14:39:13.824 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.792 7f6b2e24d700 1 -- 172.21.15.22:0/3781302512 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b281cd310 con 0x7f6b281c2b00 2022-04-28T14:39:13.825 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.793 7f6b1ffff700 1 -- 172.21.15.22:0/3781302512 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f6b10019030 con 0x7f6b281c2b00 2022-04-28T14:39:13.825 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.793 7f6b1ffff700 1 -- 172.21.15.22:0/3781302512 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3159+0+0 (secure 0 0 0) 0x7f6b10018040 con 0x7f6b281c2b00 2022-04-28T14:39:13.825 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.793 7f6b2e24d700 1 -- 172.21.15.22:0/3781302512 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b280f0290 con 0x7f6b281c2b00 2022-04-28T14:39:13.825 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.796 7f6b1ffff700 1 -- 172.21.15.22:0/3781302512 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f6b100117b0 con 0x7f6b281c2b00 2022-04-28T14:39:13.931 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.926 7f6b2e24d700 1 -- 172.21.15.22:0/3781302512 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6b280ef680 con 0x7f6b281c2b00 2022-04-28T14:39:13.939 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.935 7f6b1ffff700 1 -- 172.21.15.22:0/3781302512 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6b1000f300 con 0x7f6b281c2b00 2022-04-28T14:39:13.963 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.958 7f6b2e24d700 1 -- 172.21.15.22:0/3781302512 >> v1:172.21.15.22:6808/86956 conn(0x7f6b0c01c1b0 legacy=0x7f6b0c01e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:13.963 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.958 7f6b2e24d700 1 -- 172.21.15.22:0/3781302512 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6b281c2b00 msgr2=0x7f6b281c2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:13.963 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.959 7f6b2e24d700 1 --2- 172.21.15.22:0/3781302512 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6b281c2b00 0x7f6b281c2f50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f6b280bc490 tx=0x7f6b100068c0).stop 2022-04-28T14:39:13.964 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.960 7f6b2e24d700 1 -- 172.21.15.22:0/3781302512 shutdown_connections 2022-04-28T14:39:13.964 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.960 7f6b2e24d700 1 --2- 172.21.15.22:0/3781302512 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6b281c3580 0x7f6b280bad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:13.965 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.960 7f6b2e24d700 1 --2- 172.21.15.22:0/3781302512 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b280bd7c0 0x7f6b280bdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:13.965 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.960 7f6b2e24d700 1 --2- 172.21.15.22:0/3781302512 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6b281c2b00 0x7f6b281c2f50 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:13.965 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.960 7f6b2e24d700 1 -- 172.21.15.22:0/3781302512 >> 172.21.15.22:0/3781302512 conn(0x7f6b280d9980 msgr2=0x7f6b280c5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:13.965 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.960 7f6b2e24d700 1 -- 172.21.15.22:0/3781302512 shutdown_connections 2022-04-28T14:39:13.965 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:13.960 7f6b2e24d700 1 -- 172.21.15.22:0/3781302512 wait complete. 2022-04-28T14:39:13.967 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 2 and data pool 3 2022-04-28T14:39:13.984 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-28T14:39:14.117 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.110 7fcb94958700 1 Processor -- start 2022-04-28T14:39:14.117 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.110 7fcb94958700 1 -- start start 2022-04-28T14:39:14.117 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.110 7fcb94958700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fcb900f6230 0x7fcb900f1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:14.117 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.110 7fcb94958700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fcb900f1cf0 0x7fcb901b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:14.117 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.110 7fcb94958700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb900ab0b0 con 0x7fcb900f18a0 2022-04-28T14:39:14.117 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.110 7fcb94958700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb9010ebe0 con 0x7fcb900f1cf0 2022-04-28T14:39:14.117 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.110 7fcb94958700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb901b5420 con 0x7fcb900f6230 2022-04-28T14:39:14.118 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.110 7fcb8d5ff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fcb900f6230 0x7fcb900f1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:14.118 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.110 7fcb8de00700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fcb900f1cf0 0x7fcb901b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:14.118 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.110 7fcb8de00700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fcb900f1cf0 0x7fcb901b4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48706/0 (socket says 172.21.15.22:48706) 2022-04-28T14:39:14.118 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.110 7fcb8de00700 1 -- 172.21.15.22:0/2727897165 learned_addr learned my addr 172.21.15.22:0/2727897165 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:14.118 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.110 7fcb8d5ff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fcb900f6230 0x7fcb900f1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46054/0 (socket says 172.21.15.22:46054) 2022-04-28T14:39:14.118 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.111 7fcb8d5ff700 1 -- 172.21.15.22:0/2727897165 >> v2:172.21.15.22:3300/0 conn(0x7fcb900f1cf0 msgr2=0x7fcb901b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:14.118 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.111 7fcb8d5ff700 1 --2- 172.21.15.22:0/2727897165 >> v2:172.21.15.22:3300/0 conn(0x7fcb900f1cf0 0x7fcb901b4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:14.118 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.111 7fcb8d5ff700 1 -- 172.21.15.22:0/2727897165 >> v1:172.21.15.22:6789/0 conn(0x7fcb900f18a0 legacy=0x7fcb901b45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:14.118 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.111 7fcb8d5ff700 1 -- 172.21.15.22:0/2727897165 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb90116100 con 0x7fcb900f6230 2022-04-28T14:39:14.119 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.111 7fcb87fff700 1 -- 172.21.15.22:0/2727897165 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3799531696 0 0) 0x7fcb78001110 con 0x7fcb900f18a0 2022-04-28T14:39:14.119 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.111 7fcb8de00700 1 --2- 172.21.15.22:0/2727897165 >> v2:172.21.15.22:3300/0 conn(0x7fcb900f1cf0 0x7fcb901b4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:14.119 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.111 7fcb8d5ff700 1 --2- 172.21.15.22:0/2727897165 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fcb900f6230 0x7fcb900f1270 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fcb80002f70 tx=0x7fcb8000b970).ready entity=mon.2 client_cookie=c720c851d5fef8cd server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:14.119 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.111 7fcb87fff700 1 -- 172.21.15.22:0/2727897165 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcb90116100 con 0x7fcb900f6230 2022-04-28T14:39:14.119 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.111 7fcb87fff700 1 -- 172.21.15.22:0/2727897165 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8000d610 con 0x7fcb900f6230 2022-04-28T14:39:14.119 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.111 7fcb87fff700 1 -- 172.21.15.22:0/2727897165 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcb8000d9e0 con 0x7fcb900f6230 2022-04-28T14:39:14.119 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.111 7fcb94958700 1 -- 172.21.15.22:0/2727897165 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fcb900f6230 msgr2=0x7fcb900f1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:14.119 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.111 7fcb94958700 1 --2- 172.21.15.22:0/2727897165 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fcb900f6230 0x7fcb900f1270 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fcb80002f70 tx=0x7fcb8000b970).stop 2022-04-28T14:39:14.120 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.112 7fcb94958700 1 -- 172.21.15.22:0/2727897165 shutdown_connections 2022-04-28T14:39:14.120 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.112 7fcb94958700 1 --2- 172.21.15.22:0/2727897165 >> v2:172.21.15.22:3300/0 conn(0x7fcb900f1cf0 0x7fcb901b4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:14.120 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.112 7fcb94958700 1 --2- 172.21.15.22:0/2727897165 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fcb900f6230 0x7fcb900f1270 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:14.120 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.112 7fcb94958700 1 -- 172.21.15.22:0/2727897165 >> 172.21.15.22:0/2727897165 conn(0x7fcb90117120 msgr2=0x7fcb900f2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:14.120 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.112 7fcb94958700 1 -- 172.21.15.22:0/2727897165 shutdown_connections 2022-04-28T14:39:14.120 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.112 7fcb94958700 1 -- 172.21.15.22:0/2727897165 wait complete. 2022-04-28T14:39:14.141 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.136 7fcb94958700 1 Processor -- start 2022-04-28T14:39:14.141 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.136 7fcb94958700 1 -- start start 2022-04-28T14:39:14.144 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.137 7fcb94958700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fcb900b4100 0x7fcb901c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:14.144 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.137 7fcb94958700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb901c62f0 0x7fcb900b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:14.144 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.137 7fcb94958700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fcb901c6740 0x7fcb900b5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:14.144 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.137 7fcb94958700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb900b3460 con 0x7fcb901c62f0 2022-04-28T14:39:14.144 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.137 7fcb94958700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb900b3c60 con 0x7fcb901c6740 2022-04-28T14:39:14.145 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.137 7fcb94958700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb900b39a0 con 0x7fcb900b4100 2022-04-28T14:39:14.145 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.137 7fcb8d5ff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fcb900b4100 0x7fcb901c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:14.145 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.137 7fcb8cdfe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb901c62f0 0x7fcb900b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:14.145 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.137 7fcb8d5ff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fcb900b4100 0x7fcb901c5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46060/0 (socket says 172.21.15.22:46060) 2022-04-28T14:39:14.145 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.137 7fcb8d5ff700 1 -- 172.21.15.22:0/2020058172 learned_addr learned my addr 172.21.15.22:0/2020058172 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:14.145 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.137 7fcb8cdfe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb901c62f0 0x7fcb900b4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48710/0 (socket says 172.21.15.22:48710) 2022-04-28T14:39:14.145 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.137 7fcb8de00700 1 --2- 172.21.15.22:0/2020058172 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fcb901c6740 0x7fcb900b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:14.145 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.137 7fcb8d5ff700 1 -- 172.21.15.22:0/2020058172 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fcb901c6740 msgr2=0x7fcb900b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:14.145 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.137 7fcb8d5ff700 1 --2- 172.21.15.22:0/2020058172 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fcb901c6740 0x7fcb900b5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:14.145 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.137 7fcb8d5ff700 1 -- 172.21.15.22:0/2020058172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb901c62f0 msgr2=0x7fcb900b4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:14.146 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.137 7fcb8d5ff700 1 --2- 172.21.15.22:0/2020058172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb901c62f0 0x7fcb900b4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:14.146 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.137 7fcb8d5ff700 1 -- 172.21.15.22:0/2020058172 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb900b4c40 con 0x7fcb900b4100 2022-04-28T14:39:14.146 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.137 7fcb8de00700 1 --2- 172.21.15.22:0/2020058172 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fcb901c6740 0x7fcb900b5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:14.146 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.137 7fcb8cdfe700 1 --2- 172.21.15.22:0/2020058172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb901c62f0 0x7fcb900b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:14.146 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.137 7fcb8d5ff700 1 --2- 172.21.15.22:0/2020058172 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fcb900b4100 0x7fcb901c5cc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fcb80002f70 tx=0x7fcb8000a040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:14.146 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.137 7fcb867fc700 1 -- 172.21.15.22:0/2020058172 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcb900b4c40 con 0x7fcb900b4100 2022-04-28T14:39:14.146 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.137 7fcb867fc700 1 -- 172.21.15.22:0/2020058172 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb80013aa0 con 0x7fcb900b4100 2022-04-28T14:39:14.146 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.137 7fcb94958700 1 -- 172.21.15.22:0/2020058172 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb900cd180 con 0x7fcb900b4100 2022-04-28T14:39:14.146 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.138 7fcb867fc700 1 -- 172.21.15.22:0/2020058172 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fcb8001f450 con 0x7fcb900b4100 2022-04-28T14:39:14.146 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.138 7fcb94958700 1 -- 172.21.15.22:0/2020058172 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb900b4550 con 0x7fcb900b4100 2022-04-28T14:39:14.147 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.138 7fcb867fc700 1 -- 172.21.15.22:0/2020058172 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fcb800283f0 con 0x7fcb900b4100 2022-04-28T14:39:14.147 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.138 7fcb867fc700 1 -- 172.21.15.22:0/2020058172 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fcb80015d60 con 0x7fcb900b4100 2022-04-28T14:39:14.147 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.139 7fcb94958700 1 -- 172.21.15.22:0/2020058172 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb900f02c0 con 0x7fcb900b4100 2022-04-28T14:39:14.147 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.141 7fcb867fc700 1 -- 172.21.15.22:0/2020058172 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fcb8000d400 con 0x7fcb900b4100 2022-04-28T14:39:14.243 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.239 7fcb94958700 1 -- 172.21.15.22:0/2020058172 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb90115e40 con 0x7fcb900b4100 2022-04-28T14:39:14.244 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.239 7fcb867fc700 1 -- 172.21.15.22:0/2020058172 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+8828 (secure 0 0 0) 0x7fcb80013890 con 0x7fcb900b4100 2022-04-28T14:39:14.244 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:14.245 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":15,"fsid":"3047163a-0285-4058-8e05-ce74c6fbb9c5","created":"2022-04-28 14:38:54.232890","modified":"2022-04-28 14:39:13.928279","last_up_change":"2022-04-28 14:39:00.269721","last_in_change":"2022-04-28 14:39:00.269721","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-04-28 14:39:03.639717","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-04-28 14:39:12.000229","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-04-28 14:39:12.915097","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782ee638-1ada-48d9-9454-f9e0ca8a3135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6800","nonce":87556}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":87556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":87556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":87556}]},"public_addr":"172.21.15.22:6800/87556","cluster_addr":"172.21.15.22:6801/87556","heartbeat_back_addr":"172.21.15.22:6803/87556","heartbeat_front_addr":"172.21.15.22:6802/87556","state":["exists","up"]},{"osd":1,"uuid":"61ca6f96-fb4f-4c0f-b68b-edf1e7011f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":87557}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":87557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":87557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":87557}]},"public_addr":"172.21.15.22:6804/87557","cluster_addr":"172.21.15.22:6805/87557","heartbeat_back_addr":"172.21.15.22:6807/87557","heartbeat_front_addr":"172.21.15.22:6806/87557","state":["exists","up"]},{"osd":2,"uuid":"4b3043b9-50df-4b7f-a55a-ac8e6148c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":87558}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":87558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":87558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":87558}]},"public_addr":"172.21.15.22:6813/87558","cluster_addr":"172.21.15.22:6814/87558","heartbeat_back_addr":"172.21.15.22:6816/87558","heartbeat_front_addr":"172.21.15.22:6815/87558","state":["exists","up"]},{"osd":3,"uuid":"7807bcd1-53f8-44b5-9992-57c328e5b299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":87561}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":87561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":87561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":87561}]},"public_addr":"172.21.15.22:6809/87561","cluster_addr":"172.21.15.22:6810/87561","heartbeat_back_addr":"172.21.15.22:6812/87561","heartbeat_front_addr":"172.21.15.22:6811/87561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-04-28T14:39:14.246 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.240 7fcb94958700 1 -- 172.21.15.22:0/2020058172 >> v1:172.21.15.22:6808/86956 conn(0x7fcb7401c1b0 legacy=0x7fcb7401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:14.246 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.240 7fcb94958700 1 -- 172.21.15.22:0/2020058172 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fcb900b4100 msgr2=0x7fcb901c5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:14.246 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.240 7fcb94958700 1 --2- 172.21.15.22:0/2020058172 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fcb900b4100 0x7fcb901c5cc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fcb80002f70 tx=0x7fcb8000a040).stop 2022-04-28T14:39:14.246 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.241 7fcb94958700 1 -- 172.21.15.22:0/2020058172 shutdown_connections 2022-04-28T14:39:14.246 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.241 7fcb94958700 1 --2- 172.21.15.22:0/2020058172 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fcb901c6740 0x7fcb900b5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:14.246 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.241 7fcb94958700 1 --2- 172.21.15.22:0/2020058172 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fcb900b4100 0x7fcb901c5cc0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:14.246 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.241 7fcb94958700 1 --2- 172.21.15.22:0/2020058172 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb901c62f0 0x7fcb900b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:14.246 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.241 7fcb94958700 1 -- 172.21.15.22:0/2020058172 >> 172.21.15.22:0/2020058172 conn(0x7fcb90124110 msgr2=0x7fcb900d2910 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:14.247 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.241 7fcb94958700 1 -- 172.21.15.22:0/2020058172 shutdown_connections 2022-04-28T14:39:14.247 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.241 7fcb94958700 1 -- 172.21.15.22:0/2020058172 wait complete. 2022-04-28T14:39:14.257 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-28T14:39:14.388 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.380 7f5e86e1d700 1 Processor -- start 2022-04-28T14:39:14.388 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.380 7f5e86e1d700 1 -- start start 2022-04-28T14:39:14.388 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.381 7f5e86e1d700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5e800f6440 0x7f5e800f1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:14.388 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.381 7f5e86e1d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5e800f6890 0x7f5e800f1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:14.388 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.381 7f5e86e1d700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5e801b2540 0x7f5e801b2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:14.388 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.381 7f5e86e1d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e80111cf0 con 0x7f5e800f6890 2022-04-28T14:39:14.389 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.381 7f5e86e1d700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8010cbd0 con 0x7f5e801b2540 2022-04-28T14:39:14.389 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.381 7f5e86e1d700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8010d4b0 con 0x7f5e800f6440 2022-04-28T14:39:14.389 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.381 7f5e7effd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5e800f6890 0x7f5e800f1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:14.389 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.381 7f5e7f7fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5e800f6440 0x7f5e800f1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:14.389 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.381 7f5e7ffff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5e801b2540 0x7f5e801b2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:14.389 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.381 7f5e7f7fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5e800f6440 0x7f5e800f1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46068/0 (socket says 172.21.15.22:46068) 2022-04-28T14:39:14.389 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.381 7f5e7effd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5e800f6890 0x7f5e800f1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48716/0 (socket says 172.21.15.22:48716) 2022-04-28T14:39:14.389 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.381 7f5e7f7fe700 1 -- 172.21.15.22:0/1986758783 learned_addr learned my addr 172.21.15.22:0/1986758783 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:14.389 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.381 7f5e7ffff700 1 -- 172.21.15.22:0/1986758783 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5e800f6440 msgr2=0x7f5e800f1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:14.389 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.381 7f5e7ffff700 1 --2- 172.21.15.22:0/1986758783 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5e800f6440 0x7f5e800f1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:14.390 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.381 7f5e7ffff700 1 -- 172.21.15.22:0/1986758783 >> v2:172.21.15.22:3300/0 conn(0x7f5e800f6890 msgr2=0x7f5e800f1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:14.390 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.381 7f5e7ffff700 1 --2- 172.21.15.22:0/1986758783 >> v2:172.21.15.22:3300/0 conn(0x7f5e800f6890 0x7f5e800f1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:14.390 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.381 7f5e7ffff700 1 -- 172.21.15.22:0/1986758783 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e800f1fa0 con 0x7f5e801b2540 2022-04-28T14:39:14.390 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.381 7f5e7effd700 1 --2- 172.21.15.22:0/1986758783 >> v2:172.21.15.22:3300/0 conn(0x7f5e800f6890 0x7f5e800f1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:14.390 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.381 7f5e7f7fe700 1 --2- 172.21.15.22:0/1986758783 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5e800f6440 0x7f5e800f1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:14.390 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.382 7f5e7ffff700 1 --2- 172.21.15.22:0/1986758783 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5e801b2540 0x7f5e801b2990 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f5e80104070 tx=0x7f5e78009d40).ready entity=mon.1 client_cookie=692f574b215c50d1 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:14.390 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.382 7f5e7e7fc700 1 -- 172.21.15.22:0/1986758783 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5e800f1fa0 con 0x7f5e801b2540 2022-04-28T14:39:14.390 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.382 7f5e7e7fc700 1 -- 172.21.15.22:0/1986758783 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7800b7c0 con 0x7f5e801b2540 2022-04-28T14:39:14.390 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.382 7f5e7e7fc700 1 -- 172.21.15.22:0/1986758783 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5e7800b9a0 con 0x7f5e801b2540 2022-04-28T14:39:14.391 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.382 7f5e86e1d700 1 -- 172.21.15.22:0/1986758783 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5e801b2540 msgr2=0x7f5e801b2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:14.391 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.382 7f5e86e1d700 1 --2- 172.21.15.22:0/1986758783 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5e801b2540 0x7f5e801b2990 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f5e80104070 tx=0x7f5e78009d40).stop 2022-04-28T14:39:14.391 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.382 7f5e86e1d700 1 -- 172.21.15.22:0/1986758783 shutdown_connections 2022-04-28T14:39:14.391 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.382 7f5e86e1d700 1 --2- 172.21.15.22:0/1986758783 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5e801b2540 0x7f5e801b2990 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:14.391 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.382 7f5e86e1d700 1 --2- 172.21.15.22:0/1986758783 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5e800f6440 0x7f5e800f1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:14.391 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.382 7f5e86e1d700 1 --2- 172.21.15.22:0/1986758783 >> v2:172.21.15.22:3300/0 conn(0x7f5e800f6890 0x7f5e800f1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:14.391 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.382 7f5e86e1d700 1 -- 172.21.15.22:0/1986758783 >> 172.21.15.22:0/1986758783 conn(0x7f5e801171f0 msgr2=0x7f5e800f2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:14.391 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.382 7f5e86e1d700 1 -- 172.21.15.22:0/1986758783 shutdown_connections 2022-04-28T14:39:14.391 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.382 7f5e86e1d700 1 -- 172.21.15.22:0/1986758783 wait complete. 2022-04-28T14:39:14.414 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.406 7f5e86e1d700 1 Processor -- start 2022-04-28T14:39:14.414 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.406 7f5e86e1d700 1 -- start start 2022-04-28T14:39:14.414 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.407 7f5e86e1d700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5e800d2990 0x7f5e800bd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:14.414 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.407 7f5e86e1d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e800d3750 0x7f5e800d3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:14.414 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.407 7f5e86e1d700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5e800d41d0 0x7f5e801c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:14.414 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.407 7f5e86e1d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e800bba30 con 0x7f5e800d3750 2022-04-28T14:39:14.414 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.407 7f5e86e1d700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e800bd9c0 con 0x7f5e800d2990 2022-04-28T14:39:14.414 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.407 7f5e86e1d700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e800bce60 con 0x7f5e800d41d0 2022-04-28T14:39:14.415 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.407 7f5e7effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e800d3750 0x7f5e800d3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:14.415 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.407 7f5e7ffff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5e800d41d0 0x7f5e801c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:14.415 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.407 7f5e7f7fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5e800d2990 0x7f5e800bd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:14.415 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.407 7f5e7ffff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5e800d41d0 0x7f5e801c5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46076/0 (socket says 172.21.15.22:46076) 2022-04-28T14:39:14.415 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.407 7f5e7ffff700 1 -- 172.21.15.22:0/2283397570 learned_addr learned my addr 172.21.15.22:0/2283397570 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:14.415 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.407 7f5e7effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e800d3750 0x7f5e800d3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48722/0 (socket says 172.21.15.22:48722) 2022-04-28T14:39:14.415 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.407 7f5e7f7fe700 1 -- 172.21.15.22:0/2283397570 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5e800d41d0 msgr2=0x7f5e801c5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:14.415 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.407 7f5e7f7fe700 1 --2- 172.21.15.22:0/2283397570 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5e800d41d0 0x7f5e801c5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:14.415 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.407 7f5e7f7fe700 1 -- 172.21.15.22:0/2283397570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e800d3750 msgr2=0x7f5e800d3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:14.416 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.407 7f5e7f7fe700 1 --2- 172.21.15.22:0/2283397570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e800d3750 0x7f5e800d3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:14.416 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.407 7f5e7f7fe700 1 -- 172.21.15.22:0/2283397570 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e800d4d30 con 0x7f5e800d2990 2022-04-28T14:39:14.416 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.407 7f5e7ffff700 1 --2- 172.21.15.22:0/2283397570 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5e800d41d0 0x7f5e801c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:14.416 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.407 7f5e7effd700 1 --2- 172.21.15.22:0/2283397570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e800d3750 0x7f5e800d3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:14.416 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.407 7f5e7f7fe700 1 --2- 172.21.15.22:0/2283397570 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5e800d2990 0x7f5e800bd390 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f5e800bb8e0 tx=0x7f5e7400ecd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:14.416 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.408 7f5e7cff9700 1 -- 172.21.15.22:0/2283397570 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5e800d4d30 con 0x7f5e800d2990 2022-04-28T14:39:14.416 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.408 7f5e7cff9700 1 -- 172.21.15.22:0/2283397570 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7400c5a0 con 0x7f5e800d2990 2022-04-28T14:39:14.416 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.408 7f5e86e1d700 1 -- 172.21.15.22:0/2283397570 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e800d25d0 con 0x7f5e800d2990 2022-04-28T14:39:14.416 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.408 7f5e7cff9700 1 -- 172.21.15.22:0/2283397570 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f5e7400f040 con 0x7f5e800d2990 2022-04-28T14:39:14.416 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.408 7f5e86e1d700 1 -- 172.21.15.22:0/2283397570 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e801c5e50 con 0x7f5e800d2990 2022-04-28T14:39:14.417 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.408 7f5e7cff9700 1 -- 172.21.15.22:0/2283397570 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f5e74011070 con 0x7f5e800d2990 2022-04-28T14:39:14.417 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.408 7f5e7cff9700 1 -- 172.21.15.22:0/2283397570 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f5e74010040 con 0x7f5e800d2990 2022-04-28T14:39:14.417 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.409 7f5e86e1d700 1 -- 172.21.15.22:0/2283397570 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e800f0390 con 0x7f5e800d2990 2022-04-28T14:39:14.417 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.412 7f5e7cff9700 1 -- 172.21.15.22:0/2283397570 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f5e7400ee10 con 0x7f5e800d2990 2022-04-28T14:39:14.513 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.508 7f5e86e1d700 1 -- 172.21.15.22:0/2283397570 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e800a5b80 con 0x7f5e800d2990 2022-04-28T14:39:14.514 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.509 7f5e7cff9700 1 -- 172.21.15.22:0/2283397570 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+8828 (secure 0 0 0) 0x7f5e74000c30 con 0x7f5e800d2990 2022-04-28T14:39:14.514 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:14.515 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":15,"fsid":"3047163a-0285-4058-8e05-ce74c6fbb9c5","created":"2022-04-28 14:38:54.232890","modified":"2022-04-28 14:39:13.928279","last_up_change":"2022-04-28 14:39:00.269721","last_in_change":"2022-04-28 14:39:00.269721","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-04-28 14:39:03.639717","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-04-28 14:39:12.000229","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-04-28 14:39:12.915097","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782ee638-1ada-48d9-9454-f9e0ca8a3135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6800","nonce":87556}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":87556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":87556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":87556}]},"public_addr":"172.21.15.22:6800/87556","cluster_addr":"172.21.15.22:6801/87556","heartbeat_back_addr":"172.21.15.22:6803/87556","heartbeat_front_addr":"172.21.15.22:6802/87556","state":["exists","up"]},{"osd":1,"uuid":"61ca6f96-fb4f-4c0f-b68b-edf1e7011f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":87557}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":87557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":87557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":87557}]},"public_addr":"172.21.15.22:6804/87557","cluster_addr":"172.21.15.22:6805/87557","heartbeat_back_addr":"172.21.15.22:6807/87557","heartbeat_front_addr":"172.21.15.22:6806/87557","state":["exists","up"]},{"osd":2,"uuid":"4b3043b9-50df-4b7f-a55a-ac8e6148c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":87558}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":87558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":87558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":87558}]},"public_addr":"172.21.15.22:6813/87558","cluster_addr":"172.21.15.22:6814/87558","heartbeat_back_addr":"172.21.15.22:6816/87558","heartbeat_front_addr":"172.21.15.22:6815/87558","state":["exists","up"]},{"osd":3,"uuid":"7807bcd1-53f8-44b5-9992-57c328e5b299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":87561}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":87561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":87561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":87561}]},"public_addr":"172.21.15.22:6809/87561","cluster_addr":"172.21.15.22:6810/87561","heartbeat_back_addr":"172.21.15.22:6812/87561","heartbeat_front_addr":"172.21.15.22:6811/87561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-04-28T14:39:14.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.510 7f5e86e1d700 1 -- 172.21.15.22:0/2283397570 >> v1:172.21.15.22:6808/86956 conn(0x7f5e6001c1b0 legacy=0x7f5e6001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:14.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.510 7f5e86e1d700 1 -- 172.21.15.22:0/2283397570 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5e800d2990 msgr2=0x7f5e800bd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:14.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.510 7f5e86e1d700 1 --2- 172.21.15.22:0/2283397570 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5e800d2990 0x7f5e800bd390 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f5e800bb8e0 tx=0x7f5e7400ecd0).stop 2022-04-28T14:39:14.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.510 7f5e86e1d700 1 -- 172.21.15.22:0/2283397570 shutdown_connections 2022-04-28T14:39:14.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.510 7f5e86e1d700 1 --2- 172.21.15.22:0/2283397570 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5e800d41d0 0x7f5e801c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:14.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.510 7f5e86e1d700 1 --2- 172.21.15.22:0/2283397570 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5e800d2990 0x7f5e800bd390 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:14.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.510 7f5e86e1d700 1 --2- 172.21.15.22:0/2283397570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e800d3750 0x7f5e800d3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:14.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.510 7f5e86e1d700 1 -- 172.21.15.22:0/2283397570 >> 172.21.15.22:0/2283397570 conn(0x7f5e80114ce0 msgr2=0x7f5e80121100 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:14.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.510 7f5e86e1d700 1 -- 172.21.15.22:0/2283397570 shutdown_connections 2022-04-28T14:39:14.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.510 7f5e86e1d700 1 -- 172.21.15.22:0/2283397570 wait complete. 2022-04-28T14:39:14.526 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2022-04-28T14:39:14.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.655 7fbd19184700 1 Processor -- start 2022-04-28T14:39:14.660 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.655 7fbd19184700 1 -- start start 2022-04-28T14:39:14.662 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.655 7fbd19184700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fbd140f6360 0x7fbd140fe940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:14.662 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.655 7fbd19184700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fbd140ff3c0 0x7fbd141b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:14.662 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.655 7fbd19184700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd140ab080 con 0x7fbd140fef70 2022-04-28T14:39:14.662 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.655 7fbd19184700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd141b2260 con 0x7fbd140f6360 2022-04-28T14:39:14.663 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.655 7fbd19184700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd14115da0 con 0x7fbd140ff3c0 2022-04-28T14:39:14.663 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.655 7fbd11e00700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fbd140f6360 0x7fbd140fe940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:14.663 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.655 7fbd115ff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fbd140fef70 0x7fbd141b1430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38126/0 (socket says 172.21.15.22:38126) 2022-04-28T14:39:14.663 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.655 7fbd11e00700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fbd140f6360 0x7fbd140fe940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46296/0 (socket says 172.21.15.22:46296) 2022-04-28T14:39:14.663 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.656 7fbd115ff700 1 -- 172.21.15.22:0/2271722782 learned_addr learned my addr 172.21.15.22:0/2271722782 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:39:14.663 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.656 7fbd12601700 1 --2- 172.21.15.22:0/2271722782 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fbd140ff3c0 0x7fbd141b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:14.663 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.656 7fbd11e00700 1 -- 172.21.15.22:0/2271722782 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fbd140ff3c0 msgr2=0x7fbd141b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:14.663 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.656 7fbd11e00700 1 --2- 172.21.15.22:0/2271722782 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fbd140ff3c0 0x7fbd141b1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:14.663 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.656 7fbd11e00700 1 -- 172.21.15.22:0/2271722782 >> v1:172.21.15.22:6789/0 conn(0x7fbd140fef70 legacy=0x7fbd141b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:14.663 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.656 7fbd10dfe700 1 -- 172.21.15.22:0/2271722782 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398221491 0 0) 0x7fbd08001110 con 0x7fbd140fef70 2022-04-28T14:39:14.664 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.656 7fbd11e00700 1 -- 172.21.15.22:0/2271722782 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1410b7a0 con 0x7fbd140f6360 2022-04-28T14:39:14.664 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.656 7fbd11e00700 1 --2- 172.21.15.22:0/2271722782 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fbd140f6360 0x7fbd140fe940 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fbd14125840 tx=0x7fbd0400ba50).ready entity=mon.1 client_cookie=247b505d25c57a9a server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:14.664 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.656 7fbd10dfe700 1 -- 172.21.15.22:0/2271722782 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbd1410b7a0 con 0x7fbd140f6360 2022-04-28T14:39:14.664 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.656 7fbd10dfe700 1 -- 172.21.15.22:0/2271722782 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0400d570 con 0x7fbd140f6360 2022-04-28T14:39:14.664 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.656 7fbd10dfe700 1 -- 172.21.15.22:0/2271722782 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbd0400d940 con 0x7fbd140f6360 2022-04-28T14:39:14.664 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.656 7fbd19184700 1 -- 172.21.15.22:0/2271722782 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fbd140f6360 msgr2=0x7fbd140fe940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:14.664 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.656 7fbd19184700 1 --2- 172.21.15.22:0/2271722782 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fbd140f6360 0x7fbd140fe940 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fbd14125840 tx=0x7fbd0400ba50).stop 2022-04-28T14:39:14.664 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.657 7fbd19184700 1 -- 172.21.15.22:0/2271722782 shutdown_connections 2022-04-28T14:39:14.664 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.657 7fbd19184700 1 --2- 172.21.15.22:0/2271722782 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fbd140ff3c0 0x7fbd141b1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:14.664 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.657 7fbd19184700 1 --2- 172.21.15.22:0/2271722782 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fbd140f6360 0x7fbd140fe940 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:14.665 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.657 7fbd19184700 1 -- 172.21.15.22:0/2271722782 >> 172.21.15.22:0/2271722782 conn(0x7fbd141170f0 msgr2=0x7fbd140f2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:14.665 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.657 7fbd19184700 1 -- 172.21.15.22:0/2271722782 shutdown_connections 2022-04-28T14:39:14.665 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.657 7fbd19184700 1 -- 172.21.15.22:0/2271722782 wait complete. 2022-04-28T14:39:14.685 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.681 7fbd19184700 1 Processor -- start 2022-04-28T14:39:14.685 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.681 7fbd19184700 1 -- start start 2022-04-28T14:39:14.688 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.681 7fbd19184700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fbd140bc9e0 0x7fbd140bce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:14.688 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.681 7fbd19184700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd141c1d20 0x7fbd141c2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:14.688 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.681 7fbd19184700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fbd141c27a0 0x7fbd140b6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:14.688 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.681 7fbd19184700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd140b6170 con 0x7fbd141c1d20 2022-04-28T14:39:14.688 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.681 7fbd19184700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd141b8340 con 0x7fbd140bc9e0 2022-04-28T14:39:14.688 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.681 7fbd19184700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd140bc5f0 con 0x7fbd141c27a0 2022-04-28T14:39:14.688 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.681 7fbd11e00700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fbd140bc9e0 0x7fbd140bce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:14.688 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.681 7fbd12601700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fbd141c27a0 0x7fbd140b6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:14.688 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.681 7fbd115ff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd141c1d20 0x7fbd141c2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:14.689 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.681 7fbd11e00700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fbd140bc9e0 0x7fbd140bce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46302/0 (socket says 172.21.15.22:46302) 2022-04-28T14:39:14.689 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.681 7fbd12601700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fbd141c27a0 0x7fbd140b6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46090/0 (socket says 172.21.15.22:46090) 2022-04-28T14:39:14.689 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.681 7fbd11e00700 1 -- 172.21.15.22:0/637431994 learned_addr learned my addr 172.21.15.22:0/637431994 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:14.689 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.682 7fbd11e00700 1 -- 172.21.15.22:0/637431994 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fbd141c27a0 msgr2=0x7fbd140b6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:14.689 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.682 7fbd11e00700 1 --2- 172.21.15.22:0/637431994 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fbd141c27a0 0x7fbd140b6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:14.689 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.682 7fbd11e00700 1 -- 172.21.15.22:0/637431994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd141c1d20 msgr2=0x7fbd141c2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:14.689 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.682 7fbd11e00700 1 --2- 172.21.15.22:0/637431994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd141c1d20 0x7fbd141c2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:14.689 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.682 7fbd11e00700 1 -- 172.21.15.22:0/637431994 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd140d46e0 con 0x7fbd140bc9e0 2022-04-28T14:39:14.689 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.682 7fbd115ff700 1 --2- 172.21.15.22:0/637431994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd141c1d20 0x7fbd141c2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:14.689 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.682 7fbd11e00700 1 --2- 172.21.15.22:0/637431994 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fbd140bc9e0 0x7fbd140bce30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fbd140bc160 tx=0x7fbd040068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:14.690 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.682 7fbd02ffd700 1 -- 172.21.15.22:0/637431994 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbd040116e0 con 0x7fbd140bc9e0 2022-04-28T14:39:14.690 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.682 7fbd02ffd700 1 -- 172.21.15.22:0/637431994 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd040118e0 con 0x7fbd140bc9e0 2022-04-28T14:39:14.690 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.682 7fbd19184700 1 -- 172.21.15.22:0/637431994 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd140b6a30 con 0x7fbd140bc9e0 2022-04-28T14:39:14.690 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.682 7fbd02ffd700 1 -- 172.21.15.22:0/637431994 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fbd04011cb0 con 0x7fbd140bc9e0 2022-04-28T14:39:14.690 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.682 7fbd19184700 1 -- 172.21.15.22:0/637431994 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd140b6e70 con 0x7fbd140bc9e0 2022-04-28T14:39:14.690 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.683 7fbd02ffd700 1 -- 172.21.15.22:0/637431994 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fbd04027460 con 0x7fbd140bc9e0 2022-04-28T14:39:14.690 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.683 7fbd02ffd700 1 -- 172.21.15.22:0/637431994 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fbd04008820 con 0x7fbd140bc9e0 2022-04-28T14:39:14.690 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.683 7fbd19184700 1 -- 172.21.15.22:0/637431994 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd140f0290 con 0x7fbd140bc9e0 2022-04-28T14:39:14.691 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.686 7fbd02ffd700 1 -- 172.21.15.22:0/637431994 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fbd040114d0 con 0x7fbd140bc9e0 2022-04-28T14:39:14.813 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:14.809 7fbd19184700 1 -- 172.21.15.22:0/637431994 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbd141c6190 con 0x7fbd140bc9e0 2022-04-28T14:39:15.586 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.581 7fbd02ffd700 1 -- 172.21.15.22:0/637431994 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbd0400d360 con 0x7fbd140bc9e0 2022-04-28T14:39:15.588 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.583 7fbd19184700 1 -- 172.21.15.22:0/637431994 >> v1:172.21.15.22:6808/86956 conn(0x7fbcf001c1b0 legacy=0x7fbcf001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:15.588 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.583 7fbd19184700 1 -- 172.21.15.22:0/637431994 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fbd140bc9e0 msgr2=0x7fbd140bce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:15.588 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.583 7fbd19184700 1 --2- 172.21.15.22:0/637431994 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fbd140bc9e0 0x7fbd140bce30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fbd140bc160 tx=0x7fbd040068c0).stop 2022-04-28T14:39:15.588 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.583 7fbd19184700 1 -- 172.21.15.22:0/637431994 shutdown_connections 2022-04-28T14:39:15.589 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.583 7fbd19184700 1 --2- 172.21.15.22:0/637431994 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fbd141c27a0 0x7fbd140b6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:15.589 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.583 7fbd19184700 1 --2- 172.21.15.22:0/637431994 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fbd140bc9e0 0x7fbd140bce30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:15.589 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.583 7fbd19184700 1 --2- 172.21.15.22:0/637431994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbd141c1d20 0x7fbd141c2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:15.589 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.583 7fbd19184700 1 -- 172.21.15.22:0/637431994 >> 172.21.15.22:0/637431994 conn(0x7fbd140bdde0 msgr2=0x7fbd140e0400 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:15.589 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.584 7fbd19184700 1 -- 172.21.15.22:0/637431994 shutdown_connections 2022-04-28T14:39:15.589 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.584 7fbd19184700 1 -- 172.21.15.22:0/637431994 wait complete. 2022-04-28T14:39:15.602 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2022-04-28T14:39:15.743 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.735 7fd8c198d700 1 Processor -- start 2022-04-28T14:39:15.743 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.735 7fd8c198d700 1 -- start start 2022-04-28T14:39:15.743 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.736 7fd8c198d700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd8bc0ff220 0x7fd8bc1b6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:15.743 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.736 7fd8c198d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd8bc1b6e90 0x7fd8bc1b92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:15.743 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.736 7fd8c198d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8bc0ab280 con 0x7fd8bc0f6440 2022-04-28T14:39:15.743 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.736 7fd8c198d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8bc115e80 con 0x7fd8bc1b6e90 2022-04-28T14:39:15.744 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.736 7fd8c198d700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc10b880 con 0x7fd8bc0ff220 2022-04-28T14:39:15.744 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.736 7fd8ba5c5700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd8bc0f6440 0x7fd8bc0fea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38138/0 (socket says 172.21.15.22:38138) 2022-04-28T14:39:15.744 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.736 7fd8b9dc4700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd8bc0ff220 0x7fd8bc1b6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:15.744 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.736 7fd8ba5c5700 1 -- 172.21.15.22:0/921673732 learned_addr learned my addr 172.21.15.22:0/921673732 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:39:15.744 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.736 7fd8badc6700 1 --2- 172.21.15.22:0/921673732 >> v2:172.21.15.22:3300/0 conn(0x7fd8bc1b6e90 0x7fd8bc1b92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:15.744 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.736 7fd8b95c3700 1 -- 172.21.15.22:0/921673732 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 725550737 0 0) 0x7fd8ac001110 con 0x7fd8bc0f6440 2022-04-28T14:39:15.744 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.736 7fd8b9dc4700 1 -- 172.21.15.22:0/921673732 >> v2:172.21.15.22:3300/0 conn(0x7fd8bc1b6e90 msgr2=0x7fd8bc1b92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:15.744 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.736 7fd8b9dc4700 1 --2- 172.21.15.22:0/921673732 >> v2:172.21.15.22:3300/0 conn(0x7fd8bc1b6e90 0x7fd8bc1b92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:15.745 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.736 7fd8b9dc4700 1 -- 172.21.15.22:0/921673732 >> v1:172.21.15.22:6789/0 conn(0x7fd8bc0f6440 legacy=0x7fd8bc0fea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:15.745 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.736 7fd8b9dc4700 1 -- 172.21.15.22:0/921673732 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8bc0f6890 con 0x7fd8bc0ff220 2022-04-28T14:39:15.745 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.737 7fd8b9dc4700 1 --2- 172.21.15.22:0/921673732 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd8bc0ff220 0x7fd8bc1b6860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fd8b0002f70 tx=0x7fd8b000b970).ready entity=mon.2 client_cookie=2c09d3dd4242055a server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:15.745 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.737 7fd8b95c3700 1 -- 172.21.15.22:0/921673732 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd8bc0f6890 con 0x7fd8bc0ff220 2022-04-28T14:39:15.745 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.737 7fd8b95c3700 1 -- 172.21.15.22:0/921673732 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b000d610 con 0x7fd8bc0ff220 2022-04-28T14:39:15.745 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.737 7fd8b95c3700 1 -- 172.21.15.22:0/921673732 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd8b000d9e0 con 0x7fd8bc0ff220 2022-04-28T14:39:15.745 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.737 7fd8c198d700 1 -- 172.21.15.22:0/921673732 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd8bc0ff220 msgr2=0x7fd8bc1b6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:15.745 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.737 7fd8c198d700 1 --2- 172.21.15.22:0/921673732 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd8bc0ff220 0x7fd8bc1b6860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fd8b0002f70 tx=0x7fd8b000b970).stop 2022-04-28T14:39:15.745 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.737 7fd8c198d700 1 -- 172.21.15.22:0/921673732 shutdown_connections 2022-04-28T14:39:15.746 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.737 7fd8c198d700 1 --2- 172.21.15.22:0/921673732 >> v2:172.21.15.22:3300/0 conn(0x7fd8bc1b6e90 0x7fd8bc1b92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:15.746 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.737 7fd8c198d700 1 --2- 172.21.15.22:0/921673732 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd8bc0ff220 0x7fd8bc1b6860 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:15.746 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.737 7fd8c198d700 1 -- 172.21.15.22:0/921673732 >> 172.21.15.22:0/921673732 conn(0x7fd8bc1171d0 msgr2=0x7fd8bc0f2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:15.746 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.738 7fd8c198d700 1 -- 172.21.15.22:0/921673732 shutdown_connections 2022-04-28T14:39:15.746 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.738 7fd8c198d700 1 -- 172.21.15.22:0/921673732 wait complete. 2022-04-28T14:39:15.766 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.761 7fd8c198d700 1 Processor -- start 2022-04-28T14:39:15.766 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.761 7fd8c198d700 1 -- start start 2022-04-28T14:39:15.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.762 7fd8c198d700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd8bc0b4dd0 0x7fd8bc0b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:15.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.762 7fd8c198d700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd8bc1b2520 0x7fd8bc1b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:15.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.762 7fd8c198d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8bc1b2fa0 0x7fd8bc0d2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:15.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.762 7fd8c198d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc1b64b0 con 0x7fd8bc1b2fa0 2022-04-28T14:39:15.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.762 7fd8c198d700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc0b45f0 con 0x7fd8bc1b2520 2022-04-28T14:39:15.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.762 7fd8c198d700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc0b4060 con 0x7fd8bc0b4dd0 2022-04-28T14:39:15.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.762 7fd8ba5c5700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd8bc0b4dd0 0x7fd8bc0b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:15.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.762 7fd8b9dc4700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd8bc1b2520 0x7fd8bc1b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:15.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.762 7fd8ba5c5700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd8bc0b4dd0 0x7fd8bc0b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46100/0 (socket says 172.21.15.22:46100) 2022-04-28T14:39:15.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.762 7fd8ba5c5700 1 -- 172.21.15.22:0/915065995 learned_addr learned my addr 172.21.15.22:0/915065995 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:15.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.762 7fd8badc6700 1 --2- 172.21.15.22:0/915065995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8bc1b2fa0 0x7fd8bc0d2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:15.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.762 7fd8badc6700 1 -- 172.21.15.22:0/915065995 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd8bc0b4dd0 msgr2=0x7fd8bc0b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:15.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.762 7fd8badc6700 1 --2- 172.21.15.22:0/915065995 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd8bc0b4dd0 0x7fd8bc0b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:15.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.762 7fd8badc6700 1 -- 172.21.15.22:0/915065995 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd8bc1b2520 msgr2=0x7fd8bc1b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:15.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.762 7fd8badc6700 1 --2- 172.21.15.22:0/915065995 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd8bc1b2520 0x7fd8bc1b2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:15.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.762 7fd8badc6700 1 -- 172.21.15.22:0/915065995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8bc1b60f0 con 0x7fd8bc1b2fa0 2022-04-28T14:39:15.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.762 7fd8ba5c5700 1 --2- 172.21.15.22:0/915065995 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd8bc0b4dd0 0x7fd8bc0b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:15.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.762 7fd8b9dc4700 1 --2- 172.21.15.22:0/915065995 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd8bc1b2520 0x7fd8bc1b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:15.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.762 7fd8badc6700 1 --2- 172.21.15.22:0/915065995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8bc1b2fa0 0x7fd8bc0d2d90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fd8b400c000 tx=0x7fd8b400ed50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:15.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.762 7fd8ab7fe700 1 -- 172.21.15.22:0/915065995 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd8bc1b60f0 con 0x7fd8bc1b2fa0 2022-04-28T14:39:15.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.763 7fd8ab7fe700 1 -- 172.21.15.22:0/915065995 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b400c750 con 0x7fd8bc1b2fa0 2022-04-28T14:39:15.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.763 7fd8c198d700 1 -- 172.21.15.22:0/915065995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8bc0d33c0 con 0x7fd8bc1b2fa0 2022-04-28T14:39:15.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.763 7fd8ab7fe700 1 -- 172.21.15.22:0/915065995 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd8b400f040 con 0x7fd8bc1b2fa0 2022-04-28T14:39:15.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.763 7fd8c198d700 1 -- 172.21.15.22:0/915065995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8bc0d38c0 con 0x7fd8bc1b2fa0 2022-04-28T14:39:15.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.763 7fd8ab7fe700 1 -- 172.21.15.22:0/915065995 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fd8b4022060 con 0x7fd8bc1b2fa0 2022-04-28T14:39:15.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.763 7fd8ab7fe700 1 -- 172.21.15.22:0/915065995 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fd8b4010040 con 0x7fd8bc1b2fa0 2022-04-28T14:39:15.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.764 7fd8c198d700 1 -- 172.21.15.22:0/915065995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8bc0f0370 con 0x7fd8bc1b2fa0 2022-04-28T14:39:15.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.767 7fd8ab7fe700 1 -- 172.21.15.22:0/915065995 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fd8b400c540 con 0x7fd8bc1b2fa0 2022-04-28T14:39:15.893 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:15.888 7fd8c198d700 1 -- 172.21.15.22:0/915065995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7fd8bc1c4340 con 0x7fd8bc1b2fa0 2022-04-28T14:39:16.592 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.588 7fd8ab7fe700 1 -- 172.21.15.22:0/915065995 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v7) v1 ==== 105+0+0 (secure 0 0 0) 0x7fd8bc0ffab0 con 0x7fd8bc1b2fa0 2022-04-28T14:39:16.594 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.590 7fd8c198d700 1 -- 172.21.15.22:0/915065995 >> v1:172.21.15.22:6808/86956 conn(0x7fd89801c1b0 legacy=0x7fd89801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:16.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.590 7fd8c198d700 1 -- 172.21.15.22:0/915065995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8bc1b2fa0 msgr2=0x7fd8bc0d2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:16.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.590 7fd8c198d700 1 --2- 172.21.15.22:0/915065995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8bc1b2fa0 0x7fd8bc0d2d90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fd8b400c000 tx=0x7fd8b400ed50).stop 2022-04-28T14:39:16.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.591 7fd8c198d700 1 -- 172.21.15.22:0/915065995 shutdown_connections 2022-04-28T14:39:16.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.591 7fd8c198d700 1 --2- 172.21.15.22:0/915065995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8bc1b2fa0 0x7fd8bc0d2d90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:16.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.591 7fd8c198d700 1 --2- 172.21.15.22:0/915065995 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd8bc0b4dd0 0x7fd8bc0b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:16.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.591 7fd8c198d700 1 --2- 172.21.15.22:0/915065995 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd8bc1b2520 0x7fd8bc1b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:16.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.591 7fd8c198d700 1 -- 172.21.15.22:0/915065995 >> 172.21.15.22:0/915065995 conn(0x7fd8bc0aecf0 msgr2=0x7fd8bc0f13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:16.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.591 7fd8c198d700 1 -- 172.21.15.22:0/915065995 shutdown_connections 2022-04-28T14:39:16.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.591 7fd8c198d700 1 -- 172.21.15.22:0/915065995 wait complete. 2022-04-28T14:39:16.614 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2022-04-28T14:39:16.755 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.748 7f256c1a2700 1 Processor -- start 2022-04-28T14:39:16.755 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.748 7f256c1a2700 1 -- start start 2022-04-28T14:39:16.755 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.748 7f256c1a2700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f25640ff140 0x7f25641b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:16.755 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.748 7f256c1a2700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f25641b6db0 0x7f25641b9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:16.756 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.748 7f256c1a2700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25640ab080 con 0x7f25640f6360 2022-04-28T14:39:16.756 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.748 7f256c1a2700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2564115da0 con 0x7f25640ff140 2022-04-28T14:39:16.756 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.748 7f256c1a2700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f256410b7a0 con 0x7f25641b6db0 2022-04-28T14:39:16.756 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.748 7f2568fa1700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f25640f6360 0x7f25640fe940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38160/0 (socket says 172.21.15.22:38160) 2022-04-28T14:39:16.756 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.748 7f2568fa1700 1 -- 172.21.15.22:0/1562483553 learned_addr learned my addr 172.21.15.22:0/1562483553 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:39:16.756 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.748 7f25697a2700 1 --2- 172.21.15.22:0/1562483553 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f25641b6db0 0x7f25641b9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:16.756 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.748 7f2563fff700 1 --2- 172.21.15.22:0/1562483553 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f25640ff140 0x7f25641b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:16.756 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.749 7f25637fe700 1 -- 172.21.15.22:0/1562483553 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3822488462 0 0) 0x7f254c001110 con 0x7f25640f6360 2022-04-28T14:39:16.756 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.749 7f25637fe700 1 -- 172.21.15.22:0/1562483553 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2544003270 con 0x7f25640f6360 2022-04-28T14:39:16.756 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.749 7f25697a2700 1 -- 172.21.15.22:0/1562483553 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f25640ff140 msgr2=0x7f25641b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:16.757 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.749 7f25697a2700 1 --2- 172.21.15.22:0/1562483553 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f25640ff140 0x7f25641b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:16.757 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.749 7f25697a2700 1 -- 172.21.15.22:0/1562483553 >> v1:172.21.15.22:6789/0 conn(0x7f25640f6360 legacy=0x7f25640fe940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:16.757 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.749 7f25697a2700 1 -- 172.21.15.22:0/1562483553 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25640f67b0 con 0x7f25641b6db0 2022-04-28T14:39:16.757 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.749 7f2563fff700 1 --2- 172.21.15.22:0/1562483553 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f25640ff140 0x7f25641b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:16.757 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.749 7f25697a2700 1 --2- 172.21.15.22:0/1562483553 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f25641b6db0 0x7f25641b9210 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f2564116150 tx=0x7f255c009cf0).ready entity=mon.2 client_cookie=3cfdea6b905bc915 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:16.757 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.749 7f25637fe700 1 -- 172.21.15.22:0/1562483553 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f25640f67b0 con 0x7f25641b6db0 2022-04-28T14:39:16.757 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.749 7f25637fe700 1 -- 172.21.15.22:0/1562483553 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255c00b840 con 0x7f25641b6db0 2022-04-28T14:39:16.757 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.749 7f25637fe700 1 -- 172.21.15.22:0/1562483553 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f255c00ba20 con 0x7f25641b6db0 2022-04-28T14:39:16.757 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.749 7f256c1a2700 1 -- 172.21.15.22:0/1562483553 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f25641b6db0 msgr2=0x7f25641b9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:16.758 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.749 7f256c1a2700 1 --2- 172.21.15.22:0/1562483553 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f25641b6db0 0x7f25641b9210 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f2564116150 tx=0x7f255c009cf0).stop 2022-04-28T14:39:16.758 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.750 7f256c1a2700 1 -- 172.21.15.22:0/1562483553 shutdown_connections 2022-04-28T14:39:16.758 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.750 7f256c1a2700 1 --2- 172.21.15.22:0/1562483553 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f25641b6db0 0x7f25641b9210 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:16.758 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.750 7f256c1a2700 1 --2- 172.21.15.22:0/1562483553 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f25640ff140 0x7f25641b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:16.758 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.750 7f256c1a2700 1 -- 172.21.15.22:0/1562483553 >> 172.21.15.22:0/1562483553 conn(0x7f25641170f0 msgr2=0x7f25640f2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:16.758 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.750 7f256c1a2700 1 -- 172.21.15.22:0/1562483553 shutdown_connections 2022-04-28T14:39:16.758 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.750 7f256c1a2700 1 -- 172.21.15.22:0/1562483553 wait complete. 2022-04-28T14:39:16.780 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.774 7f256c1a2700 1 Processor -- start 2022-04-28T14:39:16.780 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.774 7f256c1a2700 1 -- start start 2022-04-28T14:39:16.781 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.774 7f256c1a2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25640b3de0 0x7f25640b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:16.781 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.774 7f256c1a2700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f25640d2f00 0x7f25640d3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:16.781 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.774 7f256c1a2700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f25641b2440 0x7f25641b2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:16.781 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.774 7f256c1a2700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25640d3980 con 0x7f25640b3de0 2022-04-28T14:39:16.781 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.774 7f256c1a2700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25641b6320 con 0x7f25640d2f00 2022-04-28T14:39:16.781 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.774 7f256c1a2700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25640b4670 con 0x7f25641b2440 2022-04-28T14:39:16.781 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.774 7f2563fff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f25640d2f00 0x7f25640d3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:16.781 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.774 7f2568fa1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25640b3de0 0x7f25640b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:16.781 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.774 7f25697a2700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f25641b2440 0x7f25641b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:16.782 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.774 7f2563fff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f25640d2f00 0x7f25640d3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46340/0 (socket says 172.21.15.22:46340) 2022-04-28T14:39:16.782 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.774 7f2563fff700 1 -- 172.21.15.22:0/2528332860 learned_addr learned my addr 172.21.15.22:0/2528332860 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:16.782 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.774 7f2568fa1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25640b3de0 0x7f25640b4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48770/0 (socket says 172.21.15.22:48770) 2022-04-28T14:39:16.782 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.774 7f25697a2700 1 --2- 172.21.15.22:0/2528332860 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f25641b2440 0x7f25641b2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46126/0 (socket says 172.21.15.22:46126) 2022-04-28T14:39:16.782 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.775 7f2563fff700 1 -- 172.21.15.22:0/2528332860 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f25641b2440 msgr2=0x7f25641b2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:16.782 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.775 7f2563fff700 1 --2- 172.21.15.22:0/2528332860 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f25641b2440 0x7f25641b2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:16.782 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.775 7f2563fff700 1 -- 172.21.15.22:0/2528332860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25640b3de0 msgr2=0x7f25640b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:16.782 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.775 7f2563fff700 1 --2- 172.21.15.22:0/2528332860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25640b3de0 0x7f25640b4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:16.782 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.775 7f2563fff700 1 -- 172.21.15.22:0/2528332860 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25640b5400 con 0x7f25640d2f00 2022-04-28T14:39:16.782 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.775 7f2568fa1700 1 --2- 172.21.15.22:0/2528332860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25640b3de0 0x7f25640b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:16.783 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.775 7f2563fff700 1 --2- 172.21.15.22:0/2528332860 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f25640d2f00 0x7f25640d3350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f255400c000 tx=0x7f255400eca0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:16.783 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.775 7f2561ffb700 1 -- 172.21.15.22:0/2528332860 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f255400f040 con 0x7f25640d2f00 2022-04-28T14:39:16.783 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.775 7f2561ffb700 1 -- 172.21.15.22:0/2528332860 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255400c9a0 con 0x7f25640d2f00 2022-04-28T14:39:16.783 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.775 7f256c1a2700 1 -- 172.21.15.22:0/2528332860 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25640b5140 con 0x7f25640d2f00 2022-04-28T14:39:16.783 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.775 7f2561ffb700 1 -- 172.21.15.22:0/2528332860 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f255400cd70 con 0x7f25640d2f00 2022-04-28T14:39:16.783 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.775 7f256c1a2700 1 -- 172.21.15.22:0/2528332860 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25641b2ec0 con 0x7f25640d2f00 2022-04-28T14:39:16.783 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.775 7f2561ffb700 1 -- 172.21.15.22:0/2528332860 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f2554011070 con 0x7f25640d2f00 2022-04-28T14:39:16.783 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.776 7f2561ffb700 1 -- 172.21.15.22:0/2528332860 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f2554010040 con 0x7f25640d2f00 2022-04-28T14:39:16.783 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.776 7f256c1a2700 1 -- 172.21.15.22:0/2528332860 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25640f0290 con 0x7f25640d2f00 2022-04-28T14:39:16.784 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.779 7f2561ffb700 1 -- 172.21.15.22:0/2528332860 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f255400c5a0 con 0x7f25640d2f00 2022-04-28T14:39:16.904 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:16.899 7f256c1a2700 1 -- 172.21.15.22:0/2528332860 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f25640a5b50 con 0x7f25640d2f00 2022-04-28T14:39:17.597 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.592 7f2561ffb700 1 -- 172.21.15.22:0/2528332860 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2554000c30 con 0x7f25640d2f00 2022-04-28T14:39:17.599 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.594 7f256c1a2700 1 -- 172.21.15.22:0/2528332860 >> v1:172.21.15.22:6808/86956 conn(0x7f254801c1b0 legacy=0x7f254801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:17.599 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.594 7f256c1a2700 1 -- 172.21.15.22:0/2528332860 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f25640d2f00 msgr2=0x7f25640d3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:17.599 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.594 7f256c1a2700 1 --2- 172.21.15.22:0/2528332860 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f25640d2f00 0x7f25640d3350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f255400c000 tx=0x7f255400eca0).stop 2022-04-28T14:39:17.599 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.594 7f256c1a2700 1 -- 172.21.15.22:0/2528332860 shutdown_connections 2022-04-28T14:39:17.599 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.594 7f256c1a2700 1 --2- 172.21.15.22:0/2528332860 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f25641b2440 0x7f25641b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:17.600 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.594 7f256c1a2700 1 --2- 172.21.15.22:0/2528332860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25640b3de0 0x7f25640b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:17.600 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.594 7f256c1a2700 1 --2- 172.21.15.22:0/2528332860 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f25640d2f00 0x7f25640d3350 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:17.600 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.594 7f256c1a2700 1 -- 172.21.15.22:0/2528332860 >> 172.21.15.22:0/2528332860 conn(0x7f25640f1d70 msgr2=0x7f25640f12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:17.600 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.594 7f256c1a2700 1 -- 172.21.15.22:0/2528332860 shutdown_connections 2022-04-28T14:39:17.600 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.594 7f256c1a2700 1 -- 172.21.15.22:0/2528332860 wait complete. 2022-04-28T14:39:17.612 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-04-28T14:39:17.748 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.743 7fba219a2700 1 Processor -- start 2022-04-28T14:39:17.748 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.743 7fba219a2700 1 -- start start 2022-04-28T14:39:17.751 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.744 7fba219a2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fba1c1b4a90 0x7fba1c1b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:17.751 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.744 7fba219a2700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fba1c1b5510 0x7fba1c1bbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:17.751 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.744 7fba219a2700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1c0ab0b0 con 0x7fba1c10e870 2022-04-28T14:39:17.751 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.744 7fba219a2700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba1c10ee00 con 0x7fba1c1b4a90 2022-04-28T14:39:17.751 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.744 7fba219a2700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c0f88f0 con 0x7fba1c1b5510 2022-04-28T14:39:17.751 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.744 7fba19dc4700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fba1c1b4a90 0x7fba1c1b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:17.752 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.744 7fba1adc6700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fba1c1b5510 0x7fba1c1bbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:17.752 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.744 7fba1a5c5700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fba1c10e870 0x7fba1c0f23a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38178/0 (socket says 172.21.15.22:38178) 2022-04-28T14:39:17.752 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.744 7fba1a5c5700 1 -- 172.21.15.22:0/820364321 learned_addr learned my addr 172.21.15.22:0/820364321 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:39:17.752 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.744 7fba1adc6700 1 -- 172.21.15.22:0/820364321 >> v2:172.21.15.22:3300/0 conn(0x7fba1c1b4a90 msgr2=0x7fba1c1b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:17.752 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.744 7fba1adc6700 1 --2- 172.21.15.22:0/820364321 >> v2:172.21.15.22:3300/0 conn(0x7fba1c1b4a90 0x7fba1c1b4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:17.752 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.744 7fba1adc6700 1 -- 172.21.15.22:0/820364321 >> v1:172.21.15.22:6789/0 conn(0x7fba1c10e870 legacy=0x7fba1c0f23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:17.752 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.744 7fba1adc6700 1 -- 172.21.15.22:0/820364321 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1c10f320 con 0x7fba1c1b5510 2022-04-28T14:39:17.752 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.744 7fba19dc4700 1 --2- 172.21.15.22:0/820364321 >> v2:172.21.15.22:3300/0 conn(0x7fba1c1b4a90 0x7fba1c1b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:17.753 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.744 7fba1adc6700 1 --2- 172.21.15.22:0/820364321 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fba1c1b5510 0x7fba1c1bbce0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fba1c0a9360 tx=0x7fba14009cc0).ready entity=mon.1 client_cookie=c7f51b4439d10b40 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:17.753 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.745 7fba195c3700 1 -- 172.21.15.22:0/820364321 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fba1c10f320 con 0x7fba1c1b5510 2022-04-28T14:39:17.753 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.745 7fba195c3700 1 -- 172.21.15.22:0/820364321 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1400b840 con 0x7fba1c1b5510 2022-04-28T14:39:17.753 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.745 7fba195c3700 1 -- 172.21.15.22:0/820364321 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fba1400ba20 con 0x7fba1c1b5510 2022-04-28T14:39:17.753 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.745 7fba219a2700 1 -- 172.21.15.22:0/820364321 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fba1c1b5510 msgr2=0x7fba1c1bbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:17.753 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.745 7fba219a2700 1 --2- 172.21.15.22:0/820364321 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fba1c1b5510 0x7fba1c1bbce0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fba1c0a9360 tx=0x7fba14009cc0).stop 2022-04-28T14:39:17.753 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.745 7fba219a2700 1 -- 172.21.15.22:0/820364321 shutdown_connections 2022-04-28T14:39:17.753 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.745 7fba219a2700 1 --2- 172.21.15.22:0/820364321 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fba1c1b5510 0x7fba1c1bbce0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:17.754 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.745 7fba219a2700 1 --2- 172.21.15.22:0/820364321 >> v2:172.21.15.22:3300/0 conn(0x7fba1c1b4a90 0x7fba1c1b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:17.754 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.745 7fba219a2700 1 -- 172.21.15.22:0/820364321 >> 172.21.15.22:0/820364321 conn(0x7fba1c125870 msgr2=0x7fba1c125cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:17.754 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.745 7fba219a2700 1 -- 172.21.15.22:0/820364321 shutdown_connections 2022-04-28T14:39:17.754 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.745 7fba219a2700 1 -- 172.21.15.22:0/820364321 wait complete. 2022-04-28T14:39:17.774 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.769 7fba219a2700 1 Processor -- start 2022-04-28T14:39:17.774 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.769 7fba219a2700 1 -- start start 2022-04-28T14:39:17.776 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.770 7fba219a2700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fba1c0cf5d0 0x7fba1c0db480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:17.777 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.770 7fba219a2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba1c0dbab0 0x7fba1c1c54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:17.777 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.770 7fba219a2700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fba1c0dbf00 0x7fba1c1c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:17.777 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.770 7fba219a2700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c0efd40 con 0x7fba1c0dbab0 2022-04-28T14:39:17.777 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.770 7fba219a2700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c1b5ad0 con 0x7fba1c0dbf00 2022-04-28T14:39:17.777 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.770 7fba219a2700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c0cf130 con 0x7fba1c0cf5d0 2022-04-28T14:39:17.777 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.770 7fba1adc6700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fba1c0dbf00 0x7fba1c1c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:17.777 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.770 7fba19dc4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba1c0dbab0 0x7fba1c1c54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:17.777 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.770 7fba1a5c5700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fba1c0cf5d0 0x7fba1c0db480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:17.778 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.770 7fba19dc4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba1c0dbab0 0x7fba1c1c54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48790/0 (socket says 172.21.15.22:48790) 2022-04-28T14:39:17.778 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.770 7fba1adc6700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fba1c0dbf00 0x7fba1c1c5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46360/0 (socket says 172.21.15.22:46360) 2022-04-28T14:39:17.778 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.770 7fba19dc4700 1 -- 172.21.15.22:0/3286640932 learned_addr learned my addr 172.21.15.22:0/3286640932 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:17.778 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.770 7fba19dc4700 1 -- 172.21.15.22:0/3286640932 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fba1c0cf5d0 msgr2=0x7fba1c0db480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:17.778 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.770 7fba19dc4700 1 --2- 172.21.15.22:0/3286640932 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fba1c0cf5d0 0x7fba1c0db480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:17.778 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.770 7fba19dc4700 1 -- 172.21.15.22:0/3286640932 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fba1c0dbf00 msgr2=0x7fba1c1c5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:17.778 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.770 7fba19dc4700 1 --2- 172.21.15.22:0/3286640932 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fba1c0dbf00 0x7fba1c1c5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:17.778 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.770 7fba19dc4700 1 -- 172.21.15.22:0/3286640932 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1c0cfec0 con 0x7fba1c0dbab0 2022-04-28T14:39:17.778 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.770 7fba1a5c5700 1 --2- 172.21.15.22:0/3286640932 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fba1c0cf5d0 0x7fba1c0db480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:17.779 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.770 7fba19dc4700 1 --2- 172.21.15.22:0/3286640932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba1c0dbab0 0x7fba1c1c54a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fba1c1b5a60 tx=0x7fba1000bf70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:17.779 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.770 7fba0b7fe700 1 -- 172.21.15.22:0/3286640932 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fba1000f040 con 0x7fba1c0dbab0 2022-04-28T14:39:17.779 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.770 7fba0b7fe700 1 -- 172.21.15.22:0/3286640932 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1000c9a0 con 0x7fba1c0dbab0 2022-04-28T14:39:17.779 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.771 7fba219a2700 1 -- 172.21.15.22:0/3286640932 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba1c1c3160 con 0x7fba1c0dbab0 2022-04-28T14:39:17.779 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.771 7fba0b7fe700 1 -- 172.21.15.22:0/3286640932 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fba1000cd70 con 0x7fba1c0dbab0 2022-04-28T14:39:17.779 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.771 7fba219a2700 1 -- 172.21.15.22:0/3286640932 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba1c1bfab0 con 0x7fba1c0dbab0 2022-04-28T14:39:17.779 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.771 7fba0b7fe700 1 -- 172.21.15.22:0/3286640932 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fba10011070 con 0x7fba1c0dbab0 2022-04-28T14:39:17.779 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.771 7fba0b7fe700 1 -- 172.21.15.22:0/3286640932 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fba10010040 con 0x7fba1c0dbab0 2022-04-28T14:39:17.779 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.772 7fba219a2700 1 -- 172.21.15.22:0/3286640932 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba1c0f02c0 con 0x7fba1c0dbab0 2022-04-28T14:39:17.780 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.775 7fba0b7fe700 1 -- 172.21.15.22:0/3286640932 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fba1000c5a0 con 0x7fba1c0dbab0 2022-04-28T14:39:17.899 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.894 7fba219a2700 1 -- 172.21.15.22:0/3286640932 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba1c0f2c90 con 0x7fba1c0dbab0 2022-04-28T14:39:17.899 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.894 7fba0b7fe700 1 -- 172.21.15.22:0/3286640932 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+2263 (secure 0 0 0) 0x7fba1002b8f0 con 0x7fba1c0dbab0 2022-04-28T14:39:17.899 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:17.899 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.22:6818/2291514211","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6818","nonce":2291514211}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-04-28 14:39:13.928436","modified":"2022-04-28 14:39:17.590611","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4184,"mds_1":4198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4184":{"gid":4184,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6819/356491488","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6819","nonce":356491488}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4198":{"gid":4198,"name":"b","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6817/401565232","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6817","nonce":401565232}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-04-28T14:39:17.900 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.895 7fba219a2700 1 -- 172.21.15.22:0/3286640932 >> v1:172.21.15.22:6808/86956 conn(0x7fb9f801c1b0 legacy=0x7fb9f801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:17.901 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.895 7fba219a2700 1 -- 172.21.15.22:0/3286640932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba1c0dbab0 msgr2=0x7fba1c1c54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:17.901 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.895 7fba219a2700 1 --2- 172.21.15.22:0/3286640932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba1c0dbab0 0x7fba1c1c54a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fba1c1b5a60 tx=0x7fba1000bf70).stop 2022-04-28T14:39:17.901 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.895 7fba219a2700 1 -- 172.21.15.22:0/3286640932 shutdown_connections 2022-04-28T14:39:17.901 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.895 7fba219a2700 1 --2- 172.21.15.22:0/3286640932 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fba1c0dbf00 0x7fba1c1c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:17.901 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.895 7fba219a2700 1 --2- 172.21.15.22:0/3286640932 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fba1c0cf5d0 0x7fba1c0db480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:17.901 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.895 7fba219a2700 1 --2- 172.21.15.22:0/3286640932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fba1c0dbab0 0x7fba1c1c54a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:17.901 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.895 7fba219a2700 1 -- 172.21.15.22:0/3286640932 >> 172.21.15.22:0/3286640932 conn(0x7fba1c0d1790 msgr2=0x7fba1c0dde40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:17.901 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.896 7fba219a2700 1 -- 172.21.15.22:0/3286640932 shutdown_connections 2022-04-28T14:39:17.901 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:17.896 7fba219a2700 1 -- 172.21.15.22:0/3286640932 wait complete. 2022-04-28T14:39:17.902 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 9 2022-04-28T14:39:17.911 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-28T14:39:18.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.036 7fe217ea2700 1 Processor -- start 2022-04-28T14:39:18.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.036 7fe217ea2700 1 -- start start 2022-04-28T14:39:18.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.036 7fe217ea2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe2100f6390 0x7fe2100fe970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:18.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.036 7fe217ea2700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe2100fefa0 0x7fe2101b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:18.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.036 7fe217ea2700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2100ab0b0 con 0x7fe2100ff3f0 2022-04-28T14:39:18.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.036 7fe217ea2700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2101b2290 con 0x7fe2100f6390 2022-04-28T14:39:18.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.036 7fe217ea2700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe210115dd0 con 0x7fe2100fefa0 2022-04-28T14:39:18.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.037 7fe20ffff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe2100fefa0 0x7fe2101b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:18.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.037 7fe214ca1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe2100f6390 0x7fe2100fe970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:18.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.037 7fe20ffff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe2100fefa0 0x7fe2101b1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46368/0 (socket says 172.21.15.22:46368) 2022-04-28T14:39:18.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.037 7fe2154a2700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe2100ff3f0 0x7fe2101b1a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38192/0 (socket says 172.21.15.22:38192) 2022-04-28T14:39:18.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.037 7fe20ffff700 1 -- 172.21.15.22:0/1248950534 learned_addr learned my addr 172.21.15.22:0/1248950534 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:18.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.037 7fe20ffff700 1 -- 172.21.15.22:0/1248950534 >> v2:172.21.15.22:3300/0 conn(0x7fe2100f6390 msgr2=0x7fe2100fe970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:18.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.037 7fe20ffff700 1 --2- 172.21.15.22:0/1248950534 >> v2:172.21.15.22:3300/0 conn(0x7fe2100f6390 0x7fe2100fe970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.037 7fe20ffff700 1 -- 172.21.15.22:0/1248950534 >> v1:172.21.15.22:6789/0 conn(0x7fe2100ff3f0 legacy=0x7fe2101b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:18.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.037 7fe20f7fe700 1 -- 172.21.15.22:0/1248950534 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2689263291 0 0) 0x7fe208001490 con 0x7fe2100ff3f0 2022-04-28T14:39:18.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.037 7fe20ffff700 1 -- 172.21.15.22:0/1248950534 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21010b7d0 con 0x7fe2100fefa0 2022-04-28T14:39:18.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.037 7fe20ffff700 1 --2- 172.21.15.22:0/1248950534 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe2100fefa0 0x7fe2101b1460 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe1f8002f70 tx=0x7fe1f80099d0).ready entity=mon.1 client_cookie=6a3f74192ec20f74 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:18.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.037 7fe20f7fe700 1 -- 172.21.15.22:0/1248950534 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe21010b7d0 con 0x7fe2100fefa0 2022-04-28T14:39:18.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.037 7fe20f7fe700 1 -- 172.21.15.22:0/1248950534 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f800f510 con 0x7fe2100fefa0 2022-04-28T14:39:18.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.037 7fe20f7fe700 1 -- 172.21.15.22:0/1248950534 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe1f800f6f0 con 0x7fe2100fefa0 2022-04-28T14:39:18.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.037 7fe217ea2700 1 -- 172.21.15.22:0/1248950534 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe2100fefa0 msgr2=0x7fe2101b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:18.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.037 7fe217ea2700 1 --2- 172.21.15.22:0/1248950534 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe2100fefa0 0x7fe2101b1460 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe1f8002f70 tx=0x7fe1f80099d0).stop 2022-04-28T14:39:18.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.038 7fe217ea2700 1 -- 172.21.15.22:0/1248950534 shutdown_connections 2022-04-28T14:39:18.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.038 7fe217ea2700 1 --2- 172.21.15.22:0/1248950534 >> v2:172.21.15.22:3300/0 conn(0x7fe2100f6390 0x7fe2100fe970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.038 7fe217ea2700 1 --2- 172.21.15.22:0/1248950534 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe2100fefa0 0x7fe2101b1460 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.046 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.038 7fe217ea2700 1 -- 172.21.15.22:0/1248950534 >> 172.21.15.22:0/1248950534 conn(0x7fe210117120 msgr2=0x7fe2100f2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:18.046 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.038 7fe217ea2700 1 -- 172.21.15.22:0/1248950534 shutdown_connections 2022-04-28T14:39:18.046 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.038 7fe217ea2700 1 -- 172.21.15.22:0/1248950534 wait complete. 2022-04-28T14:39:18.066 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.062 7fe217ea2700 1 Processor -- start 2022-04-28T14:39:18.067 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.062 7fe217ea2700 1 -- start start 2022-04-28T14:39:18.069 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.062 7fe217ea2700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe2100b7590 0x7fe2100d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:18.069 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.062 7fe217ea2700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe2100b79e0 0x7fe2100d1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:18.069 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.062 7fe217ea2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2101c2430 0x7fe2101c2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:18.070 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.062 7fe217ea2700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2101c0050 con 0x7fe2101c2430 2022-04-28T14:39:18.070 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.062 7fe217ea2700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2100b6ba0 con 0x7fe2100b79e0 2022-04-28T14:39:18.070 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.062 7fe217ea2700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2100b6ee0 con 0x7fe2100b7590 2022-04-28T14:39:18.070 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.063 7fe214ca1700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe2100b7590 0x7fe2100d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:18.070 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.063 7fe2154a2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2101c2430 0x7fe2101c2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:18.070 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.063 7fe20ffff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe2100b79e0 0x7fe2100d1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:18.070 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.063 7fe214ca1700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe2100b7590 0x7fe2100d0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46154/0 (socket says 172.21.15.22:46154) 2022-04-28T14:39:18.070 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.063 7fe2154a2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2101c2430 0x7fe2101c2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48806/0 (socket says 172.21.15.22:48806) 2022-04-28T14:39:18.070 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.063 7fe20ffff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe2100b79e0 0x7fe2100d1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46372/0 (socket says 172.21.15.22:46372) 2022-04-28T14:39:18.070 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.063 7fe214ca1700 1 -- 172.21.15.22:0/2868954741 learned_addr learned my addr 172.21.15.22:0/2868954741 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:18.071 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.063 7fe2154a2700 1 -- 172.21.15.22:0/2868954741 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe2100b7590 msgr2=0x7fe2100d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:18.071 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.063 7fe2154a2700 1 --2- 172.21.15.22:0/2868954741 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe2100b7590 0x7fe2100d0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.071 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.063 7fe2154a2700 1 -- 172.21.15.22:0/2868954741 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe2100b79e0 msgr2=0x7fe2100d1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:18.071 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.063 7fe2154a2700 1 --2- 172.21.15.22:0/2868954741 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe2100b79e0 0x7fe2100d1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.071 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.063 7fe2154a2700 1 -- 172.21.15.22:0/2868954741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2100ae240 con 0x7fe2101c2430 2022-04-28T14:39:18.071 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.063 7fe214ca1700 1 --2- 172.21.15.22:0/2868954741 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe2100b7590 0x7fe2100d0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:18.071 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.063 7fe20ffff700 1 --2- 172.21.15.22:0/2868954741 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe2100b79e0 0x7fe2100d1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:18.071 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.063 7fe2154a2700 1 --2- 172.21.15.22:0/2868954741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2101c2430 0x7fe2101c2880 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fe208000f40 tx=0x7fe20800c930).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:18.071 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.063 7fe20dffb700 1 -- 172.21.15.22:0/2868954741 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe208005af0 con 0x7fe2101c2430 2022-04-28T14:39:18.072 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.063 7fe20dffb700 1 -- 172.21.15.22:0/2868954741 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe208005cf0 con 0x7fe2101c2430 2022-04-28T14:39:18.072 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.063 7fe217ea2700 1 -- 172.21.15.22:0/2868954741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2100d64e0 con 0x7fe2101c2430 2022-04-28T14:39:18.072 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.063 7fe20dffb700 1 -- 172.21.15.22:0/2868954741 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe2080072c0 con 0x7fe2101c2430 2022-04-28T14:39:18.072 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.063 7fe217ea2700 1 -- 172.21.15.22:0/2868954741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2100d1ac0 con 0x7fe2101c2430 2022-04-28T14:39:18.072 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.064 7fe20dffb700 1 -- 172.21.15.22:0/2868954741 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fe208018020 con 0x7fe2101c2430 2022-04-28T14:39:18.072 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.064 7fe20dffb700 1 -- 172.21.15.22:0/2868954741 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fe20802b7f0 con 0x7fe2101c2430 2022-04-28T14:39:18.072 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.064 7fe217ea2700 1 -- 172.21.15.22:0/2868954741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2100d1d20 con 0x7fe2101c2430 2022-04-28T14:39:18.073 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.067 7fe20dffb700 1 -- 172.21.15.22:0/2868954741 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fe2080058e0 con 0x7fe2101c2430 2022-04-28T14:39:18.169 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.165 7fe217ea2700 1 -- 172.21.15.22:0/2868954741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2100f02c0 con 0x7fe2101c2430 2022-04-28T14:39:18.170 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.165 7fe20dffb700 1 -- 172.21.15.22:0/2868954741 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8815 (secure 0 0 0) 0x7fe2100ffa00 con 0x7fe2101c2430 2022-04-28T14:39:18.170 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:18.170 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":16,"fsid":"3047163a-0285-4058-8e05-ce74c6fbb9c5","created":"2022-04-28 14:38:54.232890","modified":"2022-04-28 14:39:14.929380","last_up_change":"2022-04-28 14:39:00.269721","last_in_change":"2022-04-28 14:39:00.269721","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-04-28 14:39:03.639717","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-04-28 14:39:12.000229","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-04-28 14:39:12.915097","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782ee638-1ada-48d9-9454-f9e0ca8a3135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6800","nonce":87556}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":87556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":87556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":87556}]},"public_addr":"172.21.15.22:6800/87556","cluster_addr":"172.21.15.22:6801/87556","heartbeat_back_addr":"172.21.15.22:6803/87556","heartbeat_front_addr":"172.21.15.22:6802/87556","state":["exists","up"]},{"osd":1,"uuid":"61ca6f96-fb4f-4c0f-b68b-edf1e7011f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":87557}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":87557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":87557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":87557}]},"public_addr":"172.21.15.22:6804/87557","cluster_addr":"172.21.15.22:6805/87557","heartbeat_back_addr":"172.21.15.22:6807/87557","heartbeat_front_addr":"172.21.15.22:6806/87557","state":["exists","up"]},{"osd":2,"uuid":"4b3043b9-50df-4b7f-a55a-ac8e6148c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":87558}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":87558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":87558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":87558}]},"public_addr":"172.21.15.22:6813/87558","cluster_addr":"172.21.15.22:6814/87558","heartbeat_back_addr":"172.21.15.22:6816/87558","heartbeat_front_addr":"172.21.15.22:6815/87558","state":["exists","up"]},{"osd":3,"uuid":"7807bcd1-53f8-44b5-9992-57c328e5b299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":87561}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":87561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":87561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":87561}]},"public_addr":"172.21.15.22:6809/87561","cluster_addr":"172.21.15.22:6810/87561","heartbeat_back_addr":"172.21.15.22:6812/87561","heartbeat_front_addr":"172.21.15.22:6811/87561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-04-28T14:39:18.171 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.166 7fe217ea2700 1 -- 172.21.15.22:0/2868954741 >> v1:172.21.15.22:6808/86956 conn(0x7fe1f401c1b0 legacy=0x7fe1f401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:18.172 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.166 7fe217ea2700 1 -- 172.21.15.22:0/2868954741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2101c2430 msgr2=0x7fe2101c2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:18.172 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.166 7fe217ea2700 1 --2- 172.21.15.22:0/2868954741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2101c2430 0x7fe2101c2880 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fe208000f40 tx=0x7fe20800c930).stop 2022-04-28T14:39:18.172 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.166 7fe217ea2700 1 -- 172.21.15.22:0/2868954741 shutdown_connections 2022-04-28T14:39:18.172 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.166 7fe217ea2700 1 --2- 172.21.15.22:0/2868954741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2101c2430 0x7fe2101c2880 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.172 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.166 7fe217ea2700 1 --2- 172.21.15.22:0/2868954741 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe2100b7590 0x7fe2100d0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.172 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.166 7fe217ea2700 1 --2- 172.21.15.22:0/2868954741 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe2100b79e0 0x7fe2100d1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.172 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.166 7fe217ea2700 1 -- 172.21.15.22:0/2868954741 >> 172.21.15.22:0/2868954741 conn(0x7fe2100bdc10 msgr2=0x7fe210120530 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:18.172 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.166 7fe217ea2700 1 -- 172.21.15.22:0/2868954741 shutdown_connections 2022-04-28T14:39:18.172 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.166 7fe217ea2700 1 -- 172.21.15.22:0/2868954741 wait complete. 2022-04-28T14:39:18.182 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2022-04-28T14:39:18.182 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-04-28T14:39:18.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.307 7f76ebeff700 1 Processor -- start 2022-04-28T14:39:18.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.307 7f76ebeff700 1 -- start start 2022-04-28T14:39:18.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.307 7f76ebeff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f76e40f6300 0x7f76e40f1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:18.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.307 7f76ebeff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f76e40f1970 0x7f76e41b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:18.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.307 7f76ebeff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f76e40f1dc0 0x7f76e41b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:18.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.307 7f76ebeff700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e410ecb0 con 0x7f76e40f1970 2022-04-28T14:39:18.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.307 7f76ebeff700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e410f240 con 0x7f76e40f1dc0 2022-04-28T14:39:18.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.307 7f76ebeff700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76e41151f0 con 0x7f76e40f6300 2022-04-28T14:39:18.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.307 7f76e8cfe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f76e40f6300 0x7f76e40f1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:18.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.307 7f76e3fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f76e40f1970 0x7f76e41b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:18.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.307 7f76e94ff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f76e40f1dc0 0x7f76e41b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:18.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.308 7f76e8cfe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f76e40f6300 0x7f76e40f1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46162/0 (socket says 172.21.15.22:46162) 2022-04-28T14:39:18.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.308 7f76e3fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f76e40f1970 0x7f76e41b46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48810/0 (socket says 172.21.15.22:48810) 2022-04-28T14:39:18.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.308 7f76e8cfe700 1 -- 172.21.15.22:0/1491655788 learned_addr learned my addr 172.21.15.22:0/1491655788 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:18.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.308 7f76e94ff700 1 -- 172.21.15.22:0/1491655788 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f76e40f6300 msgr2=0x7f76e40f1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:18.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.308 7f76e94ff700 1 --2- 172.21.15.22:0/1491655788 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f76e40f6300 0x7f76e40f1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.308 7f76e94ff700 1 -- 172.21.15.22:0/1491655788 >> v2:172.21.15.22:3300/0 conn(0x7f76e40f1970 msgr2=0x7f76e41b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:18.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.308 7f76e94ff700 1 --2- 172.21.15.22:0/1491655788 >> v2:172.21.15.22:3300/0 conn(0x7f76e40f1970 0x7f76e41b46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.308 7f76e94ff700 1 -- 172.21.15.22:0/1491655788 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e41161d0 con 0x7f76e40f1dc0 2022-04-28T14:39:18.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.308 7f76e3fff700 1 --2- 172.21.15.22:0/1491655788 >> v2:172.21.15.22:3300/0 conn(0x7f76e40f1970 0x7f76e41b46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:18.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.308 7f76e8cfe700 1 --2- 172.21.15.22:0/1491655788 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f76e40f6300 0x7f76e40f1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:18.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.308 7f76e94ff700 1 --2- 172.21.15.22:0/1491655788 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f76e40f1dc0 0x7f76e41b4cf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f76e4114d30 tx=0x7f76dc009d70).ready entity=mon.1 client_cookie=da40fdba58a337c6 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:18.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.308 7f76e37fe700 1 -- 172.21.15.22:0/1491655788 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f76e41161d0 con 0x7f76e40f1dc0 2022-04-28T14:39:18.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.308 7f76e37fe700 1 -- 172.21.15.22:0/1491655788 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76dc00b780 con 0x7f76e40f1dc0 2022-04-28T14:39:18.317 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.308 7f76e37fe700 1 -- 172.21.15.22:0/1491655788 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f76dc00b960 con 0x7f76e40f1dc0 2022-04-28T14:39:18.317 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.308 7f76ebeff700 1 -- 172.21.15.22:0/1491655788 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f76e40f1dc0 msgr2=0x7f76e41b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:18.317 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.308 7f76ebeff700 1 --2- 172.21.15.22:0/1491655788 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f76e40f1dc0 0x7f76e41b4cf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f76e4114d30 tx=0x7f76dc009d70).stop 2022-04-28T14:39:18.317 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.309 7f76ebeff700 1 -- 172.21.15.22:0/1491655788 shutdown_connections 2022-04-28T14:39:18.317 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.309 7f76ebeff700 1 --2- 172.21.15.22:0/1491655788 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f76e40f1dc0 0x7f76e41b4cf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.317 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.309 7f76ebeff700 1 --2- 172.21.15.22:0/1491655788 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f76e40f6300 0x7f76e40f1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.317 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.309 7f76ebeff700 1 --2- 172.21.15.22:0/1491655788 >> v2:172.21.15.22:3300/0 conn(0x7f76e40f1970 0x7f76e41b46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.317 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.309 7f76ebeff700 1 -- 172.21.15.22:0/1491655788 >> 172.21.15.22:0/1491655788 conn(0x7f76e41171f0 msgr2=0x7f76e40f2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:18.317 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.309 7f76ebeff700 1 -- 172.21.15.22:0/1491655788 shutdown_connections 2022-04-28T14:39:18.317 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.309 7f76ebeff700 1 -- 172.21.15.22:0/1491655788 wait complete. 2022-04-28T14:39:18.337 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.333 7f76ebeff700 1 Processor -- start 2022-04-28T14:39:18.338 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.333 7f76ebeff700 1 -- start start 2022-04-28T14:39:18.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.333 7f76ebeff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76e41245e0 0x7f76e41c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:18.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.333 7f76ebeff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f76e41c6340 0x7f76e40b0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:18.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.333 7f76ebeff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f76e41c6790 0x7f76e40b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:18.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.333 7f76ebeff700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e4124e40 con 0x7f76e41245e0 2022-04-28T14:39:18.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.333 7f76ebeff700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e40d0a20 con 0x7f76e41c6790 2022-04-28T14:39:18.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.333 7f76ebeff700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76e40b22c0 con 0x7f76e41c6340 2022-04-28T14:39:18.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.334 7f76e3fff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f76e41c6340 0x7f76e40b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:18.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.334 7f76e8cfe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76e41245e0 0x7f76e41c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:18.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.334 7f76e94ff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f76e41c6790 0x7f76e40b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:18.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.334 7f76e8cfe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76e41245e0 0x7f76e41c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48816/0 (socket says 172.21.15.22:48816) 2022-04-28T14:39:18.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.334 7f76e3fff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f76e41c6340 0x7f76e40b0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46170/0 (socket says 172.21.15.22:46170) 2022-04-28T14:39:18.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.334 7f76e8cfe700 1 -- 172.21.15.22:0/1692881079 learned_addr learned my addr 172.21.15.22:0/1692881079 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:18.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.334 7f76e8cfe700 1 -- 172.21.15.22:0/1692881079 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f76e41c6340 msgr2=0x7f76e40b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:18.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.334 7f76e8cfe700 1 --2- 172.21.15.22:0/1692881079 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f76e41c6340 0x7f76e40b0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.334 7f76e8cfe700 1 -- 172.21.15.22:0/1692881079 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f76e41c6790 msgr2=0x7f76e40b15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:18.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.334 7f76e8cfe700 1 --2- 172.21.15.22:0/1692881079 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f76e41c6790 0x7f76e40b15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.334 7f76e8cfe700 1 -- 172.21.15.22:0/1692881079 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e40cff90 con 0x7f76e41245e0 2022-04-28T14:39:18.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.334 7f76e94ff700 1 --2- 172.21.15.22:0/1692881079 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f76e41c6790 0x7f76e40b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:18.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.334 7f76e8cfe700 1 --2- 172.21.15.22:0/1692881079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76e41245e0 0x7f76e41c5d10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f76e40b27b0 tx=0x7f76d800ec50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:18.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.334 7f76e1ffb700 1 -- 172.21.15.22:0/1692881079 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f76e40cff90 con 0x7f76e41245e0 2022-04-28T14:39:18.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.334 7f76e1ffb700 1 -- 172.21.15.22:0/1692881079 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d800c5a0 con 0x7f76e41245e0 2022-04-28T14:39:18.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.334 7f76ebeff700 1 -- 172.21.15.22:0/1692881079 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e4125070 con 0x7f76e41245e0 2022-04-28T14:39:18.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.334 7f76e1ffb700 1 -- 172.21.15.22:0/1692881079 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f76d800f040 con 0x7f76e41245e0 2022-04-28T14:39:18.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.334 7f76ebeff700 1 -- 172.21.15.22:0/1692881079 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e40d0350 con 0x7f76e41245e0 2022-04-28T14:39:18.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.335 7f76e1ffb700 1 -- 172.21.15.22:0/1692881079 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f76d8022060 con 0x7f76e41245e0 2022-04-28T14:39:18.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.335 7f76e1ffb700 1 -- 172.21.15.22:0/1692881079 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f76d8010040 con 0x7f76e41245e0 2022-04-28T14:39:18.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.335 7f76ebeff700 1 -- 172.21.15.22:0/1692881079 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e40a5b80 con 0x7f76e41245e0 2022-04-28T14:39:18.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.338 7f76e1ffb700 1 -- 172.21.15.22:0/1692881079 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f76d800ed90 con 0x7f76e41245e0 2022-04-28T14:39:18.437 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.432 7f76ebeff700 1 -- 172.21.15.22:0/1692881079 --> v1:172.21.15.22:6808/86956 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f76e40b1f90 con 0x7f76cc01c1b0 2022-04-28T14:39:18.445 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.440 7f76e1ffb700 1 -- 172.21.15.22:0/1692881079 <== mgr.4104 v1:172.21.15.22:6808/86956 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306142 (unknown 2965378022 0 3519037275) 0x7f76e40b1f90 con 0x7f76cc01c1b0 2022-04-28T14:39:18.449 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:18.452 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.443 7f76ebeff700 1 -- 172.21.15.22:0/1692881079 >> v1:172.21.15.22:6808/86956 conn(0x7f76cc01c1b0 legacy=0x7f76cc01e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:18.452 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.443 7f76ebeff700 1 -- 172.21.15.22:0/1692881079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76e41245e0 msgr2=0x7f76e41c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:18.452 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.443 7f76ebeff700 1 --2- 172.21.15.22:0/1692881079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76e41245e0 0x7f76e41c5d10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f76e40b27b0 tx=0x7f76d800ec50).stop 2022-04-28T14:39:18.452 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.443 7f76ebeff700 1 -- 172.21.15.22:0/1692881079 shutdown_connections 2022-04-28T14:39:18.452 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.443 7f76ebeff700 1 --2- 172.21.15.22:0/1692881079 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f76e41c6790 0x7f76e40b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.453 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.443 7f76ebeff700 1 --2- 172.21.15.22:0/1692881079 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f76e41245e0 0x7f76e41c5d10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.453 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.443 7f76ebeff700 1 --2- 172.21.15.22:0/1692881079 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f76e41c6340 0x7f76e40b0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.453 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.443 7f76ebeff700 1 -- 172.21.15.22:0/1692881079 >> 172.21.15.22:0/1692881079 conn(0x7f76e40ab5c0 msgr2=0x7f76e40d2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:18.453 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.443 7f76ebeff700 1 -- 172.21.15.22:0/1692881079 shutdown_connections 2022-04-28T14:39:18.453 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.443 7f76ebeff700 1 -- 172.21.15.22:0/1692881079 wait complete. 2022-04-28T14:39:18.453 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2022-04-28T14:39:18.459 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2022-04-28 14:39:18.262597","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":272,"acting":272,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":236,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4194936,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292424,"statfs":{"total":386547056640,"available":382251442176,"internally_reserved":4294967296,"allocated":614400,"data_stored":161054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.952742","last_change":"2022-04-28 14:39:13.943418","last_active":"2022-04-28 14:39:13.952742","last_peered":"2022-04-28 14:39:13.952742","last_clean":"2022-04-28 14:39:13.952742","last_became_active":"2022-04-28 14:39:13.943111","last_became_peered":"2022-04-28 14:39:13.943111","last_unstale":"2022-04-28 14:39:13.952742","last_undegraded":"2022-04-28 14:39:13.952742","last_fullsized":"2022-04-28 14:39:13.952742","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943533","last_change":"2022-04-28 14:39:13.619263","last_active":"2022-04-28 14:39:13.943533","last_peered":"2022-04-28 14:39:13.943533","last_clean":"2022-04-28 14:39:13.943533","last_became_active":"2022-04-28 14:39:13.618911","last_became_peered":"2022-04-28 14:39:13.618911","last_unstale":"2022-04-28 14:39:13.943533","last_undegraded":"2022-04-28 14:39:13.943533","last_fullsized":"2022-04-28 14:39:13.943533","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967103","last_change":"2022-04-28 14:39:13.964730","last_active":"2022-04-28 14:39:13.967103","last_peered":"2022-04-28 14:39:13.967103","last_clean":"2022-04-28 14:39:13.967103","last_became_active":"2022-04-28 14:39:13.964405","last_became_peered":"2022-04-28 14:39:13.964405","last_unstale":"2022-04-28 14:39:13.967103","last_undegraded":"2022-04-28 14:39:13.967103","last_fullsized":"2022-04-28 14:39:13.967103","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.939780","last_change":"2022-04-28 14:39:13.611678","last_active":"2022-04-28 14:39:13.939780","last_peered":"2022-04-28 14:39:13.939780","last_clean":"2022-04-28 14:39:13.939780","last_became_active":"2022-04-28 14:39:13.611166","last_became_peered":"2022-04-28 14:39:13.611166","last_unstale":"2022-04-28 14:39:13.939780","last_undegraded":"2022-04-28 14:39:13.939780","last_fullsized":"2022-04-28 14:39:13.939780","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967673","last_change":"2022-04-28 14:39:13.960149","last_active":"2022-04-28 14:39:13.967673","last_peered":"2022-04-28 14:39:13.967673","last_clean":"2022-04-28 14:39:13.967673","last_became_active":"2022-04-28 14:39:13.959509","last_became_peered":"2022-04-28 14:39:13.959509","last_unstale":"2022-04-28 14:39:13.967673","last_undegraded":"2022-04-28 14:39:13.967673","last_fullsized":"2022-04-28 14:39:13.967673","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.937531","last_change":"2022-04-28 14:39:13.610970","last_active":"2022-04-28 14:39:13.937531","last_peered":"2022-04-28 14:39:13.937531","last_clean":"2022-04-28 14:39:13.937531","last_became_active":"2022-04-28 14:39:13.610661","last_became_peered":"2022-04-28 14:39:13.610661","last_unstale":"2022-04-28 14:39:13.937531","last_undegraded":"2022-04-28 14:39:13.937531","last_fullsized":"2022-04-28 14:39:13.937531","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.964032","last_change":"2022-04-28 14:39:13.963240","last_active":"2022-04-28 14:39:13.964032","last_peered":"2022-04-28 14:39:13.964032","last_clean":"2022-04-28 14:39:13.964032","last_became_active":"2022-04-28 14:39:13.961860","last_became_peered":"2022-04-28 14:39:13.961860","last_unstale":"2022-04-28 14:39:13.964032","last_undegraded":"2022-04-28 14:39:13.964032","last_fullsized":"2022-04-28 14:39:13.964032","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.936595","last_change":"2022-04-28 14:39:13.607628","last_active":"2022-04-28 14:39:13.936595","last_peered":"2022-04-28 14:39:13.936595","last_clean":"2022-04-28 14:39:13.936595","last_became_active":"2022-04-28 14:39:13.607234","last_became_peered":"2022-04-28 14:39:13.607234","last_unstale":"2022-04-28 14:39:13.936595","last_undegraded":"2022-04-28 14:39:13.936595","last_fullsized":"2022-04-28 14:39:13.936595","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.974109","last_change":"2022-04-28 14:39:13.972780","last_active":"2022-04-28 14:39:13.974109","last_peered":"2022-04-28 14:39:13.974109","last_clean":"2022-04-28 14:39:13.974109","last_became_active":"2022-04-28 14:39:13.972189","last_became_peered":"2022-04-28 14:39:13.972189","last_unstale":"2022-04-28 14:39:13.974109","last_undegraded":"2022-04-28 14:39:13.974109","last_fullsized":"2022-04-28 14:39:13.974109","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.941713","last_change":"2022-04-28 14:39:13.615060","last_active":"2022-04-28 14:39:13.941713","last_peered":"2022-04-28 14:39:13.941713","last_clean":"2022-04-28 14:39:13.941713","last_became_active":"2022-04-28 14:39:13.614686","last_became_peered":"2022-04-28 14:39:13.614686","last_unstale":"2022-04-28 14:39:13.941713","last_undegraded":"2022-04-28 14:39:13.941713","last_fullsized":"2022-04-28 14:39:13.941713","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967350","last_change":"2022-04-28 14:39:13.963855","last_active":"2022-04-28 14:39:13.967350","last_peered":"2022-04-28 14:39:13.967350","last_clean":"2022-04-28 14:39:13.967350","last_became_active":"2022-04-28 14:39:13.963518","last_became_peered":"2022-04-28 14:39:13.963518","last_unstale":"2022-04-28 14:39:13.967350","last_undegraded":"2022-04-28 14:39:13.967350","last_fullsized":"2022-04-28 14:39:13.967350","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.949698","last_change":"2022-04-28 14:39:13.623926","last_active":"2022-04-28 14:39:13.949698","last_peered":"2022-04-28 14:39:13.949698","last_clean":"2022-04-28 14:39:13.949698","last_became_active":"2022-04-28 14:39:13.623608","last_became_peered":"2022-04-28 14:39:13.623608","last_unstale":"2022-04-28 14:39:13.949698","last_undegraded":"2022-04-28 14:39:13.949698","last_fullsized":"2022-04-28 14:39:13.949698","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.969853","last_change":"2022-04-28 14:39:13.968270","last_active":"2022-04-28 14:39:13.969853","last_peered":"2022-04-28 14:39:13.969853","last_clean":"2022-04-28 14:39:13.969853","last_became_active":"2022-04-28 14:39:13.967894","last_became_peered":"2022-04-28 14:39:13.967894","last_unstale":"2022-04-28 14:39:13.969853","last_undegraded":"2022-04-28 14:39:13.969853","last_fullsized":"2022-04-28 14:39:13.969853","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.968859","last_change":"2022-04-28 14:39:13.613942","last_active":"2022-04-28 14:39:13.968859","last_peered":"2022-04-28 14:39:13.968859","last_clean":"2022-04-28 14:39:13.968859","last_became_active":"2022-04-28 14:39:13.613151","last_became_peered":"2022-04-28 14:39:13.613151","last_unstale":"2022-04-28 14:39:13.968859","last_undegraded":"2022-04-28 14:39:13.968859","last_fullsized":"2022-04-28 14:39:13.968859","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.974442","last_change":"2022-04-28 14:39:13.972010","last_active":"2022-04-28 14:39:13.974442","last_peered":"2022-04-28 14:39:13.974442","last_clean":"2022-04-28 14:39:13.974442","last_became_active":"2022-04-28 14:39:13.971680","last_became_peered":"2022-04-28 14:39:13.971680","last_unstale":"2022-04-28 14:39:13.974442","last_undegraded":"2022-04-28 14:39:13.974442","last_fullsized":"2022-04-28 14:39:13.974442","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.970613","last_change":"2022-04-28 14:39:13.608578","last_active":"2022-04-28 14:39:13.970613","last_peered":"2022-04-28 14:39:13.970613","last_clean":"2022-04-28 14:39:13.970613","last_became_active":"2022-04-28 14:39:13.608208","last_became_peered":"2022-04-28 14:39:13.608208","last_unstale":"2022-04-28 14:39:13.970613","last_undegraded":"2022-04-28 14:39:13.970613","last_fullsized":"2022-04-28 14:39:13.970613","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.964577","last_change":"2022-04-28 14:39:13.959741","last_active":"2022-04-28 14:39:13.964577","last_peered":"2022-04-28 14:39:13.964577","last_clean":"2022-04-28 14:39:13.964577","last_became_active":"2022-04-28 14:39:13.959445","last_became_peered":"2022-04-28 14:39:13.959445","last_unstale":"2022-04-28 14:39:13.964577","last_undegraded":"2022-04-28 14:39:13.964577","last_fullsized":"2022-04-28 14:39:13.964577","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.971788","last_change":"2022-04-28 14:39:13.615947","last_active":"2022-04-28 14:39:13.971788","last_peered":"2022-04-28 14:39:13.971788","last_clean":"2022-04-28 14:39:13.971788","last_became_active":"2022-04-28 14:39:13.615589","last_became_peered":"2022-04-28 14:39:13.615589","last_unstale":"2022-04-28 14:39:13.971788","last_undegraded":"2022-04-28 14:39:13.971788","last_fullsized":"2022-04-28 14:39:13.971788","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.969361","last_change":"2022-04-28 14:39:13.966950","last_active":"2022-04-28 14:39:13.969361","last_peered":"2022-04-28 14:39:13.969361","last_clean":"2022-04-28 14:39:13.969361","last_became_active":"2022-04-28 14:39:13.961621","last_became_peered":"2022-04-28 14:39:13.961621","last_unstale":"2022-04-28 14:39:13.969361","last_undegraded":"2022-04-28 14:39:13.969361","last_fullsized":"2022-04-28 14:39:13.969361","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.939563","last_change":"2022-04-28 14:39:13.614233","last_active":"2022-04-28 14:39:13.939563","last_peered":"2022-04-28 14:39:13.939563","last_clean":"2022-04-28 14:39:13.939563","last_became_active":"2022-04-28 14:39:13.613890","last_became_peered":"2022-04-28 14:39:13.613890","last_unstale":"2022-04-28 14:39:13.939563","last_undegraded":"2022-04-28 14:39:13.939563","last_fullsized":"2022-04-28 14:39:13.939563","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.963364","last_change":"2022-04-28 14:39:13.953204","last_active":"2022-04-28 14:39:13.963364","last_peered":"2022-04-28 14:39:13.963364","last_clean":"2022-04-28 14:39:13.963364","last_became_active":"2022-04-28 14:39:13.952884","last_became_peered":"2022-04-28 14:39:13.952884","last_unstale":"2022-04-28 14:39:13.963364","last_undegraded":"2022-04-28 14:39:13.963364","last_fullsized":"2022-04-28 14:39:13.963364","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943168","last_change":"2022-04-28 14:39:13.616607","last_active":"2022-04-28 14:39:13.943168","last_peered":"2022-04-28 14:39:13.943168","last_clean":"2022-04-28 14:39:13.943168","last_became_active":"2022-04-28 14:39:13.616264","last_became_peered":"2022-04-28 14:39:13.616264","last_unstale":"2022-04-28 14:39:13.943168","last_undegraded":"2022-04-28 14:39:13.943168","last_fullsized":"2022-04-28 14:39:13.943168","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967596","last_change":"2022-04-28 14:39:13.958559","last_active":"2022-04-28 14:39:13.967596","last_peered":"2022-04-28 14:39:13.967596","last_clean":"2022-04-28 14:39:13.967596","last_became_active":"2022-04-28 14:39:13.958048","last_became_peered":"2022-04-28 14:39:13.958048","last_unstale":"2022-04-28 14:39:13.967596","last_undegraded":"2022-04-28 14:39:13.967596","last_fullsized":"2022-04-28 14:39:13.967596","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.963748","last_change":"2022-04-28 14:39:13.599319","last_active":"2022-04-28 14:39:13.963748","last_peered":"2022-04-28 14:39:13.963748","last_clean":"2022-04-28 14:39:13.963748","last_became_active":"2022-04-28 14:39:13.598926","last_became_peered":"2022-04-28 14:39:13.598926","last_unstale":"2022-04-28 14:39:13.963748","last_undegraded":"2022-04-28 14:39:13.963748","last_fullsized":"2022-04-28 14:39:13.963748","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.957215","last_change":"2022-04-28 14:39:13.953566","last_active":"2022-04-28 14:39:13.957215","last_peered":"2022-04-28 14:39:13.957215","last_clean":"2022-04-28 14:39:13.957215","last_became_active":"2022-04-28 14:39:13.953248","last_became_peered":"2022-04-28 14:39:13.953248","last_unstale":"2022-04-28 14:39:13.957215","last_undegraded":"2022-04-28 14:39:13.957215","last_fullsized":"2022-04-28 14:39:13.957215","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967268","last_change":"2022-04-28 14:39:13.621471","last_active":"2022-04-28 14:39:13.967268","last_peered":"2022-04-28 14:39:13.967268","last_clean":"2022-04-28 14:39:13.967268","last_became_active":"2022-04-28 14:39:13.621155","last_became_peered":"2022-04-28 14:39:13.621155","last_unstale":"2022-04-28 14:39:13.967268","last_undegraded":"2022-04-28 14:39:13.967268","last_fullsized":"2022-04-28 14:39:13.967268","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967331","last_change":"2022-04-28 14:39:13.961895","last_active":"2022-04-28 14:39:13.967331","last_peered":"2022-04-28 14:39:13.967331","last_clean":"2022-04-28 14:39:13.967331","last_became_active":"2022-04-28 14:39:13.961160","last_became_peered":"2022-04-28 14:39:13.961160","last_unstale":"2022-04-28 14:39:13.967331","last_undegraded":"2022-04-28 14:39:13.967331","last_fullsized":"2022-04-28 14:39:13.967331","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.972847","last_change":"2022-04-28 14:39:13.608696","last_active":"2022-04-28 14:39:13.972847","last_peered":"2022-04-28 14:39:13.972847","last_clean":"2022-04-28 14:39:13.972847","last_became_active":"2022-04-28 14:39:13.608335","last_became_peered":"2022-04-28 14:39:13.608335","last_unstale":"2022-04-28 14:39:13.972847","last_undegraded":"2022-04-28 14:39:13.972847","last_fullsized":"2022-04-28 14:39:13.972847","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.964505","last_change":"2022-04-28 14:39:13.959179","last_active":"2022-04-28 14:39:13.964505","last_peered":"2022-04-28 14:39:13.964505","last_clean":"2022-04-28 14:39:13.964505","last_became_active":"2022-04-28 14:39:13.958838","last_became_peered":"2022-04-28 14:39:13.958838","last_unstale":"2022-04-28 14:39:13.964505","last_undegraded":"2022-04-28 14:39:13.964505","last_fullsized":"2022-04-28 14:39:13.964505","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.940753","last_change":"2022-04-28 14:39:13.618291","last_active":"2022-04-28 14:39:13.940753","last_peered":"2022-04-28 14:39:13.940753","last_clean":"2022-04-28 14:39:13.940753","last_became_active":"2022-04-28 14:39:13.617912","last_became_peered":"2022-04-28 14:39:13.617912","last_unstale":"2022-04-28 14:39:13.940753","last_undegraded":"2022-04-28 14:39:13.940753","last_fullsized":"2022-04-28 14:39:13.940753","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.969809","last_change":"2022-04-28 14:39:13.966352","last_active":"2022-04-28 14:39:13.969809","last_peered":"2022-04-28 14:39:13.969809","last_clean":"2022-04-28 14:39:13.969809","last_became_active":"2022-04-28 14:39:13.966039","last_became_peered":"2022-04-28 14:39:13.966039","last_unstale":"2022-04-28 14:39:13.969809","last_undegraded":"2022-04-28 14:39:13.969809","last_fullsized":"2022-04-28 14:39:13.969809","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943346","last_change":"2022-04-28 14:39:13.601416","last_active":"2022-04-28 14:39:13.943346","last_peered":"2022-04-28 14:39:13.943346","last_clean":"2022-04-28 14:39:13.943346","last_became_active":"2022-04-28 14:39:13.601028","last_became_peered":"2022-04-28 14:39:13.601028","last_unstale":"2022-04-28 14:39:13.943346","last_undegraded":"2022-04-28 14:39:13.943346","last_fullsized":"2022-04-28 14:39:13.943346","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.970241","last_change":"2022-04-28 14:39:13.958313","last_active":"2022-04-28 14:39:13.970241","last_peered":"2022-04-28 14:39:13.970241","last_clean":"2022-04-28 14:39:13.970241","last_became_active":"2022-04-28 14:39:13.956853","last_became_peered":"2022-04-28 14:39:13.956853","last_unstale":"2022-04-28 14:39:13.970241","last_undegraded":"2022-04-28 14:39:13.970241","last_fullsized":"2022-04-28 14:39:13.970241","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.960773","last_change":"2022-04-28 14:39:13.613340","last_active":"2022-04-28 14:39:13.960773","last_peered":"2022-04-28 14:39:13.960773","last_clean":"2022-04-28 14:39:13.960773","last_became_active":"2022-04-28 14:39:13.612902","last_became_peered":"2022-04-28 14:39:13.612902","last_unstale":"2022-04-28 14:39:13.960773","last_undegraded":"2022-04-28 14:39:13.960773","last_fullsized":"2022-04-28 14:39:13.960773","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.969340","last_change":"2022-04-28 14:39:13.966772","last_active":"2022-04-28 14:39:13.969340","last_peered":"2022-04-28 14:39:13.969340","last_clean":"2022-04-28 14:39:13.969340","last_became_active":"2022-04-28 14:39:13.961393","last_became_peered":"2022-04-28 14:39:13.961393","last_unstale":"2022-04-28 14:39:13.969340","last_undegraded":"2022-04-28 14:39:13.969340","last_fullsized":"2022-04-28 14:39:13.969340","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.942112","last_change":"2022-04-28 14:39:13.619825","last_active":"2022-04-28 14:39:13.942112","last_peered":"2022-04-28 14:39:13.942112","last_clean":"2022-04-28 14:39:13.942112","last_became_active":"2022-04-28 14:39:13.619514","last_became_peered":"2022-04-28 14:39:13.619514","last_unstale":"2022-04-28 14:39:13.942112","last_undegraded":"2022-04-28 14:39:13.942112","last_fullsized":"2022-04-28 14:39:13.942112","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.957541","last_change":"2022-04-28 14:39:13.956243","last_active":"2022-04-28 14:39:13.957541","last_peered":"2022-04-28 14:39:13.957541","last_clean":"2022-04-28 14:39:13.957541","last_became_active":"2022-04-28 14:39:13.955924","last_became_peered":"2022-04-28 14:39:13.955924","last_unstale":"2022-04-28 14:39:13.957541","last_undegraded":"2022-04-28 14:39:13.957541","last_fullsized":"2022-04-28 14:39:13.957541","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.934839","last_change":"2022-04-28 14:39:13.607250","last_active":"2022-04-28 14:39:13.934839","last_peered":"2022-04-28 14:39:13.934839","last_clean":"2022-04-28 14:39:13.934839","last_became_active":"2022-04-28 14:39:13.606892","last_became_peered":"2022-04-28 14:39:13.606892","last_unstale":"2022-04-28 14:39:13.934839","last_undegraded":"2022-04-28 14:39:13.934839","last_fullsized":"2022-04-28 14:39:13.934839","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967619","last_change":"2022-04-28 14:39:13.958594","last_active":"2022-04-28 14:39:13.967619","last_peered":"2022-04-28 14:39:13.967619","last_clean":"2022-04-28 14:39:13.967619","last_became_active":"2022-04-28 14:39:13.958234","last_became_peered":"2022-04-28 14:39:13.958234","last_unstale":"2022-04-28 14:39:13.967619","last_undegraded":"2022-04-28 14:39:13.967619","last_fullsized":"2022-04-28 14:39:13.967619","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943967","last_change":"2022-04-28 14:39:13.610919","last_active":"2022-04-28 14:39:13.943967","last_peered":"2022-04-28 14:39:13.943967","last_clean":"2022-04-28 14:39:13.943967","last_became_active":"2022-04-28 14:39:13.610535","last_became_peered":"2022-04-28 14:39:13.610535","last_unstale":"2022-04-28 14:39:13.943967","last_undegraded":"2022-04-28 14:39:13.943967","last_fullsized":"2022-04-28 14:39:13.943967","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.970041","last_change":"2022-04-28 14:39:13.968427","last_active":"2022-04-28 14:39:13.970041","last_peered":"2022-04-28 14:39:13.970041","last_clean":"2022-04-28 14:39:13.970041","last_became_active":"2022-04-28 14:39:13.968116","last_became_peered":"2022-04-28 14:39:13.968116","last_unstale":"2022-04-28 14:39:13.970041","last_undegraded":"2022-04-28 14:39:13.970041","last_fullsized":"2022-04-28 14:39:13.970041","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943521","last_change":"2022-04-28 14:39:05.390479","last_active":"2022-04-28 14:39:13.943521","last_peered":"2022-04-28 14:39:13.943521","last_clean":"2022-04-28 14:39:13.943521","last_became_active":"2022-04-28 14:39:05.390111","last_became_peered":"2022-04-28 14:39:05.390111","last_unstale":"2022-04-28 14:39:13.943521","last_undegraded":"2022-04-28 14:39:13.943521","last_fullsized":"2022-04-28 14:39:13.943521","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.941477","last_change":"2022-04-28 14:39:13.610156","last_active":"2022-04-28 14:39:13.941477","last_peered":"2022-04-28 14:39:13.941477","last_clean":"2022-04-28 14:39:13.941477","last_became_active":"2022-04-28 14:39:13.609823","last_became_peered":"2022-04-28 14:39:13.609823","last_unstale":"2022-04-28 14:39:13.941477","last_undegraded":"2022-04-28 14:39:13.941477","last_fullsized":"2022-04-28 14:39:13.941477","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.962538","last_change":"2022-04-28 14:39:13.952310","last_active":"2022-04-28 14:39:13.962538","last_peered":"2022-04-28 14:39:13.962538","last_clean":"2022-04-28 14:39:13.962538","last_became_active":"2022-04-28 14:39:13.951984","last_became_peered":"2022-04-28 14:39:13.951984","last_unstale":"2022-04-28 14:39:13.962538","last_undegraded":"2022-04-28 14:39:13.962538","last_fullsized":"2022-04-28 14:39:13.962538","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.945719","last_change":"2022-04-28 14:39:05.388548","last_active":"2022-04-28 14:39:13.945719","last_peered":"2022-04-28 14:39:13.945719","last_clean":"2022-04-28 14:39:13.945719","last_became_active":"2022-04-28 14:39:05.388215","last_became_peered":"2022-04-28 14:39:05.388215","last_unstale":"2022-04-28 14:39:13.945719","last_undegraded":"2022-04-28 14:39:13.945719","last_fullsized":"2022-04-28 14:39:13.945719","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.971324","last_change":"2022-04-28 14:39:13.627277","last_active":"2022-04-28 14:39:13.971324","last_peered":"2022-04-28 14:39:13.971324","last_clean":"2022-04-28 14:39:13.971324","last_became_active":"2022-04-28 14:39:13.626883","last_became_peered":"2022-04-28 14:39:13.626883","last_unstale":"2022-04-28 14:39:13.971324","last_undegraded":"2022-04-28 14:39:13.971324","last_fullsized":"2022-04-28 14:39:13.971324","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.940615","last_change":"2022-04-28 14:39:05.388784","last_active":"2022-04-28 14:39:13.940615","last_peered":"2022-04-28 14:39:13.940615","last_clean":"2022-04-28 14:39:13.940615","last_became_active":"2022-04-28 14:39:05.388043","last_became_peered":"2022-04-28 14:39:05.388043","last_unstale":"2022-04-28 14:39:13.940615","last_undegraded":"2022-04-28 14:39:13.940615","last_fullsized":"2022-04-28 14:39:13.940615","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.935857","last_change":"2022-04-28 14:39:13.622411","last_active":"2022-04-28 14:39:13.935857","last_peered":"2022-04-28 14:39:13.935857","last_clean":"2022-04-28 14:39:13.935857","last_became_active":"2022-04-28 14:39:13.621590","last_became_peered":"2022-04-28 14:39:13.621590","last_unstale":"2022-04-28 14:39:13.935857","last_undegraded":"2022-04-28 14:39:13.935857","last_fullsized":"2022-04-28 14:39:13.935857","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.963743","last_change":"2022-04-28 14:39:13.955187","last_active":"2022-04-28 14:39:13.963743","last_peered":"2022-04-28 14:39:13.963743","last_clean":"2022-04-28 14:39:13.963743","last_became_active":"2022-04-28 14:39:13.954831","last_became_peered":"2022-04-28 14:39:13.954831","last_unstale":"2022-04-28 14:39:13.963743","last_undegraded":"2022-04-28 14:39:13.963743","last_fullsized":"2022-04-28 14:39:13.963743","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943544","last_change":"2022-04-28 14:39:05.390881","last_active":"2022-04-28 14:39:13.943544","last_peered":"2022-04-28 14:39:13.943544","last_clean":"2022-04-28 14:39:13.943544","last_became_active":"2022-04-28 14:39:05.390559","last_became_peered":"2022-04-28 14:39:05.390559","last_unstale":"2022-04-28 14:39:13.943544","last_undegraded":"2022-04-28 14:39:13.943544","last_fullsized":"2022-04-28 14:39:13.943544","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.935200","last_change":"2022-04-28 14:39:13.608628","last_active":"2022-04-28 14:39:13.935200","last_peered":"2022-04-28 14:39:13.935200","last_clean":"2022-04-28 14:39:13.935200","last_became_active":"2022-04-28 14:39:13.608261","last_became_peered":"2022-04-28 14:39:13.608261","last_unstale":"2022-04-28 14:39:13.935200","last_undegraded":"2022-04-28 14:39:13.935200","last_fullsized":"2022-04-28 14:39:13.935200","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.952043","last_change":"2022-04-28 14:39:13.944110","last_active":"2022-04-28 14:39:13.952043","last_peered":"2022-04-28 14:39:13.952043","last_clean":"2022-04-28 14:39:13.952043","last_became_active":"2022-04-28 14:39:13.943780","last_became_peered":"2022-04-28 14:39:13.943780","last_unstale":"2022-04-28 14:39:13.952043","last_undegraded":"2022-04-28 14:39:13.952043","last_fullsized":"2022-04-28 14:39:13.952043","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.935718","last_change":"2022-04-28 14:39:05.390962","last_active":"2022-04-28 14:39:13.935718","last_peered":"2022-04-28 14:39:13.935718","last_clean":"2022-04-28 14:39:13.935718","last_became_active":"2022-04-28 14:39:05.390602","last_became_peered":"2022-04-28 14:39:05.390602","last_unstale":"2022-04-28 14:39:13.935718","last_undegraded":"2022-04-28 14:39:13.935718","last_fullsized":"2022-04-28 14:39:13.935718","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943104","last_change":"2022-04-28 14:39:13.614524","last_active":"2022-04-28 14:39:13.943104","last_peered":"2022-04-28 14:39:13.943104","last_clean":"2022-04-28 14:39:13.943104","last_became_active":"2022-04-28 14:39:13.614177","last_became_peered":"2022-04-28 14:39:13.614177","last_unstale":"2022-04-28 14:39:13.943104","last_undegraded":"2022-04-28 14:39:13.943104","last_fullsized":"2022-04-28 14:39:13.943104","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.970262","last_change":"2022-04-28 14:39:13.960464","last_active":"2022-04-28 14:39:13.970262","last_peered":"2022-04-28 14:39:13.970262","last_clean":"2022-04-28 14:39:13.970262","last_became_active":"2022-04-28 14:39:13.958817","last_became_peered":"2022-04-28 14:39:13.958817","last_unstale":"2022-04-28 14:39:13.970262","last_undegraded":"2022-04-28 14:39:13.970262","last_fullsized":"2022-04-28 14:39:13.970262","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.937426","last_change":"2022-04-28 14:39:05.389329","last_active":"2022-04-28 14:39:13.937426","last_peered":"2022-04-28 14:39:13.937426","last_clean":"2022-04-28 14:39:13.937426","last_became_active":"2022-04-28 14:39:05.389030","last_became_peered":"2022-04-28 14:39:05.389030","last_unstale":"2022-04-28 14:39:13.937426","last_undegraded":"2022-04-28 14:39:13.937426","last_fullsized":"2022-04-28 14:39:13.937426","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.939667","last_change":"2022-04-28 14:39:13.624225","last_active":"2022-04-28 14:39:13.939667","last_peered":"2022-04-28 14:39:13.939667","last_clean":"2022-04-28 14:39:13.939667","last_became_active":"2022-04-28 14:39:13.623631","last_became_peered":"2022-04-28 14:39:13.623631","last_unstale":"2022-04-28 14:39:13.939667","last_undegraded":"2022-04-28 14:39:13.939667","last_fullsized":"2022-04-28 14:39:13.939667","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.957004","last_change":"2022-04-28 14:39:13.951379","last_active":"2022-04-28 14:39:13.957004","last_peered":"2022-04-28 14:39:13.957004","last_clean":"2022-04-28 14:39:13.957004","last_became_active":"2022-04-28 14:39:13.950657","last_became_peered":"2022-04-28 14:39:13.950657","last_unstale":"2022-04-28 14:39:13.957004","last_undegraded":"2022-04-28 14:39:13.957004","last_fullsized":"2022-04-28 14:39:13.957004","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.947902","last_change":"2022-04-28 14:39:05.388553","last_active":"2022-04-28 14:39:13.947902","last_peered":"2022-04-28 14:39:13.947902","last_clean":"2022-04-28 14:39:13.947902","last_became_active":"2022-04-28 14:39:05.388170","last_became_peered":"2022-04-28 14:39:05.388170","last_unstale":"2022-04-28 14:39:13.947902","last_undegraded":"2022-04-28 14:39:13.947902","last_fullsized":"2022-04-28 14:39:13.947902","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.953366","last_change":"2022-04-28 14:39:13.627446","last_active":"2022-04-28 14:39:13.953366","last_peered":"2022-04-28 14:39:13.953366","last_clean":"2022-04-28 14:39:13.953366","last_became_active":"2022-04-28 14:39:13.627067","last_became_peered":"2022-04-28 14:39:13.627067","last_unstale":"2022-04-28 14:39:13.953366","last_undegraded":"2022-04-28 14:39:13.953366","last_fullsized":"2022-04-28 14:39:13.953366","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.961324","last_change":"2022-04-28 14:39:13.951391","last_active":"2022-04-28 14:39:13.961324","last_peered":"2022-04-28 14:39:13.961324","last_clean":"2022-04-28 14:39:13.961324","last_became_active":"2022-04-28 14:39:13.951063","last_became_peered":"2022-04-28 14:39:13.951063","last_unstale":"2022-04-28 14:39:13.961324","last_undegraded":"2022-04-28 14:39:13.961324","last_fullsized":"2022-04-28 14:39:13.961324","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.941494","last_change":"2022-04-28 14:39:05.388412","last_active":"2022-04-28 14:39:13.941494","last_peered":"2022-04-28 14:39:13.941494","last_clean":"2022-04-28 14:39:13.941494","last_became_active":"2022-04-28 14:39:05.388067","last_became_peered":"2022-04-28 14:39:05.388067","last_unstale":"2022-04-28 14:39:13.941494","last_undegraded":"2022-04-28 14:39:13.941494","last_fullsized":"2022-04-28 14:39:13.941494","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.940916","last_change":"2022-04-28 14:39:13.609546","last_active":"2022-04-28 14:39:13.940916","last_peered":"2022-04-28 14:39:13.940916","last_clean":"2022-04-28 14:39:13.940916","last_became_active":"2022-04-28 14:39:13.609231","last_became_peered":"2022-04-28 14:39:13.609231","last_unstale":"2022-04-28 14:39:13.940916","last_undegraded":"2022-04-28 14:39:13.940916","last_fullsized":"2022-04-28 14:39:13.940916","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.973586","last_change":"2022-04-28 14:39:13.971977","last_active":"2022-04-28 14:39:13.973586","last_peered":"2022-04-28 14:39:13.973586","last_clean":"2022-04-28 14:39:13.973586","last_became_active":"2022-04-28 14:39:13.971343","last_became_peered":"2022-04-28 14:39:13.971343","last_unstale":"2022-04-28 14:39:13.973586","last_undegraded":"2022-04-28 14:39:13.973586","last_fullsized":"2022-04-28 14:39:13.973586","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.974303","last_change":"2022-04-28 14:39:13.970909","last_active":"2022-04-28 14:39:13.974303","last_peered":"2022-04-28 14:39:13.974303","last_clean":"2022-04-28 14:39:13.974303","last_became_active":"2022-04-28 14:39:13.970599","last_became_peered":"2022-04-28 14:39:13.970599","last_unstale":"2022-04-28 14:39:13.974303","last_undegraded":"2022-04-28 14:39:13.974303","last_fullsized":"2022-04-28 14:39:13.974303","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.948934","last_change":"2022-04-28 14:39:13.622383","last_active":"2022-04-28 14:39:13.948934","last_peered":"2022-04-28 14:39:13.948934","last_clean":"2022-04-28 14:39:13.948934","last_became_active":"2022-04-28 14:39:13.620810","last_became_peered":"2022-04-28 14:39:13.620810","last_unstale":"2022-04-28 14:39:13.948934","last_undegraded":"2022-04-28 14:39:13.948934","last_fullsized":"2022-04-28 14:39:13.948934","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.961345","last_change":"2022-04-28 14:39:13.951426","last_active":"2022-04-28 14:39:13.961345","last_peered":"2022-04-28 14:39:13.961345","last_clean":"2022-04-28 14:39:13.961345","last_became_active":"2022-04-28 14:39:13.951111","last_became_peered":"2022-04-28 14:39:13.951111","last_unstale":"2022-04-28 14:39:13.961345","last_undegraded":"2022-04-28 14:39:13.961345","last_fullsized":"2022-04-28 14:39:13.961345","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.964946","last_change":"2022-04-28 14:39:13.622151","last_active":"2022-04-28 14:39:13.964946","last_peered":"2022-04-28 14:39:13.964946","last_clean":"2022-04-28 14:39:13.964946","last_became_active":"2022-04-28 14:39:13.621812","last_became_peered":"2022-04-28 14:39:13.621812","last_unstale":"2022-04-28 14:39:13.964946","last_undegraded":"2022-04-28 14:39:13.964946","last_fullsized":"2022-04-28 14:39:13.964946","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967311","last_change":"2022-04-28 14:39:13.961409","last_active":"2022-04-28 14:39:13.967311","last_peered":"2022-04-28 14:39:13.967311","last_clean":"2022-04-28 14:39:13.967311","last_became_active":"2022-04-28 14:39:13.961034","last_became_peered":"2022-04-28 14:39:13.961034","last_unstale":"2022-04-28 14:39:13.967311","last_undegraded":"2022-04-28 14:39:13.967311","last_fullsized":"2022-04-28 14:39:13.967311","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.970906","last_change":"2022-04-28 14:39:13.627961","last_active":"2022-04-28 14:39:13.970906","last_peered":"2022-04-28 14:39:13.970906","last_clean":"2022-04-28 14:39:13.970906","last_became_active":"2022-04-28 14:39:13.627595","last_became_peered":"2022-04-28 14:39:13.627595","last_unstale":"2022-04-28 14:39:13.970906","last_undegraded":"2022-04-28 14:39:13.970906","last_fullsized":"2022-04-28 14:39:13.970906","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.975440","last_change":"2022-04-28 14:39:13.973251","last_active":"2022-04-28 14:39:13.975440","last_peered":"2022-04-28 14:39:13.975440","last_clean":"2022-04-28 14:39:13.975440","last_became_active":"2022-04-28 14:39:13.973008","last_became_peered":"2022-04-28 14:39:13.973008","last_unstale":"2022-04-28 14:39:13.975440","last_undegraded":"2022-04-28 14:39:13.975440","last_fullsized":"2022-04-28 14:39:13.975440","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.971384","last_change":"2022-04-28 14:39:13.619997","last_active":"2022-04-28 14:39:13.971384","last_peered":"2022-04-28 14:39:13.971384","last_clean":"2022-04-28 14:39:13.971384","last_became_active":"2022-04-28 14:39:13.619739","last_became_peered":"2022-04-28 14:39:13.619739","last_unstale":"2022-04-28 14:39:13.971384","last_undegraded":"2022-04-28 14:39:13.971384","last_fullsized":"2022-04-28 14:39:13.971384","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.949245","last_change":"2022-04-28 14:39:13.944278","last_active":"2022-04-28 14:39:13.949245","last_peered":"2022-04-28 14:39:13.949245","last_clean":"2022-04-28 14:39:13.949245","last_became_active":"2022-04-28 14:39:13.943973","last_became_peered":"2022-04-28 14:39:13.943973","last_unstale":"2022-04-28 14:39:13.949245","last_undegraded":"2022-04-28 14:39:13.949245","last_fullsized":"2022-04-28 14:39:13.949245","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.936304","last_change":"2022-04-28 14:39:13.622598","last_active":"2022-04-28 14:39:13.936304","last_peered":"2022-04-28 14:39:13.936304","last_clean":"2022-04-28 14:39:13.936304","last_became_active":"2022-04-28 14:39:13.622080","last_became_peered":"2022-04-28 14:39:13.622080","last_unstale":"2022-04-28 14:39:13.936304","last_undegraded":"2022-04-28 14:39:13.936304","last_fullsized":"2022-04-28 14:39:13.936304","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.955715","last_change":"2022-04-28 14:39:13.952416","last_active":"2022-04-28 14:39:13.955715","last_peered":"2022-04-28 14:39:13.955715","last_clean":"2022-04-28 14:39:13.955715","last_became_active":"2022-04-28 14:39:13.952100","last_became_peered":"2022-04-28 14:39:13.952100","last_unstale":"2022-04-28 14:39:13.955715","last_undegraded":"2022-04-28 14:39:13.955715","last_fullsized":"2022-04-28 14:39:13.955715","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.935394","last_change":"2022-04-28 14:39:13.602486","last_active":"2022-04-28 14:39:13.935394","last_peered":"2022-04-28 14:39:13.935394","last_clean":"2022-04-28 14:39:13.935394","last_became_active":"2022-04-28 14:39:13.602105","last_became_peered":"2022-04-28 14:39:13.602105","last_unstale":"2022-04-28 14:39:13.935394","last_undegraded":"2022-04-28 14:39:13.935394","last_fullsized":"2022-04-28 14:39:13.935394","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967037","last_change":"2022-04-28 14:39:13.964624","last_active":"2022-04-28 14:39:13.967037","last_peered":"2022-04-28 14:39:13.967037","last_clean":"2022-04-28 14:39:13.967037","last_became_active":"2022-04-28 14:39:13.964305","last_became_peered":"2022-04-28 14:39:13.964305","last_unstale":"2022-04-28 14:39:13.967037","last_undegraded":"2022-04-28 14:39:13.967037","last_fullsized":"2022-04-28 14:39:13.967037","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.939875","last_change":"2022-04-28 14:39:13.624420","last_active":"2022-04-28 14:39:13.939875","last_peered":"2022-04-28 14:39:13.939875","last_clean":"2022-04-28 14:39:13.939875","last_became_active":"2022-04-28 14:39:13.623884","last_became_peered":"2022-04-28 14:39:13.623884","last_unstale":"2022-04-28 14:39:13.939875","last_undegraded":"2022-04-28 14:39:13.939875","last_fullsized":"2022-04-28 14:39:13.939875","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.970283","last_change":"2022-04-28 14:39:13.960655","last_active":"2022-04-28 14:39:13.970283","last_peered":"2022-04-28 14:39:13.970283","last_clean":"2022-04-28 14:39:13.970283","last_became_active":"2022-04-28 14:39:13.960060","last_became_peered":"2022-04-28 14:39:13.960060","last_unstale":"2022-04-28 14:39:13.970283","last_undegraded":"2022-04-28 14:39:13.970283","last_fullsized":"2022-04-28 14:39:13.970283","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943941","last_change":"2022-04-28 14:39:13.624344","last_active":"2022-04-28 14:39:13.943941","last_peered":"2022-04-28 14:39:13.943941","last_clean":"2022-04-28 14:39:13.943941","last_became_active":"2022-04-28 14:39:13.623843","last_became_peered":"2022-04-28 14:39:13.623843","last_unstale":"2022-04-28 14:39:13.943941","last_undegraded":"2022-04-28 14:39:13.943941","last_fullsized":"2022-04-28 14:39:13.943941","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.973468","last_change":"2022-04-28 14:39:13.969259","last_active":"2022-04-28 14:39:13.973468","last_peered":"2022-04-28 14:39:13.973468","last_clean":"2022-04-28 14:39:13.973468","last_became_active":"2022-04-28 14:39:13.968448","last_became_peered":"2022-04-28 14:39:13.968448","last_unstale":"2022-04-28 14:39:13.973468","last_undegraded":"2022-04-28 14:39:13.973468","last_fullsized":"2022-04-28 14:39:13.973468","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.941007","last_change":"2022-04-28 14:39:13.609457","last_active":"2022-04-28 14:39:13.941007","last_peered":"2022-04-28 14:39:13.941007","last_clean":"2022-04-28 14:39:13.941007","last_became_active":"2022-04-28 14:39:13.609114","last_became_peered":"2022-04-28 14:39:13.609114","last_unstale":"2022-04-28 14:39:13.941007","last_undegraded":"2022-04-28 14:39:13.941007","last_fullsized":"2022-04-28 14:39:13.941007","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967821","last_change":"2022-04-28 14:39:13.960837","last_active":"2022-04-28 14:39:13.967821","last_peered":"2022-04-28 14:39:13.967821","last_clean":"2022-04-28 14:39:13.967821","last_became_active":"2022-04-28 14:39:13.960511","last_became_peered":"2022-04-28 14:39:13.960511","last_unstale":"2022-04-28 14:39:13.967821","last_undegraded":"2022-04-28 14:39:13.967821","last_fullsized":"2022-04-28 14:39:13.967821","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943620","last_change":"2022-04-28 14:39:13.600840","last_active":"2022-04-28 14:39:13.943620","last_peered":"2022-04-28 14:39:13.943620","last_clean":"2022-04-28 14:39:13.943620","last_became_active":"2022-04-28 14:39:13.600508","last_became_peered":"2022-04-28 14:39:13.600508","last_unstale":"2022-04-28 14:39:13.943620","last_undegraded":"2022-04-28 14:39:13.943620","last_fullsized":"2022-04-28 14:39:13.943620","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.969866","last_change":"2022-04-28 14:39:13.968364","last_active":"2022-04-28 14:39:13.969866","last_peered":"2022-04-28 14:39:13.969866","last_clean":"2022-04-28 14:39:13.969866","last_became_active":"2022-04-28 14:39:13.968054","last_became_peered":"2022-04-28 14:39:13.968054","last_unstale":"2022-04-28 14:39:13.969866","last_undegraded":"2022-04-28 14:39:13.969866","last_fullsized":"2022-04-28 14:39:13.969866","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:15.552206","last_change":"2022-04-28 14:39:13.623080","last_active":"2022-04-28 14:39:15.552206","last_peered":"2022-04-28 14:39:15.552206","last_clean":"2022-04-28 14:39:15.552206","last_became_active":"2022-04-28 14:39:13.622568","last_became_peered":"2022-04-28 14:39:13.622568","last_unstale":"2022-04-28 14:39:15.552206","last_undegraded":"2022-04-28 14:39:15.552206","last_fullsized":"2022-04-28 14:39:15.552206","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.973674","last_change":"2022-04-28 14:39:13.972567","last_active":"2022-04-28 14:39:13.973674","last_peered":"2022-04-28 14:39:13.973674","last_clean":"2022-04-28 14:39:13.973674","last_became_active":"2022-04-28 14:39:13.972179","last_became_peered":"2022-04-28 14:39:13.972179","last_unstale":"2022-04-28 14:39:13.973674","last_undegraded":"2022-04-28 14:39:13.973674","last_fullsized":"2022-04-28 14:39:13.973674","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.955560","last_change":"2022-04-28 14:39:13.622222","last_active":"2022-04-28 14:39:13.955560","last_peered":"2022-04-28 14:39:13.955560","last_clean":"2022-04-28 14:39:13.955560","last_became_active":"2022-04-28 14:39:13.621872","last_became_peered":"2022-04-28 14:39:13.621872","last_unstale":"2022-04-28 14:39:13.955560","last_undegraded":"2022-04-28 14:39:13.955560","last_fullsized":"2022-04-28 14:39:13.955560","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967571","last_change":"2022-04-28 14:39:13.958395","last_active":"2022-04-28 14:39:13.967571","last_peered":"2022-04-28 14:39:13.967571","last_clean":"2022-04-28 14:39:13.967571","last_became_active":"2022-04-28 14:39:13.957976","last_became_peered":"2022-04-28 14:39:13.957976","last_unstale":"2022-04-28 14:39:13.967571","last_undegraded":"2022-04-28 14:39:13.967571","last_fullsized":"2022-04-28 14:39:13.967571","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.937046","last_change":"2022-04-28 14:39:13.622467","last_active":"2022-04-28 14:39:13.937046","last_peered":"2022-04-28 14:39:13.937046","last_clean":"2022-04-28 14:39:13.937046","last_became_active":"2022-04-28 14:39:13.621838","last_became_peered":"2022-04-28 14:39:13.621838","last_unstale":"2022-04-28 14:39:13.937046","last_undegraded":"2022-04-28 14:39:13.937046","last_fullsized":"2022-04-28 14:39:13.937046","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967649","last_change":"2022-04-28 14:39:13.958646","last_active":"2022-04-28 14:39:13.967649","last_peered":"2022-04-28 14:39:13.967649","last_clean":"2022-04-28 14:39:13.967649","last_became_active":"2022-04-28 14:39:13.957994","last_became_peered":"2022-04-28 14:39:13.957994","last_unstale":"2022-04-28 14:39:13.967649","last_undegraded":"2022-04-28 14:39:13.967649","last_fullsized":"2022-04-28 14:39:13.967649","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.942257","last_change":"2022-04-28 14:39:13.614008","last_active":"2022-04-28 14:39:13.942257","last_peered":"2022-04-28 14:39:13.942257","last_clean":"2022-04-28 14:39:13.942257","last_became_active":"2022-04-28 14:39:13.613702","last_became_peered":"2022-04-28 14:39:13.613702","last_unstale":"2022-04-28 14:39:13.942257","last_undegraded":"2022-04-28 14:39:13.942257","last_fullsized":"2022-04-28 14:39:13.942257","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.956962","last_change":"2022-04-28 14:39:13.950979","last_active":"2022-04-28 14:39:13.956962","last_peered":"2022-04-28 14:39:13.956962","last_clean":"2022-04-28 14:39:13.956962","last_became_active":"2022-04-28 14:39:13.950168","last_became_peered":"2022-04-28 14:39:13.950168","last_unstale":"2022-04-28 14:39:13.956962","last_undegraded":"2022-04-28 14:39:13.956962","last_fullsized":"2022-04-28 14:39:13.956962","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.942015","last_change":"2022-04-28 14:39:13.617031","last_active":"2022-04-28 14:39:13.942015","last_peered":"2022-04-28 14:39:13.942015","last_clean":"2022-04-28 14:39:13.942015","last_became_active":"2022-04-28 14:39:13.615420","last_became_peered":"2022-04-28 14:39:13.615420","last_unstale":"2022-04-28 14:39:13.942015","last_undegraded":"2022-04-28 14:39:13.942015","last_fullsized":"2022-04-28 14:39:13.942015","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.963546","last_change":"2022-04-28 14:39:13.954485","last_active":"2022-04-28 14:39:13.963546","last_peered":"2022-04-28 14:39:13.963546","last_clean":"2022-04-28 14:39:13.963546","last_became_active":"2022-04-28 14:39:13.954179","last_became_peered":"2022-04-28 14:39:13.954179","last_unstale":"2022-04-28 14:39:13.963546","last_undegraded":"2022-04-28 14:39:13.963546","last_fullsized":"2022-04-28 14:39:13.963546","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.970981","last_change":"2022-04-28 14:39:13.608868","last_active":"2022-04-28 14:39:13.970981","last_peered":"2022-04-28 14:39:13.970981","last_clean":"2022-04-28 14:39:13.970981","last_became_active":"2022-04-28 14:39:13.608590","last_became_peered":"2022-04-28 14:39:13.608590","last_unstale":"2022-04-28 14:39:13.970981","last_undegraded":"2022-04-28 14:39:13.970981","last_fullsized":"2022-04-28 14:39:13.970981","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.969788","last_change":"2022-04-28 14:39:13.966189","last_active":"2022-04-28 14:39:13.969788","last_peered":"2022-04-28 14:39:13.969788","last_clean":"2022-04-28 14:39:13.969788","last_became_active":"2022-04-28 14:39:13.965877","last_became_peered":"2022-04-28 14:39:13.965877","last_unstale":"2022-04-28 14:39:13.969788","last_undegraded":"2022-04-28 14:39:13.969788","last_fullsized":"2022-04-28 14:39:13.969788","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943233","last_change":"2022-04-28 14:39:13.601488","last_active":"2022-04-28 14:39:13.943233","last_peered":"2022-04-28 14:39:13.943233","last_clean":"2022-04-28 14:39:13.943233","last_became_active":"2022-04-28 14:39:13.601122","last_became_peered":"2022-04-28 14:39:13.601122","last_unstale":"2022-04-28 14:39:13.943233","last_undegraded":"2022-04-28 14:39:13.943233","last_fullsized":"2022-04-28 14:39:13.943233","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.956513","last_change":"2022-04-28 14:39:13.951897","last_active":"2022-04-28 14:39:13.956513","last_peered":"2022-04-28 14:39:13.956513","last_clean":"2022-04-28 14:39:13.956513","last_became_active":"2022-04-28 14:39:13.951314","last_became_peered":"2022-04-28 14:39:13.951314","last_unstale":"2022-04-28 14:39:13.956513","last_undegraded":"2022-04-28 14:39:13.956513","last_fullsized":"2022-04-28 14:39:13.956513","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.974243","last_change":"2022-04-28 14:39:13.615041","last_active":"2022-04-28 14:39:13.974243","last_peered":"2022-04-28 14:39:13.974243","last_clean":"2022-04-28 14:39:13.974243","last_became_active":"2022-04-28 14:39:13.614710","last_became_peered":"2022-04-28 14:39:13.614710","last_unstale":"2022-04-28 14:39:13.974243","last_undegraded":"2022-04-28 14:39:13.974243","last_fullsized":"2022-04-28 14:39:13.974243","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.975312","last_change":"2022-04-28 14:39:13.971986","last_active":"2022-04-28 14:39:13.975312","last_peered":"2022-04-28 14:39:13.975312","last_clean":"2022-04-28 14:39:13.975312","last_became_active":"2022-04-28 14:39:13.971243","last_became_peered":"2022-04-28 14:39:13.971243","last_unstale":"2022-04-28 14:39:13.975312","last_undegraded":"2022-04-28 14:39:13.975312","last_fullsized":"2022-04-28 14:39:13.975312","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.941578","last_change":"2022-04-28 14:39:13.613362","last_active":"2022-04-28 14:39:13.941578","last_peered":"2022-04-28 14:39:13.941578","last_clean":"2022-04-28 14:39:13.941578","last_became_active":"2022-04-28 14:39:13.612969","last_became_peered":"2022-04-28 14:39:13.612969","last_unstale":"2022-04-28 14:39:13.941578","last_undegraded":"2022-04-28 14:39:13.941578","last_fullsized":"2022-04-28 14:39:13.941578","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.973650","last_change":"2022-04-28 14:39:13.972552","last_active":"2022-04-28 14:39:13.973650","last_peered":"2022-04-28 14:39:13.973650","last_clean":"2022-04-28 14:39:13.973650","last_became_active":"2022-04-28 14:39:13.970887","last_became_peered":"2022-04-28 14:39:13.970887","last_unstale":"2022-04-28 14:39:13.973650","last_undegraded":"2022-04-28 14:39:13.973650","last_fullsized":"2022-04-28 14:39:13.973650","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.955661","last_change":"2022-04-28 14:39:13.628138","last_active":"2022-04-28 14:39:13.955661","last_peered":"2022-04-28 14:39:13.955661","last_clean":"2022-04-28 14:39:13.955661","last_became_active":"2022-04-28 14:39:13.627785","last_became_peered":"2022-04-28 14:39:13.627785","last_unstale":"2022-04-28 14:39:13.955661","last_undegraded":"2022-04-28 14:39:13.955661","last_fullsized":"2022-04-28 14:39:13.955661","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.962842","last_change":"2022-04-28 14:39:13.955799","last_active":"2022-04-28 14:39:13.962842","last_peered":"2022-04-28 14:39:13.962842","last_clean":"2022-04-28 14:39:13.962842","last_became_active":"2022-04-28 14:39:13.955495","last_became_peered":"2022-04-28 14:39:13.955495","last_unstale":"2022-04-28 14:39:13.962842","last_undegraded":"2022-04-28 14:39:13.962842","last_fullsized":"2022-04-28 14:39:13.962842","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.965267","last_change":"2022-04-28 14:39:13.621432","last_active":"2022-04-28 14:39:13.965267","last_peered":"2022-04-28 14:39:13.965267","last_clean":"2022-04-28 14:39:13.965267","last_became_active":"2022-04-28 14:39:13.621080","last_became_peered":"2022-04-28 14:39:13.621080","last_unstale":"2022-04-28 14:39:13.965267","last_undegraded":"2022-04-28 14:39:13.965267","last_fullsized":"2022-04-28 14:39:13.965267","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.957517","last_change":"2022-04-28 14:39:13.956112","last_active":"2022-04-28 14:39:13.957517","last_peered":"2022-04-28 14:39:13.957517","last_clean":"2022-04-28 14:39:13.957517","last_became_active":"2022-04-28 14:39:13.955792","last_became_peered":"2022-04-28 14:39:13.955792","last_unstale":"2022-04-28 14:39:13.957517","last_undegraded":"2022-04-28 14:39:13.957517","last_fullsized":"2022-04-28 14:39:13.957517","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943395","last_change":"2022-04-28 14:39:13.622128","last_active":"2022-04-28 14:39:13.943395","last_peered":"2022-04-28 14:39:13.943395","last_clean":"2022-04-28 14:39:13.943395","last_became_active":"2022-04-28 14:39:13.621790","last_became_peered":"2022-04-28 14:39:13.621790","last_unstale":"2022-04-28 14:39:13.943395","last_undegraded":"2022-04-28 14:39:13.943395","last_fullsized":"2022-04-28 14:39:13.943395","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.969380","last_change":"2022-04-28 14:39:13.967323","last_active":"2022-04-28 14:39:13.969380","last_peered":"2022-04-28 14:39:13.969380","last_clean":"2022-04-28 14:39:13.969380","last_became_active":"2022-04-28 14:39:13.961173","last_became_peered":"2022-04-28 14:39:13.961173","last_unstale":"2022-04-28 14:39:13.969380","last_undegraded":"2022-04-28 14:39:13.969380","last_fullsized":"2022-04-28 14:39:13.969380","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.937877","last_change":"2022-04-28 14:39:13.609625","last_active":"2022-04-28 14:39:13.937877","last_peered":"2022-04-28 14:39:13.937877","last_clean":"2022-04-28 14:39:13.937877","last_became_active":"2022-04-28 14:39:13.609062","last_became_peered":"2022-04-28 14:39:13.609062","last_unstale":"2022-04-28 14:39:13.937877","last_undegraded":"2022-04-28 14:39:13.937877","last_fullsized":"2022-04-28 14:39:13.937877","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.966595","last_change":"2022-04-28 14:39:13.963123","last_active":"2022-04-28 14:39:13.966595","last_peered":"2022-04-28 14:39:13.966595","last_clean":"2022-04-28 14:39:13.966595","last_became_active":"2022-04-28 14:39:13.962825","last_became_peered":"2022-04-28 14:39:13.962825","last_unstale":"2022-04-28 14:39:13.966595","last_undegraded":"2022-04-28 14:39:13.966595","last_fullsized":"2022-04-28 14:39:13.966595","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.959564","last_change":"2022-04-28 14:39:13.603083","last_active":"2022-04-28 14:39:13.959564","last_peered":"2022-04-28 14:39:13.959564","last_clean":"2022-04-28 14:39:13.959564","last_became_active":"2022-04-28 14:39:13.602776","last_became_peered":"2022-04-28 14:39:13.602776","last_unstale":"2022-04-28 14:39:13.959564","last_undegraded":"2022-04-28 14:39:13.959564","last_fullsized":"2022-04-28 14:39:13.959564","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.974419","last_change":"2022-04-28 14:39:13.971833","last_active":"2022-04-28 14:39:13.974419","last_peered":"2022-04-28 14:39:13.974419","last_clean":"2022-04-28 14:39:13.974419","last_became_active":"2022-04-28 14:39:13.971513","last_became_peered":"2022-04-28 14:39:13.971513","last_unstale":"2022-04-28 14:39:13.974419","last_undegraded":"2022-04-28 14:39:13.974419","last_fullsized":"2022-04-28 14:39:13.974419","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.975464","last_change":"2022-04-28 14:39:13.619098","last_active":"2022-04-28 14:39:13.975464","last_peered":"2022-04-28 14:39:13.975464","last_clean":"2022-04-28 14:39:13.975464","last_became_active":"2022-04-28 14:39:13.618737","last_became_peered":"2022-04-28 14:39:13.618737","last_unstale":"2022-04-28 14:39:13.975464","last_undegraded":"2022-04-28 14:39:13.975464","last_fullsized":"2022-04-28 14:39:13.975464","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.956440","last_change":"2022-04-28 14:39:13.951611","last_active":"2022-04-28 14:39:13.956440","last_peered":"2022-04-28 14:39:13.956440","last_clean":"2022-04-28 14:39:13.956440","last_became_active":"2022-04-28 14:39:13.951102","last_became_peered":"2022-04-28 14:39:13.951102","last_unstale":"2022-04-28 14:39:13.956440","last_undegraded":"2022-04-28 14:39:13.956440","last_fullsized":"2022-04-28 14:39:13.956440","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.941816","last_change":"2022-04-28 14:39:13.618476","last_active":"2022-04-28 14:39:13.941816","last_peered":"2022-04-28 14:39:13.941816","last_clean":"2022-04-28 14:39:13.941816","last_became_active":"2022-04-28 14:39:13.617950","last_became_peered":"2022-04-28 14:39:13.617950","last_unstale":"2022-04-28 14:39:13.941816","last_undegraded":"2022-04-28 14:39:13.941816","last_fullsized":"2022-04-28 14:39:13.941816","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.973798","last_change":"2022-04-28 14:39:13.969503","last_active":"2022-04-28 14:39:13.973798","last_peered":"2022-04-28 14:39:13.973798","last_clean":"2022-04-28 14:39:13.973798","last_became_active":"2022-04-28 14:39:13.969200","last_became_peered":"2022-04-28 14:39:13.969200","last_unstale":"2022-04-28 14:39:13.973798","last_undegraded":"2022-04-28 14:39:13.973798","last_fullsized":"2022-04-28 14:39:13.973798","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.941382","last_change":"2022-04-28 14:39:13.613426","last_active":"2022-04-28 14:39:13.941382","last_peered":"2022-04-28 14:39:13.941382","last_clean":"2022-04-28 14:39:13.941382","last_became_active":"2022-04-28 14:39:13.613077","last_became_peered":"2022-04-28 14:39:13.613077","last_unstale":"2022-04-28 14:39:13.941382","last_undegraded":"2022-04-28 14:39:13.941382","last_fullsized":"2022-04-28 14:39:13.941382","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.962551","last_change":"2022-04-28 14:39:13.953772","last_active":"2022-04-28 14:39:13.962551","last_peered":"2022-04-28 14:39:13.962551","last_clean":"2022-04-28 14:39:13.962551","last_became_active":"2022-04-28 14:39:13.953478","last_became_peered":"2022-04-28 14:39:13.953478","last_unstale":"2022-04-28 14:39:13.962551","last_undegraded":"2022-04-28 14:39:13.962551","last_fullsized":"2022-04-28 14:39:13.962551","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.950662","last_change":"2022-04-28 14:39:13.606445","last_active":"2022-04-28 14:39:13.950662","last_peered":"2022-04-28 14:39:13.950662","last_clean":"2022-04-28 14:39:13.950662","last_became_active":"2022-04-28 14:39:13.606028","last_became_peered":"2022-04-28 14:39:13.606028","last_unstale":"2022-04-28 14:39:13.950662","last_undegraded":"2022-04-28 14:39:13.950662","last_fullsized":"2022-04-28 14:39:13.950662","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.956487","last_change":"2022-04-28 14:39:13.951780","last_active":"2022-04-28 14:39:13.956487","last_peered":"2022-04-28 14:39:13.956487","last_clean":"2022-04-28 14:39:13.956487","last_became_active":"2022-04-28 14:39:13.951236","last_became_peered":"2022-04-28 14:39:13.951236","last_unstale":"2022-04-28 14:39:13.956487","last_undegraded":"2022-04-28 14:39:13.956487","last_fullsized":"2022-04-28 14:39:13.956487","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.942534","last_change":"2022-04-28 14:39:13.621466","last_active":"2022-04-28 14:39:13.942534","last_peered":"2022-04-28 14:39:13.942534","last_clean":"2022-04-28 14:39:13.942534","last_became_active":"2022-04-28 14:39:13.621146","last_became_peered":"2022-04-28 14:39:13.621146","last_unstale":"2022-04-28 14:39:13.942534","last_undegraded":"2022-04-28 14:39:13.942534","last_fullsized":"2022-04-28 14:39:13.942534","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967697","last_change":"2022-04-28 14:39:13.960230","last_active":"2022-04-28 14:39:13.967697","last_peered":"2022-04-28 14:39:13.967697","last_clean":"2022-04-28 14:39:13.967697","last_became_active":"2022-04-28 14:39:13.958741","last_became_peered":"2022-04-28 14:39:13.958741","last_unstale":"2022-04-28 14:39:13.967697","last_undegraded":"2022-04-28 14:39:13.967697","last_fullsized":"2022-04-28 14:39:13.967697","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.937051","last_change":"2022-04-28 14:39:13.603448","last_active":"2022-04-28 14:39:13.937051","last_peered":"2022-04-28 14:39:13.937051","last_clean":"2022-04-28 14:39:13.937051","last_became_active":"2022-04-28 14:39:13.603117","last_became_peered":"2022-04-28 14:39:13.603117","last_unstale":"2022-04-28 14:39:13.937051","last_undegraded":"2022-04-28 14:39:13.937051","last_fullsized":"2022-04-28 14:39:13.937051","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.956983","last_change":"2022-04-28 14:39:13.951179","last_active":"2022-04-28 14:39:13.956983","last_peered":"2022-04-28 14:39:13.956983","last_clean":"2022-04-28 14:39:13.956983","last_became_active":"2022-04-28 14:39:13.950413","last_became_peered":"2022-04-28 14:39:13.950413","last_unstale":"2022-04-28 14:39:13.956983","last_undegraded":"2022-04-28 14:39:13.956983","last_fullsized":"2022-04-28 14:39:13.956983","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.972495","last_change":"2022-04-28 14:39:13.609803","last_active":"2022-04-28 14:39:13.972495","last_peered":"2022-04-28 14:39:13.972495","last_clean":"2022-04-28 14:39:13.972495","last_became_active":"2022-04-28 14:39:13.609320","last_became_peered":"2022-04-28 14:39:13.609320","last_unstale":"2022-04-28 14:39:13.972495","last_undegraded":"2022-04-28 14:39:13.972495","last_fullsized":"2022-04-28 14:39:13.972495","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.957157","last_change":"2022-04-28 14:39:13.953322","last_active":"2022-04-28 14:39:13.957157","last_peered":"2022-04-28 14:39:13.957157","last_clean":"2022-04-28 14:39:13.957157","last_became_active":"2022-04-28 14:39:13.952997","last_became_peered":"2022-04-28 14:39:13.952997","last_unstale":"2022-04-28 14:39:13.957157","last_undegraded":"2022-04-28 14:39:13.957157","last_fullsized":"2022-04-28 14:39:13.957157","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.964743","last_change":"2022-04-28 14:39:13.624451","last_active":"2022-04-28 14:39:13.964743","last_peered":"2022-04-28 14:39:13.964743","last_clean":"2022-04-28 14:39:13.964743","last_became_active":"2022-04-28 14:39:13.624118","last_became_peered":"2022-04-28 14:39:13.624118","last_unstale":"2022-04-28 14:39:13.964743","last_undegraded":"2022-04-28 14:39:13.964743","last_fullsized":"2022-04-28 14:39:13.964743","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.962340","last_change":"2022-04-28 14:39:13.956657","last_active":"2022-04-28 14:39:13.962340","last_peered":"2022-04-28 14:39:13.962340","last_clean":"2022-04-28 14:39:13.962340","last_became_active":"2022-04-28 14:39:13.956291","last_became_peered":"2022-04-28 14:39:13.956291","last_unstale":"2022-04-28 14:39:13.962340","last_undegraded":"2022-04-28 14:39:13.962340","last_fullsized":"2022-04-28 14:39:13.962340","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.964761","last_change":"2022-04-28 14:39:13.621131","last_active":"2022-04-28 14:39:13.964761","last_peered":"2022-04-28 14:39:13.964761","last_clean":"2022-04-28 14:39:13.964761","last_became_active":"2022-04-28 14:39:13.620764","last_became_peered":"2022-04-28 14:39:13.620764","last_unstale":"2022-04-28 14:39:13.964761","last_undegraded":"2022-04-28 14:39:13.964761","last_fullsized":"2022-04-28 14:39:13.964761","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.973522","last_change":"2022-04-28 14:39:13.971712","last_active":"2022-04-28 14:39:13.973522","last_peered":"2022-04-28 14:39:13.973522","last_clean":"2022-04-28 14:39:13.973522","last_became_active":"2022-04-28 14:39:13.970627","last_became_peered":"2022-04-28 14:39:13.970627","last_unstale":"2022-04-28 14:39:13.973522","last_undegraded":"2022-04-28 14:39:13.973522","last_fullsized":"2022-04-28 14:39:13.973522","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.941716","last_change":"2022-04-28 14:39:13.618500","last_active":"2022-04-28 14:39:13.941716","last_peered":"2022-04-28 14:39:13.941716","last_clean":"2022-04-28 14:39:13.941716","last_became_active":"2022-04-28 14:39:13.618171","last_became_peered":"2022-04-28 14:39:13.618171","last_unstale":"2022-04-28 14:39:13.941716","last_undegraded":"2022-04-28 14:39:13.941716","last_fullsized":"2022-04-28 14:39:13.941716","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967485","last_change":"2022-04-28 14:39:13.966833","last_active":"2022-04-28 14:39:13.967485","last_peered":"2022-04-28 14:39:13.967485","last_clean":"2022-04-28 14:39:13.967485","last_became_active":"2022-04-28 14:39:13.963563","last_became_peered":"2022-04-28 14:39:13.963563","last_unstale":"2022-04-28 14:39:13.967485","last_undegraded":"2022-04-28 14:39:13.967485","last_fullsized":"2022-04-28 14:39:13.967485","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.950038","last_change":"2022-04-28 14:39:13.622884","last_active":"2022-04-28 14:39:13.950038","last_peered":"2022-04-28 14:39:13.950038","last_clean":"2022-04-28 14:39:13.950038","last_became_active":"2022-04-28 14:39:13.617005","last_became_peered":"2022-04-28 14:39:13.617005","last_unstale":"2022-04-28 14:39:13.950038","last_undegraded":"2022-04-28 14:39:13.950038","last_fullsized":"2022-04-28 14:39:13.950038","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.959924","last_change":"2022-04-28 14:39:13.951972","last_active":"2022-04-28 14:39:13.959924","last_peered":"2022-04-28 14:39:13.959924","last_clean":"2022-04-28 14:39:13.959924","last_became_active":"2022-04-28 14:39:13.951647","last_became_peered":"2022-04-28 14:39:13.951647","last_unstale":"2022-04-28 14:39:13.959924","last_undegraded":"2022-04-28 14:39:13.959924","last_fullsized":"2022-04-28 14:39:13.959924","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.963369","last_change":"2022-04-28 14:39:13.619298","last_active":"2022-04-28 14:39:13.963369","last_peered":"2022-04-28 14:39:13.963369","last_clean":"2022-04-28 14:39:13.963369","last_became_active":"2022-04-28 14:39:13.618948","last_became_peered":"2022-04-28 14:39:13.618948","last_unstale":"2022-04-28 14:39:13.963369","last_undegraded":"2022-04-28 14:39:13.963369","last_fullsized":"2022-04-28 14:39:13.963369","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048744,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323096,"statfs":{"total":96636764160,"available":95562850304,"internally_reserved":1073741824,"allocated":163840,"data_stored":41801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323108,"statfs":{"total":96636764160,"available":95562862592,"internally_reserved":1073741824,"allocated":151552,"data_stored":40785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048728,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323112,"statfs":{"total":96636764160,"available":95562866688,"internally_reserved":1073741824,"allocated":147456,"data_stored":37731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323108,"statfs":{"total":96636764160,"available":95562862592,"internally_reserved":1073741824,"allocated":151552,"data_stored":40737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.185}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.215}]}]}]}} 2022-04-28T14:39:18.500 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-04-28T14:39:18.632 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.627 7f4ec8b8f700 1 Processor -- start 2022-04-28T14:39:18.632 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.627 7f4ec8b8f700 1 -- start start 2022-04-28T14:39:18.634 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.628 7f4ec8b8f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4ec40f62e0 0x7f4ec40f1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:18.634 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.628 7f4ec8b8f700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4ec40f1970 0x7f4ec41b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:18.635 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.628 7f4ec8b8f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec40ab2b0 con 0x7f4ec40f1dc0 2022-04-28T14:39:18.635 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.628 7f4ec8b8f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec410ecb0 con 0x7f4ec40f62e0 2022-04-28T14:39:18.635 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.628 7f4ec8b8f700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec41b54f0 con 0x7f4ec40f1970 2022-04-28T14:39:18.635 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.628 7f4ec104f700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4ec40f1970 0x7f4ec41b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:18.635 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.628 7f4ec104f700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4ec40f1970 0x7f4ec41b46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46178/0 (socket says 172.21.15.22:46178) 2022-04-28T14:39:18.635 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.628 7f4ec104f700 1 -- 172.21.15.22:0/1122357291 learned_addr learned my addr 172.21.15.22:0/1122357291 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:18.635 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.628 7f4ec1850700 1 --2- 172.21.15.22:0/1122357291 >> v2:172.21.15.22:3300/0 conn(0x7f4ec40f62e0 0x7f4ec40f1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:18.635 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.628 7f4ec104f700 1 -- 172.21.15.22:0/1122357291 >> v2:172.21.15.22:3300/0 conn(0x7f4ec40f62e0 msgr2=0x7f4ec40f1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:18.635 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.628 7f4ec104f700 1 --2- 172.21.15.22:0/1122357291 >> v2:172.21.15.22:3300/0 conn(0x7f4ec40f62e0 0x7f4ec40f1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.635 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.628 7f4ec084e700 1 -- 172.21.15.22:0/1122357291 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2459996666 0 0) 0x7f4ebc001490 con 0x7f4ec40f1dc0 2022-04-28T14:39:18.636 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.628 7f4ec104f700 1 -- 172.21.15.22:0/1122357291 >> v1:172.21.15.22:6789/0 conn(0x7f4ec40f1dc0 legacy=0x7f4ec41b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:18.636 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.628 7f4ec104f700 1 -- 172.21.15.22:0/1122357291 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec4116f10 con 0x7f4ec40f1970 2022-04-28T14:39:18.636 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.628 7f4ec104f700 1 --2- 172.21.15.22:0/1122357291 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4ec40f1970 0x7f4ec41b46c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f4eb4002f70 tx=0x7f4eb40099d0).ready entity=mon.2 client_cookie=3567fae3a57375f server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:18.636 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.629 7f4ec084e700 1 -- 172.21.15.22:0/1122357291 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4ec4116f10 con 0x7f4ec40f1970 2022-04-28T14:39:18.636 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.629 7f4ec084e700 1 -- 172.21.15.22:0/1122357291 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb400f510 con 0x7f4ec40f1970 2022-04-28T14:39:18.636 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.629 7f4ec084e700 1 -- 172.21.15.22:0/1122357291 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4eb400f6f0 con 0x7f4ec40f1970 2022-04-28T14:39:18.636 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.629 7f4ec8b8f700 1 -- 172.21.15.22:0/1122357291 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4ec40f1970 msgr2=0x7f4ec41b46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:18.636 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.629 7f4ec8b8f700 1 --2- 172.21.15.22:0/1122357291 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4ec40f1970 0x7f4ec41b46c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f4eb4002f70 tx=0x7f4eb40099d0).stop 2022-04-28T14:39:18.636 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.629 7f4ec8b8f700 1 -- 172.21.15.22:0/1122357291 shutdown_connections 2022-04-28T14:39:18.636 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.629 7f4ec8b8f700 1 --2- 172.21.15.22:0/1122357291 >> v2:172.21.15.22:3300/0 conn(0x7f4ec40f62e0 0x7f4ec40f1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.637 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.629 7f4ec8b8f700 1 --2- 172.21.15.22:0/1122357291 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4ec40f1970 0x7f4ec41b46c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.637 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.629 7f4ec8b8f700 1 -- 172.21.15.22:0/1122357291 >> 172.21.15.22:0/1122357291 conn(0x7f4ec41171f0 msgr2=0x7f4ec40f2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:18.637 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.629 7f4ec8b8f700 1 -- 172.21.15.22:0/1122357291 shutdown_connections 2022-04-28T14:39:18.637 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.629 7f4ec8b8f700 1 -- 172.21.15.22:0/1122357291 wait complete. 2022-04-28T14:39:18.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.653 7f4ec8b8f700 1 Processor -- start 2022-04-28T14:39:18.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.653 7f4ec8b8f700 1 -- start start 2022-04-28T14:39:18.660 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.654 7f4ec8b8f700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4ec40b7120 0x7f4ec40d1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:18.660 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.654 7f4ec8b8f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ec40b7570 0x7f4ec40d2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:18.661 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.654 7f4ec8b8f700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4ec40b7f10 0x7f4ec40b8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:18.661 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.654 7f4ec8b8f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec41b7b80 con 0x7f4ec40b7570 2022-04-28T14:39:18.661 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.654 7f4ec8b8f700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec41b84d0 con 0x7f4ec40b7120 2022-04-28T14:39:18.661 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.654 7f4ec8b8f700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec40b65d0 con 0x7f4ec40b7f10 2022-04-28T14:39:18.661 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.654 7f4ec104f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ec40b7570 0x7f4ec40d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:18.661 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.654 7f4ec2051700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4ec40b7f10 0x7f4ec40b8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:18.661 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.654 7f4ec104f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ec40b7570 0x7f4ec40d2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48832/0 (socket says 172.21.15.22:48832) 2022-04-28T14:39:18.661 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.654 7f4ec104f700 1 -- 172.21.15.22:0/4188382828 learned_addr learned my addr 172.21.15.22:0/4188382828 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:18.661 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.654 7f4ec1850700 1 --2- 172.21.15.22:0/4188382828 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4ec40b7120 0x7f4ec40d1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:18.661 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.654 7f4ec104f700 1 -- 172.21.15.22:0/4188382828 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4ec40b7f10 msgr2=0x7f4ec40b8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:18.662 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.654 7f4ec104f700 1 --2- 172.21.15.22:0/4188382828 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4ec40b7f10 0x7f4ec40b8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.662 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.654 7f4ec104f700 1 -- 172.21.15.22:0/4188382828 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4ec40b7120 msgr2=0x7f4ec40d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:18.662 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.654 7f4ec104f700 1 --2- 172.21.15.22:0/4188382828 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4ec40b7120 0x7f4ec40d1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.662 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.654 7f4ec104f700 1 -- 172.21.15.22:0/4188382828 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec40d2b50 con 0x7f4ec40b7570 2022-04-28T14:39:18.662 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.654 7f4ec2051700 1 --2- 172.21.15.22:0/4188382828 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4ec40b7f10 0x7f4ec40b8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:18.662 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.655 7f4ec104f700 1 --2- 172.21.15.22:0/4188382828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ec40b7570 0x7f4ec40d2520 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f4eb4002f70 tx=0x7f4eb40068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:18.662 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.655 7f4ebaffd700 1 -- 172.21.15.22:0/4188382828 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4ec40d2b50 con 0x7f4ec40b7570 2022-04-28T14:39:18.662 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.655 7f4ebaffd700 1 -- 172.21.15.22:0/4188382828 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb4011760 con 0x7f4ec40b7570 2022-04-28T14:39:18.662 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.655 7f4ec8b8f700 1 -- 172.21.15.22:0/4188382828 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec40b6d00 con 0x7f4ec40b7570 2022-04-28T14:39:18.662 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.655 7f4ebaffd700 1 -- 172.21.15.22:0/4188382828 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4eb4011b30 con 0x7f4ec40b7570 2022-04-28T14:39:18.663 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.655 7f4ec8b8f700 1 -- 172.21.15.22:0/4188382828 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec40b8990 con 0x7f4ec40b7570 2022-04-28T14:39:18.663 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.655 7f4ebaffd700 1 -- 172.21.15.22:0/4188382828 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f4eb4027460 con 0x7f4ec40b7570 2022-04-28T14:39:18.663 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.655 7f4ebaffd700 1 -- 172.21.15.22:0/4188382828 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f4eb4029060 con 0x7f4ec40b7570 2022-04-28T14:39:18.663 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.656 7f4ec8b8f700 1 -- 172.21.15.22:0/4188382828 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec40f0390 con 0x7f4ec40b7570 2022-04-28T14:39:18.663 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.659 7f4ebaffd700 1 -- 172.21.15.22:0/4188382828 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f4eb4011550 con 0x7f4ec40b7570 2022-04-28T14:39:18.756 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.752 7f4ec8b8f700 1 -- 172.21.15.22:0/4188382828 --> v1:172.21.15.22:6808/86956 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f4ec40b7aa0 con 0x7f4ea801c1b0 2022-04-28T14:39:18.764 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.759 7f4ebaffd700 1 -- 172.21.15.22:0/4188382828 <== mgr.4104 v1:172.21.15.22:6808/86956 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306142 (unknown 2965378022 0 3519037275) 0x7f4ec40b7aa0 con 0x7f4ea801c1b0 2022-04-28T14:39:18.768 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:18.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.762 7f4ec8b8f700 1 -- 172.21.15.22:0/4188382828 >> v1:172.21.15.22:6808/86956 conn(0x7f4ea801c1b0 legacy=0x7f4ea801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:18.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.762 7f4ec8b8f700 1 -- 172.21.15.22:0/4188382828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ec40b7570 msgr2=0x7f4ec40d2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:18.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.762 7f4ec8b8f700 1 --2- 172.21.15.22:0/4188382828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ec40b7570 0x7f4ec40d2520 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f4eb4002f70 tx=0x7f4eb40068c0).stop 2022-04-28T14:39:18.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.762 7f4ec8b8f700 1 -- 172.21.15.22:0/4188382828 shutdown_connections 2022-04-28T14:39:18.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.762 7f4ec8b8f700 1 --2- 172.21.15.22:0/4188382828 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4ec40b7f10 0x7f4ec40b8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.762 7f4ec8b8f700 1 --2- 172.21.15.22:0/4188382828 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4ec40b7120 0x7f4ec40d1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.762 7f4ec8b8f700 1 --2- 172.21.15.22:0/4188382828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ec40b7570 0x7f4ec40d2520 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.762 7f4ec8b8f700 1 -- 172.21.15.22:0/4188382828 >> 172.21.15.22:0/4188382828 conn(0x7f4ec40d6010 msgr2=0x7f4ec4123920 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:18.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.762 7f4ec8b8f700 1 -- 172.21.15.22:0/4188382828 shutdown_connections 2022-04-28T14:39:18.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.762 7f4ec8b8f700 1 -- 172.21.15.22:0/4188382828 wait complete. 2022-04-28T14:39:18.771 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2022-04-28T14:39:18.777 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2022-04-28 14:39:18.262597","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":272,"acting":272,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":236,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4194936,"kb_used_data":600,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292424,"statfs":{"total":386547056640,"available":382251442176,"internally_reserved":4294967296,"allocated":614400,"data_stored":161054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.952742","last_change":"2022-04-28 14:39:13.943418","last_active":"2022-04-28 14:39:13.952742","last_peered":"2022-04-28 14:39:13.952742","last_clean":"2022-04-28 14:39:13.952742","last_became_active":"2022-04-28 14:39:13.943111","last_became_peered":"2022-04-28 14:39:13.943111","last_unstale":"2022-04-28 14:39:13.952742","last_undegraded":"2022-04-28 14:39:13.952742","last_fullsized":"2022-04-28 14:39:13.952742","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943533","last_change":"2022-04-28 14:39:13.619263","last_active":"2022-04-28 14:39:13.943533","last_peered":"2022-04-28 14:39:13.943533","last_clean":"2022-04-28 14:39:13.943533","last_became_active":"2022-04-28 14:39:13.618911","last_became_peered":"2022-04-28 14:39:13.618911","last_unstale":"2022-04-28 14:39:13.943533","last_undegraded":"2022-04-28 14:39:13.943533","last_fullsized":"2022-04-28 14:39:13.943533","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967103","last_change":"2022-04-28 14:39:13.964730","last_active":"2022-04-28 14:39:13.967103","last_peered":"2022-04-28 14:39:13.967103","last_clean":"2022-04-28 14:39:13.967103","last_became_active":"2022-04-28 14:39:13.964405","last_became_peered":"2022-04-28 14:39:13.964405","last_unstale":"2022-04-28 14:39:13.967103","last_undegraded":"2022-04-28 14:39:13.967103","last_fullsized":"2022-04-28 14:39:13.967103","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.939780","last_change":"2022-04-28 14:39:13.611678","last_active":"2022-04-28 14:39:13.939780","last_peered":"2022-04-28 14:39:13.939780","last_clean":"2022-04-28 14:39:13.939780","last_became_active":"2022-04-28 14:39:13.611166","last_became_peered":"2022-04-28 14:39:13.611166","last_unstale":"2022-04-28 14:39:13.939780","last_undegraded":"2022-04-28 14:39:13.939780","last_fullsized":"2022-04-28 14:39:13.939780","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967673","last_change":"2022-04-28 14:39:13.960149","last_active":"2022-04-28 14:39:13.967673","last_peered":"2022-04-28 14:39:13.967673","last_clean":"2022-04-28 14:39:13.967673","last_became_active":"2022-04-28 14:39:13.959509","last_became_peered":"2022-04-28 14:39:13.959509","last_unstale":"2022-04-28 14:39:13.967673","last_undegraded":"2022-04-28 14:39:13.967673","last_fullsized":"2022-04-28 14:39:13.967673","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.937531","last_change":"2022-04-28 14:39:13.610970","last_active":"2022-04-28 14:39:13.937531","last_peered":"2022-04-28 14:39:13.937531","last_clean":"2022-04-28 14:39:13.937531","last_became_active":"2022-04-28 14:39:13.610661","last_became_peered":"2022-04-28 14:39:13.610661","last_unstale":"2022-04-28 14:39:13.937531","last_undegraded":"2022-04-28 14:39:13.937531","last_fullsized":"2022-04-28 14:39:13.937531","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.964032","last_change":"2022-04-28 14:39:13.963240","last_active":"2022-04-28 14:39:13.964032","last_peered":"2022-04-28 14:39:13.964032","last_clean":"2022-04-28 14:39:13.964032","last_became_active":"2022-04-28 14:39:13.961860","last_became_peered":"2022-04-28 14:39:13.961860","last_unstale":"2022-04-28 14:39:13.964032","last_undegraded":"2022-04-28 14:39:13.964032","last_fullsized":"2022-04-28 14:39:13.964032","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.936595","last_change":"2022-04-28 14:39:13.607628","last_active":"2022-04-28 14:39:13.936595","last_peered":"2022-04-28 14:39:13.936595","last_clean":"2022-04-28 14:39:13.936595","last_became_active":"2022-04-28 14:39:13.607234","last_became_peered":"2022-04-28 14:39:13.607234","last_unstale":"2022-04-28 14:39:13.936595","last_undegraded":"2022-04-28 14:39:13.936595","last_fullsized":"2022-04-28 14:39:13.936595","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.974109","last_change":"2022-04-28 14:39:13.972780","last_active":"2022-04-28 14:39:13.974109","last_peered":"2022-04-28 14:39:13.974109","last_clean":"2022-04-28 14:39:13.974109","last_became_active":"2022-04-28 14:39:13.972189","last_became_peered":"2022-04-28 14:39:13.972189","last_unstale":"2022-04-28 14:39:13.974109","last_undegraded":"2022-04-28 14:39:13.974109","last_fullsized":"2022-04-28 14:39:13.974109","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.941713","last_change":"2022-04-28 14:39:13.615060","last_active":"2022-04-28 14:39:13.941713","last_peered":"2022-04-28 14:39:13.941713","last_clean":"2022-04-28 14:39:13.941713","last_became_active":"2022-04-28 14:39:13.614686","last_became_peered":"2022-04-28 14:39:13.614686","last_unstale":"2022-04-28 14:39:13.941713","last_undegraded":"2022-04-28 14:39:13.941713","last_fullsized":"2022-04-28 14:39:13.941713","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967350","last_change":"2022-04-28 14:39:13.963855","last_active":"2022-04-28 14:39:13.967350","last_peered":"2022-04-28 14:39:13.967350","last_clean":"2022-04-28 14:39:13.967350","last_became_active":"2022-04-28 14:39:13.963518","last_became_peered":"2022-04-28 14:39:13.963518","last_unstale":"2022-04-28 14:39:13.967350","last_undegraded":"2022-04-28 14:39:13.967350","last_fullsized":"2022-04-28 14:39:13.967350","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.949698","last_change":"2022-04-28 14:39:13.623926","last_active":"2022-04-28 14:39:13.949698","last_peered":"2022-04-28 14:39:13.949698","last_clean":"2022-04-28 14:39:13.949698","last_became_active":"2022-04-28 14:39:13.623608","last_became_peered":"2022-04-28 14:39:13.623608","last_unstale":"2022-04-28 14:39:13.949698","last_undegraded":"2022-04-28 14:39:13.949698","last_fullsized":"2022-04-28 14:39:13.949698","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.969853","last_change":"2022-04-28 14:39:13.968270","last_active":"2022-04-28 14:39:13.969853","last_peered":"2022-04-28 14:39:13.969853","last_clean":"2022-04-28 14:39:13.969853","last_became_active":"2022-04-28 14:39:13.967894","last_became_peered":"2022-04-28 14:39:13.967894","last_unstale":"2022-04-28 14:39:13.969853","last_undegraded":"2022-04-28 14:39:13.969853","last_fullsized":"2022-04-28 14:39:13.969853","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.968859","last_change":"2022-04-28 14:39:13.613942","last_active":"2022-04-28 14:39:13.968859","last_peered":"2022-04-28 14:39:13.968859","last_clean":"2022-04-28 14:39:13.968859","last_became_active":"2022-04-28 14:39:13.613151","last_became_peered":"2022-04-28 14:39:13.613151","last_unstale":"2022-04-28 14:39:13.968859","last_undegraded":"2022-04-28 14:39:13.968859","last_fullsized":"2022-04-28 14:39:13.968859","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.974442","last_change":"2022-04-28 14:39:13.972010","last_active":"2022-04-28 14:39:13.974442","last_peered":"2022-04-28 14:39:13.974442","last_clean":"2022-04-28 14:39:13.974442","last_became_active":"2022-04-28 14:39:13.971680","last_became_peered":"2022-04-28 14:39:13.971680","last_unstale":"2022-04-28 14:39:13.974442","last_undegraded":"2022-04-28 14:39:13.974442","last_fullsized":"2022-04-28 14:39:13.974442","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.970613","last_change":"2022-04-28 14:39:13.608578","last_active":"2022-04-28 14:39:13.970613","last_peered":"2022-04-28 14:39:13.970613","last_clean":"2022-04-28 14:39:13.970613","last_became_active":"2022-04-28 14:39:13.608208","last_became_peered":"2022-04-28 14:39:13.608208","last_unstale":"2022-04-28 14:39:13.970613","last_undegraded":"2022-04-28 14:39:13.970613","last_fullsized":"2022-04-28 14:39:13.970613","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.964577","last_change":"2022-04-28 14:39:13.959741","last_active":"2022-04-28 14:39:13.964577","last_peered":"2022-04-28 14:39:13.964577","last_clean":"2022-04-28 14:39:13.964577","last_became_active":"2022-04-28 14:39:13.959445","last_became_peered":"2022-04-28 14:39:13.959445","last_unstale":"2022-04-28 14:39:13.964577","last_undegraded":"2022-04-28 14:39:13.964577","last_fullsized":"2022-04-28 14:39:13.964577","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.971788","last_change":"2022-04-28 14:39:13.615947","last_active":"2022-04-28 14:39:13.971788","last_peered":"2022-04-28 14:39:13.971788","last_clean":"2022-04-28 14:39:13.971788","last_became_active":"2022-04-28 14:39:13.615589","last_became_peered":"2022-04-28 14:39:13.615589","last_unstale":"2022-04-28 14:39:13.971788","last_undegraded":"2022-04-28 14:39:13.971788","last_fullsized":"2022-04-28 14:39:13.971788","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.969361","last_change":"2022-04-28 14:39:13.966950","last_active":"2022-04-28 14:39:13.969361","last_peered":"2022-04-28 14:39:13.969361","last_clean":"2022-04-28 14:39:13.969361","last_became_active":"2022-04-28 14:39:13.961621","last_became_peered":"2022-04-28 14:39:13.961621","last_unstale":"2022-04-28 14:39:13.969361","last_undegraded":"2022-04-28 14:39:13.969361","last_fullsized":"2022-04-28 14:39:13.969361","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.939563","last_change":"2022-04-28 14:39:13.614233","last_active":"2022-04-28 14:39:13.939563","last_peered":"2022-04-28 14:39:13.939563","last_clean":"2022-04-28 14:39:13.939563","last_became_active":"2022-04-28 14:39:13.613890","last_became_peered":"2022-04-28 14:39:13.613890","last_unstale":"2022-04-28 14:39:13.939563","last_undegraded":"2022-04-28 14:39:13.939563","last_fullsized":"2022-04-28 14:39:13.939563","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.963364","last_change":"2022-04-28 14:39:13.953204","last_active":"2022-04-28 14:39:13.963364","last_peered":"2022-04-28 14:39:13.963364","last_clean":"2022-04-28 14:39:13.963364","last_became_active":"2022-04-28 14:39:13.952884","last_became_peered":"2022-04-28 14:39:13.952884","last_unstale":"2022-04-28 14:39:13.963364","last_undegraded":"2022-04-28 14:39:13.963364","last_fullsized":"2022-04-28 14:39:13.963364","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943168","last_change":"2022-04-28 14:39:13.616607","last_active":"2022-04-28 14:39:13.943168","last_peered":"2022-04-28 14:39:13.943168","last_clean":"2022-04-28 14:39:13.943168","last_became_active":"2022-04-28 14:39:13.616264","last_became_peered":"2022-04-28 14:39:13.616264","last_unstale":"2022-04-28 14:39:13.943168","last_undegraded":"2022-04-28 14:39:13.943168","last_fullsized":"2022-04-28 14:39:13.943168","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967596","last_change":"2022-04-28 14:39:13.958559","last_active":"2022-04-28 14:39:13.967596","last_peered":"2022-04-28 14:39:13.967596","last_clean":"2022-04-28 14:39:13.967596","last_became_active":"2022-04-28 14:39:13.958048","last_became_peered":"2022-04-28 14:39:13.958048","last_unstale":"2022-04-28 14:39:13.967596","last_undegraded":"2022-04-28 14:39:13.967596","last_fullsized":"2022-04-28 14:39:13.967596","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.963748","last_change":"2022-04-28 14:39:13.599319","last_active":"2022-04-28 14:39:13.963748","last_peered":"2022-04-28 14:39:13.963748","last_clean":"2022-04-28 14:39:13.963748","last_became_active":"2022-04-28 14:39:13.598926","last_became_peered":"2022-04-28 14:39:13.598926","last_unstale":"2022-04-28 14:39:13.963748","last_undegraded":"2022-04-28 14:39:13.963748","last_fullsized":"2022-04-28 14:39:13.963748","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.957215","last_change":"2022-04-28 14:39:13.953566","last_active":"2022-04-28 14:39:13.957215","last_peered":"2022-04-28 14:39:13.957215","last_clean":"2022-04-28 14:39:13.957215","last_became_active":"2022-04-28 14:39:13.953248","last_became_peered":"2022-04-28 14:39:13.953248","last_unstale":"2022-04-28 14:39:13.957215","last_undegraded":"2022-04-28 14:39:13.957215","last_fullsized":"2022-04-28 14:39:13.957215","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967268","last_change":"2022-04-28 14:39:13.621471","last_active":"2022-04-28 14:39:13.967268","last_peered":"2022-04-28 14:39:13.967268","last_clean":"2022-04-28 14:39:13.967268","last_became_active":"2022-04-28 14:39:13.621155","last_became_peered":"2022-04-28 14:39:13.621155","last_unstale":"2022-04-28 14:39:13.967268","last_undegraded":"2022-04-28 14:39:13.967268","last_fullsized":"2022-04-28 14:39:13.967268","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967331","last_change":"2022-04-28 14:39:13.961895","last_active":"2022-04-28 14:39:13.967331","last_peered":"2022-04-28 14:39:13.967331","last_clean":"2022-04-28 14:39:13.967331","last_became_active":"2022-04-28 14:39:13.961160","last_became_peered":"2022-04-28 14:39:13.961160","last_unstale":"2022-04-28 14:39:13.967331","last_undegraded":"2022-04-28 14:39:13.967331","last_fullsized":"2022-04-28 14:39:13.967331","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.972847","last_change":"2022-04-28 14:39:13.608696","last_active":"2022-04-28 14:39:13.972847","last_peered":"2022-04-28 14:39:13.972847","last_clean":"2022-04-28 14:39:13.972847","last_became_active":"2022-04-28 14:39:13.608335","last_became_peered":"2022-04-28 14:39:13.608335","last_unstale":"2022-04-28 14:39:13.972847","last_undegraded":"2022-04-28 14:39:13.972847","last_fullsized":"2022-04-28 14:39:13.972847","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.964505","last_change":"2022-04-28 14:39:13.959179","last_active":"2022-04-28 14:39:13.964505","last_peered":"2022-04-28 14:39:13.964505","last_clean":"2022-04-28 14:39:13.964505","last_became_active":"2022-04-28 14:39:13.958838","last_became_peered":"2022-04-28 14:39:13.958838","last_unstale":"2022-04-28 14:39:13.964505","last_undegraded":"2022-04-28 14:39:13.964505","last_fullsized":"2022-04-28 14:39:13.964505","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.940753","last_change":"2022-04-28 14:39:13.618291","last_active":"2022-04-28 14:39:13.940753","last_peered":"2022-04-28 14:39:13.940753","last_clean":"2022-04-28 14:39:13.940753","last_became_active":"2022-04-28 14:39:13.617912","last_became_peered":"2022-04-28 14:39:13.617912","last_unstale":"2022-04-28 14:39:13.940753","last_undegraded":"2022-04-28 14:39:13.940753","last_fullsized":"2022-04-28 14:39:13.940753","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.969809","last_change":"2022-04-28 14:39:13.966352","last_active":"2022-04-28 14:39:13.969809","last_peered":"2022-04-28 14:39:13.969809","last_clean":"2022-04-28 14:39:13.969809","last_became_active":"2022-04-28 14:39:13.966039","last_became_peered":"2022-04-28 14:39:13.966039","last_unstale":"2022-04-28 14:39:13.969809","last_undegraded":"2022-04-28 14:39:13.969809","last_fullsized":"2022-04-28 14:39:13.969809","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943346","last_change":"2022-04-28 14:39:13.601416","last_active":"2022-04-28 14:39:13.943346","last_peered":"2022-04-28 14:39:13.943346","last_clean":"2022-04-28 14:39:13.943346","last_became_active":"2022-04-28 14:39:13.601028","last_became_peered":"2022-04-28 14:39:13.601028","last_unstale":"2022-04-28 14:39:13.943346","last_undegraded":"2022-04-28 14:39:13.943346","last_fullsized":"2022-04-28 14:39:13.943346","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.970241","last_change":"2022-04-28 14:39:13.958313","last_active":"2022-04-28 14:39:13.970241","last_peered":"2022-04-28 14:39:13.970241","last_clean":"2022-04-28 14:39:13.970241","last_became_active":"2022-04-28 14:39:13.956853","last_became_peered":"2022-04-28 14:39:13.956853","last_unstale":"2022-04-28 14:39:13.970241","last_undegraded":"2022-04-28 14:39:13.970241","last_fullsized":"2022-04-28 14:39:13.970241","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.960773","last_change":"2022-04-28 14:39:13.613340","last_active":"2022-04-28 14:39:13.960773","last_peered":"2022-04-28 14:39:13.960773","last_clean":"2022-04-28 14:39:13.960773","last_became_active":"2022-04-28 14:39:13.612902","last_became_peered":"2022-04-28 14:39:13.612902","last_unstale":"2022-04-28 14:39:13.960773","last_undegraded":"2022-04-28 14:39:13.960773","last_fullsized":"2022-04-28 14:39:13.960773","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.969340","last_change":"2022-04-28 14:39:13.966772","last_active":"2022-04-28 14:39:13.969340","last_peered":"2022-04-28 14:39:13.969340","last_clean":"2022-04-28 14:39:13.969340","last_became_active":"2022-04-28 14:39:13.961393","last_became_peered":"2022-04-28 14:39:13.961393","last_unstale":"2022-04-28 14:39:13.969340","last_undegraded":"2022-04-28 14:39:13.969340","last_fullsized":"2022-04-28 14:39:13.969340","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.942112","last_change":"2022-04-28 14:39:13.619825","last_active":"2022-04-28 14:39:13.942112","last_peered":"2022-04-28 14:39:13.942112","last_clean":"2022-04-28 14:39:13.942112","last_became_active":"2022-04-28 14:39:13.619514","last_became_peered":"2022-04-28 14:39:13.619514","last_unstale":"2022-04-28 14:39:13.942112","last_undegraded":"2022-04-28 14:39:13.942112","last_fullsized":"2022-04-28 14:39:13.942112","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.957541","last_change":"2022-04-28 14:39:13.956243","last_active":"2022-04-28 14:39:13.957541","last_peered":"2022-04-28 14:39:13.957541","last_clean":"2022-04-28 14:39:13.957541","last_became_active":"2022-04-28 14:39:13.955924","last_became_peered":"2022-04-28 14:39:13.955924","last_unstale":"2022-04-28 14:39:13.957541","last_undegraded":"2022-04-28 14:39:13.957541","last_fullsized":"2022-04-28 14:39:13.957541","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.934839","last_change":"2022-04-28 14:39:13.607250","last_active":"2022-04-28 14:39:13.934839","last_peered":"2022-04-28 14:39:13.934839","last_clean":"2022-04-28 14:39:13.934839","last_became_active":"2022-04-28 14:39:13.606892","last_became_peered":"2022-04-28 14:39:13.606892","last_unstale":"2022-04-28 14:39:13.934839","last_undegraded":"2022-04-28 14:39:13.934839","last_fullsized":"2022-04-28 14:39:13.934839","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967619","last_change":"2022-04-28 14:39:13.958594","last_active":"2022-04-28 14:39:13.967619","last_peered":"2022-04-28 14:39:13.967619","last_clean":"2022-04-28 14:39:13.967619","last_became_active":"2022-04-28 14:39:13.958234","last_became_peered":"2022-04-28 14:39:13.958234","last_unstale":"2022-04-28 14:39:13.967619","last_undegraded":"2022-04-28 14:39:13.967619","last_fullsized":"2022-04-28 14:39:13.967619","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943967","last_change":"2022-04-28 14:39:13.610919","last_active":"2022-04-28 14:39:13.943967","last_peered":"2022-04-28 14:39:13.943967","last_clean":"2022-04-28 14:39:13.943967","last_became_active":"2022-04-28 14:39:13.610535","last_became_peered":"2022-04-28 14:39:13.610535","last_unstale":"2022-04-28 14:39:13.943967","last_undegraded":"2022-04-28 14:39:13.943967","last_fullsized":"2022-04-28 14:39:13.943967","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.970041","last_change":"2022-04-28 14:39:13.968427","last_active":"2022-04-28 14:39:13.970041","last_peered":"2022-04-28 14:39:13.970041","last_clean":"2022-04-28 14:39:13.970041","last_became_active":"2022-04-28 14:39:13.968116","last_became_peered":"2022-04-28 14:39:13.968116","last_unstale":"2022-04-28 14:39:13.970041","last_undegraded":"2022-04-28 14:39:13.970041","last_fullsized":"2022-04-28 14:39:13.970041","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943521","last_change":"2022-04-28 14:39:05.390479","last_active":"2022-04-28 14:39:13.943521","last_peered":"2022-04-28 14:39:13.943521","last_clean":"2022-04-28 14:39:13.943521","last_became_active":"2022-04-28 14:39:05.390111","last_became_peered":"2022-04-28 14:39:05.390111","last_unstale":"2022-04-28 14:39:13.943521","last_undegraded":"2022-04-28 14:39:13.943521","last_fullsized":"2022-04-28 14:39:13.943521","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.941477","last_change":"2022-04-28 14:39:13.610156","last_active":"2022-04-28 14:39:13.941477","last_peered":"2022-04-28 14:39:13.941477","last_clean":"2022-04-28 14:39:13.941477","last_became_active":"2022-04-28 14:39:13.609823","last_became_peered":"2022-04-28 14:39:13.609823","last_unstale":"2022-04-28 14:39:13.941477","last_undegraded":"2022-04-28 14:39:13.941477","last_fullsized":"2022-04-28 14:39:13.941477","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.962538","last_change":"2022-04-28 14:39:13.952310","last_active":"2022-04-28 14:39:13.962538","last_peered":"2022-04-28 14:39:13.962538","last_clean":"2022-04-28 14:39:13.962538","last_became_active":"2022-04-28 14:39:13.951984","last_became_peered":"2022-04-28 14:39:13.951984","last_unstale":"2022-04-28 14:39:13.962538","last_undegraded":"2022-04-28 14:39:13.962538","last_fullsized":"2022-04-28 14:39:13.962538","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.945719","last_change":"2022-04-28 14:39:05.388548","last_active":"2022-04-28 14:39:13.945719","last_peered":"2022-04-28 14:39:13.945719","last_clean":"2022-04-28 14:39:13.945719","last_became_active":"2022-04-28 14:39:05.388215","last_became_peered":"2022-04-28 14:39:05.388215","last_unstale":"2022-04-28 14:39:13.945719","last_undegraded":"2022-04-28 14:39:13.945719","last_fullsized":"2022-04-28 14:39:13.945719","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.971324","last_change":"2022-04-28 14:39:13.627277","last_active":"2022-04-28 14:39:13.971324","last_peered":"2022-04-28 14:39:13.971324","last_clean":"2022-04-28 14:39:13.971324","last_became_active":"2022-04-28 14:39:13.626883","last_became_peered":"2022-04-28 14:39:13.626883","last_unstale":"2022-04-28 14:39:13.971324","last_undegraded":"2022-04-28 14:39:13.971324","last_fullsized":"2022-04-28 14:39:13.971324","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.940615","last_change":"2022-04-28 14:39:05.388784","last_active":"2022-04-28 14:39:13.940615","last_peered":"2022-04-28 14:39:13.940615","last_clean":"2022-04-28 14:39:13.940615","last_became_active":"2022-04-28 14:39:05.388043","last_became_peered":"2022-04-28 14:39:05.388043","last_unstale":"2022-04-28 14:39:13.940615","last_undegraded":"2022-04-28 14:39:13.940615","last_fullsized":"2022-04-28 14:39:13.940615","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.935857","last_change":"2022-04-28 14:39:13.622411","last_active":"2022-04-28 14:39:13.935857","last_peered":"2022-04-28 14:39:13.935857","last_clean":"2022-04-28 14:39:13.935857","last_became_active":"2022-04-28 14:39:13.621590","last_became_peered":"2022-04-28 14:39:13.621590","last_unstale":"2022-04-28 14:39:13.935857","last_undegraded":"2022-04-28 14:39:13.935857","last_fullsized":"2022-04-28 14:39:13.935857","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.963743","last_change":"2022-04-28 14:39:13.955187","last_active":"2022-04-28 14:39:13.963743","last_peered":"2022-04-28 14:39:13.963743","last_clean":"2022-04-28 14:39:13.963743","last_became_active":"2022-04-28 14:39:13.954831","last_became_peered":"2022-04-28 14:39:13.954831","last_unstale":"2022-04-28 14:39:13.963743","last_undegraded":"2022-04-28 14:39:13.963743","last_fullsized":"2022-04-28 14:39:13.963743","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943544","last_change":"2022-04-28 14:39:05.390881","last_active":"2022-04-28 14:39:13.943544","last_peered":"2022-04-28 14:39:13.943544","last_clean":"2022-04-28 14:39:13.943544","last_became_active":"2022-04-28 14:39:05.390559","last_became_peered":"2022-04-28 14:39:05.390559","last_unstale":"2022-04-28 14:39:13.943544","last_undegraded":"2022-04-28 14:39:13.943544","last_fullsized":"2022-04-28 14:39:13.943544","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.935200","last_change":"2022-04-28 14:39:13.608628","last_active":"2022-04-28 14:39:13.935200","last_peered":"2022-04-28 14:39:13.935200","last_clean":"2022-04-28 14:39:13.935200","last_became_active":"2022-04-28 14:39:13.608261","last_became_peered":"2022-04-28 14:39:13.608261","last_unstale":"2022-04-28 14:39:13.935200","last_undegraded":"2022-04-28 14:39:13.935200","last_fullsized":"2022-04-28 14:39:13.935200","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.952043","last_change":"2022-04-28 14:39:13.944110","last_active":"2022-04-28 14:39:13.952043","last_peered":"2022-04-28 14:39:13.952043","last_clean":"2022-04-28 14:39:13.952043","last_became_active":"2022-04-28 14:39:13.943780","last_became_peered":"2022-04-28 14:39:13.943780","last_unstale":"2022-04-28 14:39:13.952043","last_undegraded":"2022-04-28 14:39:13.952043","last_fullsized":"2022-04-28 14:39:13.952043","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.935718","last_change":"2022-04-28 14:39:05.390962","last_active":"2022-04-28 14:39:13.935718","last_peered":"2022-04-28 14:39:13.935718","last_clean":"2022-04-28 14:39:13.935718","last_became_active":"2022-04-28 14:39:05.390602","last_became_peered":"2022-04-28 14:39:05.390602","last_unstale":"2022-04-28 14:39:13.935718","last_undegraded":"2022-04-28 14:39:13.935718","last_fullsized":"2022-04-28 14:39:13.935718","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943104","last_change":"2022-04-28 14:39:13.614524","last_active":"2022-04-28 14:39:13.943104","last_peered":"2022-04-28 14:39:13.943104","last_clean":"2022-04-28 14:39:13.943104","last_became_active":"2022-04-28 14:39:13.614177","last_became_peered":"2022-04-28 14:39:13.614177","last_unstale":"2022-04-28 14:39:13.943104","last_undegraded":"2022-04-28 14:39:13.943104","last_fullsized":"2022-04-28 14:39:13.943104","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.970262","last_change":"2022-04-28 14:39:13.960464","last_active":"2022-04-28 14:39:13.970262","last_peered":"2022-04-28 14:39:13.970262","last_clean":"2022-04-28 14:39:13.970262","last_became_active":"2022-04-28 14:39:13.958817","last_became_peered":"2022-04-28 14:39:13.958817","last_unstale":"2022-04-28 14:39:13.970262","last_undegraded":"2022-04-28 14:39:13.970262","last_fullsized":"2022-04-28 14:39:13.970262","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.937426","last_change":"2022-04-28 14:39:05.389329","last_active":"2022-04-28 14:39:13.937426","last_peered":"2022-04-28 14:39:13.937426","last_clean":"2022-04-28 14:39:13.937426","last_became_active":"2022-04-28 14:39:05.389030","last_became_peered":"2022-04-28 14:39:05.389030","last_unstale":"2022-04-28 14:39:13.937426","last_undegraded":"2022-04-28 14:39:13.937426","last_fullsized":"2022-04-28 14:39:13.937426","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.939667","last_change":"2022-04-28 14:39:13.624225","last_active":"2022-04-28 14:39:13.939667","last_peered":"2022-04-28 14:39:13.939667","last_clean":"2022-04-28 14:39:13.939667","last_became_active":"2022-04-28 14:39:13.623631","last_became_peered":"2022-04-28 14:39:13.623631","last_unstale":"2022-04-28 14:39:13.939667","last_undegraded":"2022-04-28 14:39:13.939667","last_fullsized":"2022-04-28 14:39:13.939667","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.957004","last_change":"2022-04-28 14:39:13.951379","last_active":"2022-04-28 14:39:13.957004","last_peered":"2022-04-28 14:39:13.957004","last_clean":"2022-04-28 14:39:13.957004","last_became_active":"2022-04-28 14:39:13.950657","last_became_peered":"2022-04-28 14:39:13.950657","last_unstale":"2022-04-28 14:39:13.957004","last_undegraded":"2022-04-28 14:39:13.957004","last_fullsized":"2022-04-28 14:39:13.957004","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.947902","last_change":"2022-04-28 14:39:05.388553","last_active":"2022-04-28 14:39:13.947902","last_peered":"2022-04-28 14:39:13.947902","last_clean":"2022-04-28 14:39:13.947902","last_became_active":"2022-04-28 14:39:05.388170","last_became_peered":"2022-04-28 14:39:05.388170","last_unstale":"2022-04-28 14:39:13.947902","last_undegraded":"2022-04-28 14:39:13.947902","last_fullsized":"2022-04-28 14:39:13.947902","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.953366","last_change":"2022-04-28 14:39:13.627446","last_active":"2022-04-28 14:39:13.953366","last_peered":"2022-04-28 14:39:13.953366","last_clean":"2022-04-28 14:39:13.953366","last_became_active":"2022-04-28 14:39:13.627067","last_became_peered":"2022-04-28 14:39:13.627067","last_unstale":"2022-04-28 14:39:13.953366","last_undegraded":"2022-04-28 14:39:13.953366","last_fullsized":"2022-04-28 14:39:13.953366","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.961324","last_change":"2022-04-28 14:39:13.951391","last_active":"2022-04-28 14:39:13.961324","last_peered":"2022-04-28 14:39:13.961324","last_clean":"2022-04-28 14:39:13.961324","last_became_active":"2022-04-28 14:39:13.951063","last_became_peered":"2022-04-28 14:39:13.951063","last_unstale":"2022-04-28 14:39:13.961324","last_undegraded":"2022-04-28 14:39:13.961324","last_fullsized":"2022-04-28 14:39:13.961324","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.941494","last_change":"2022-04-28 14:39:05.388412","last_active":"2022-04-28 14:39:13.941494","last_peered":"2022-04-28 14:39:13.941494","last_clean":"2022-04-28 14:39:13.941494","last_became_active":"2022-04-28 14:39:05.388067","last_became_peered":"2022-04-28 14:39:05.388067","last_unstale":"2022-04-28 14:39:13.941494","last_undegraded":"2022-04-28 14:39:13.941494","last_fullsized":"2022-04-28 14:39:13.941494","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.940916","last_change":"2022-04-28 14:39:13.609546","last_active":"2022-04-28 14:39:13.940916","last_peered":"2022-04-28 14:39:13.940916","last_clean":"2022-04-28 14:39:13.940916","last_became_active":"2022-04-28 14:39:13.609231","last_became_peered":"2022-04-28 14:39:13.609231","last_unstale":"2022-04-28 14:39:13.940916","last_undegraded":"2022-04-28 14:39:13.940916","last_fullsized":"2022-04-28 14:39:13.940916","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.973586","last_change":"2022-04-28 14:39:13.971977","last_active":"2022-04-28 14:39:13.973586","last_peered":"2022-04-28 14:39:13.973586","last_clean":"2022-04-28 14:39:13.973586","last_became_active":"2022-04-28 14:39:13.971343","last_became_peered":"2022-04-28 14:39:13.971343","last_unstale":"2022-04-28 14:39:13.973586","last_undegraded":"2022-04-28 14:39:13.973586","last_fullsized":"2022-04-28 14:39:13.973586","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.974303","last_change":"2022-04-28 14:39:13.970909","last_active":"2022-04-28 14:39:13.974303","last_peered":"2022-04-28 14:39:13.974303","last_clean":"2022-04-28 14:39:13.974303","last_became_active":"2022-04-28 14:39:13.970599","last_became_peered":"2022-04-28 14:39:13.970599","last_unstale":"2022-04-28 14:39:13.974303","last_undegraded":"2022-04-28 14:39:13.974303","last_fullsized":"2022-04-28 14:39:13.974303","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.948934","last_change":"2022-04-28 14:39:13.622383","last_active":"2022-04-28 14:39:13.948934","last_peered":"2022-04-28 14:39:13.948934","last_clean":"2022-04-28 14:39:13.948934","last_became_active":"2022-04-28 14:39:13.620810","last_became_peered":"2022-04-28 14:39:13.620810","last_unstale":"2022-04-28 14:39:13.948934","last_undegraded":"2022-04-28 14:39:13.948934","last_fullsized":"2022-04-28 14:39:13.948934","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.961345","last_change":"2022-04-28 14:39:13.951426","last_active":"2022-04-28 14:39:13.961345","last_peered":"2022-04-28 14:39:13.961345","last_clean":"2022-04-28 14:39:13.961345","last_became_active":"2022-04-28 14:39:13.951111","last_became_peered":"2022-04-28 14:39:13.951111","last_unstale":"2022-04-28 14:39:13.961345","last_undegraded":"2022-04-28 14:39:13.961345","last_fullsized":"2022-04-28 14:39:13.961345","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.964946","last_change":"2022-04-28 14:39:13.622151","last_active":"2022-04-28 14:39:13.964946","last_peered":"2022-04-28 14:39:13.964946","last_clean":"2022-04-28 14:39:13.964946","last_became_active":"2022-04-28 14:39:13.621812","last_became_peered":"2022-04-28 14:39:13.621812","last_unstale":"2022-04-28 14:39:13.964946","last_undegraded":"2022-04-28 14:39:13.964946","last_fullsized":"2022-04-28 14:39:13.964946","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967311","last_change":"2022-04-28 14:39:13.961409","last_active":"2022-04-28 14:39:13.967311","last_peered":"2022-04-28 14:39:13.967311","last_clean":"2022-04-28 14:39:13.967311","last_became_active":"2022-04-28 14:39:13.961034","last_became_peered":"2022-04-28 14:39:13.961034","last_unstale":"2022-04-28 14:39:13.967311","last_undegraded":"2022-04-28 14:39:13.967311","last_fullsized":"2022-04-28 14:39:13.967311","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.970906","last_change":"2022-04-28 14:39:13.627961","last_active":"2022-04-28 14:39:13.970906","last_peered":"2022-04-28 14:39:13.970906","last_clean":"2022-04-28 14:39:13.970906","last_became_active":"2022-04-28 14:39:13.627595","last_became_peered":"2022-04-28 14:39:13.627595","last_unstale":"2022-04-28 14:39:13.970906","last_undegraded":"2022-04-28 14:39:13.970906","last_fullsized":"2022-04-28 14:39:13.970906","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.975440","last_change":"2022-04-28 14:39:13.973251","last_active":"2022-04-28 14:39:13.975440","last_peered":"2022-04-28 14:39:13.975440","last_clean":"2022-04-28 14:39:13.975440","last_became_active":"2022-04-28 14:39:13.973008","last_became_peered":"2022-04-28 14:39:13.973008","last_unstale":"2022-04-28 14:39:13.975440","last_undegraded":"2022-04-28 14:39:13.975440","last_fullsized":"2022-04-28 14:39:13.975440","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.971384","last_change":"2022-04-28 14:39:13.619997","last_active":"2022-04-28 14:39:13.971384","last_peered":"2022-04-28 14:39:13.971384","last_clean":"2022-04-28 14:39:13.971384","last_became_active":"2022-04-28 14:39:13.619739","last_became_peered":"2022-04-28 14:39:13.619739","last_unstale":"2022-04-28 14:39:13.971384","last_undegraded":"2022-04-28 14:39:13.971384","last_fullsized":"2022-04-28 14:39:13.971384","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.949245","last_change":"2022-04-28 14:39:13.944278","last_active":"2022-04-28 14:39:13.949245","last_peered":"2022-04-28 14:39:13.949245","last_clean":"2022-04-28 14:39:13.949245","last_became_active":"2022-04-28 14:39:13.943973","last_became_peered":"2022-04-28 14:39:13.943973","last_unstale":"2022-04-28 14:39:13.949245","last_undegraded":"2022-04-28 14:39:13.949245","last_fullsized":"2022-04-28 14:39:13.949245","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.936304","last_change":"2022-04-28 14:39:13.622598","last_active":"2022-04-28 14:39:13.936304","last_peered":"2022-04-28 14:39:13.936304","last_clean":"2022-04-28 14:39:13.936304","last_became_active":"2022-04-28 14:39:13.622080","last_became_peered":"2022-04-28 14:39:13.622080","last_unstale":"2022-04-28 14:39:13.936304","last_undegraded":"2022-04-28 14:39:13.936304","last_fullsized":"2022-04-28 14:39:13.936304","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.955715","last_change":"2022-04-28 14:39:13.952416","last_active":"2022-04-28 14:39:13.955715","last_peered":"2022-04-28 14:39:13.955715","last_clean":"2022-04-28 14:39:13.955715","last_became_active":"2022-04-28 14:39:13.952100","last_became_peered":"2022-04-28 14:39:13.952100","last_unstale":"2022-04-28 14:39:13.955715","last_undegraded":"2022-04-28 14:39:13.955715","last_fullsized":"2022-04-28 14:39:13.955715","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.935394","last_change":"2022-04-28 14:39:13.602486","last_active":"2022-04-28 14:39:13.935394","last_peered":"2022-04-28 14:39:13.935394","last_clean":"2022-04-28 14:39:13.935394","last_became_active":"2022-04-28 14:39:13.602105","last_became_peered":"2022-04-28 14:39:13.602105","last_unstale":"2022-04-28 14:39:13.935394","last_undegraded":"2022-04-28 14:39:13.935394","last_fullsized":"2022-04-28 14:39:13.935394","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967037","last_change":"2022-04-28 14:39:13.964624","last_active":"2022-04-28 14:39:13.967037","last_peered":"2022-04-28 14:39:13.967037","last_clean":"2022-04-28 14:39:13.967037","last_became_active":"2022-04-28 14:39:13.964305","last_became_peered":"2022-04-28 14:39:13.964305","last_unstale":"2022-04-28 14:39:13.967037","last_undegraded":"2022-04-28 14:39:13.967037","last_fullsized":"2022-04-28 14:39:13.967037","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.939875","last_change":"2022-04-28 14:39:13.624420","last_active":"2022-04-28 14:39:13.939875","last_peered":"2022-04-28 14:39:13.939875","last_clean":"2022-04-28 14:39:13.939875","last_became_active":"2022-04-28 14:39:13.623884","last_became_peered":"2022-04-28 14:39:13.623884","last_unstale":"2022-04-28 14:39:13.939875","last_undegraded":"2022-04-28 14:39:13.939875","last_fullsized":"2022-04-28 14:39:13.939875","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.970283","last_change":"2022-04-28 14:39:13.960655","last_active":"2022-04-28 14:39:13.970283","last_peered":"2022-04-28 14:39:13.970283","last_clean":"2022-04-28 14:39:13.970283","last_became_active":"2022-04-28 14:39:13.960060","last_became_peered":"2022-04-28 14:39:13.960060","last_unstale":"2022-04-28 14:39:13.970283","last_undegraded":"2022-04-28 14:39:13.970283","last_fullsized":"2022-04-28 14:39:13.970283","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943941","last_change":"2022-04-28 14:39:13.624344","last_active":"2022-04-28 14:39:13.943941","last_peered":"2022-04-28 14:39:13.943941","last_clean":"2022-04-28 14:39:13.943941","last_became_active":"2022-04-28 14:39:13.623843","last_became_peered":"2022-04-28 14:39:13.623843","last_unstale":"2022-04-28 14:39:13.943941","last_undegraded":"2022-04-28 14:39:13.943941","last_fullsized":"2022-04-28 14:39:13.943941","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.973468","last_change":"2022-04-28 14:39:13.969259","last_active":"2022-04-28 14:39:13.973468","last_peered":"2022-04-28 14:39:13.973468","last_clean":"2022-04-28 14:39:13.973468","last_became_active":"2022-04-28 14:39:13.968448","last_became_peered":"2022-04-28 14:39:13.968448","last_unstale":"2022-04-28 14:39:13.973468","last_undegraded":"2022-04-28 14:39:13.973468","last_fullsized":"2022-04-28 14:39:13.973468","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.941007","last_change":"2022-04-28 14:39:13.609457","last_active":"2022-04-28 14:39:13.941007","last_peered":"2022-04-28 14:39:13.941007","last_clean":"2022-04-28 14:39:13.941007","last_became_active":"2022-04-28 14:39:13.609114","last_became_peered":"2022-04-28 14:39:13.609114","last_unstale":"2022-04-28 14:39:13.941007","last_undegraded":"2022-04-28 14:39:13.941007","last_fullsized":"2022-04-28 14:39:13.941007","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967821","last_change":"2022-04-28 14:39:13.960837","last_active":"2022-04-28 14:39:13.967821","last_peered":"2022-04-28 14:39:13.967821","last_clean":"2022-04-28 14:39:13.967821","last_became_active":"2022-04-28 14:39:13.960511","last_became_peered":"2022-04-28 14:39:13.960511","last_unstale":"2022-04-28 14:39:13.967821","last_undegraded":"2022-04-28 14:39:13.967821","last_fullsized":"2022-04-28 14:39:13.967821","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943620","last_change":"2022-04-28 14:39:13.600840","last_active":"2022-04-28 14:39:13.943620","last_peered":"2022-04-28 14:39:13.943620","last_clean":"2022-04-28 14:39:13.943620","last_became_active":"2022-04-28 14:39:13.600508","last_became_peered":"2022-04-28 14:39:13.600508","last_unstale":"2022-04-28 14:39:13.943620","last_undegraded":"2022-04-28 14:39:13.943620","last_fullsized":"2022-04-28 14:39:13.943620","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.969866","last_change":"2022-04-28 14:39:13.968364","last_active":"2022-04-28 14:39:13.969866","last_peered":"2022-04-28 14:39:13.969866","last_clean":"2022-04-28 14:39:13.969866","last_became_active":"2022-04-28 14:39:13.968054","last_became_peered":"2022-04-28 14:39:13.968054","last_unstale":"2022-04-28 14:39:13.969866","last_undegraded":"2022-04-28 14:39:13.969866","last_fullsized":"2022-04-28 14:39:13.969866","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:15.552206","last_change":"2022-04-28 14:39:13.623080","last_active":"2022-04-28 14:39:15.552206","last_peered":"2022-04-28 14:39:15.552206","last_clean":"2022-04-28 14:39:15.552206","last_became_active":"2022-04-28 14:39:13.622568","last_became_peered":"2022-04-28 14:39:13.622568","last_unstale":"2022-04-28 14:39:15.552206","last_undegraded":"2022-04-28 14:39:15.552206","last_fullsized":"2022-04-28 14:39:15.552206","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.973674","last_change":"2022-04-28 14:39:13.972567","last_active":"2022-04-28 14:39:13.973674","last_peered":"2022-04-28 14:39:13.973674","last_clean":"2022-04-28 14:39:13.973674","last_became_active":"2022-04-28 14:39:13.972179","last_became_peered":"2022-04-28 14:39:13.972179","last_unstale":"2022-04-28 14:39:13.973674","last_undegraded":"2022-04-28 14:39:13.973674","last_fullsized":"2022-04-28 14:39:13.973674","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.955560","last_change":"2022-04-28 14:39:13.622222","last_active":"2022-04-28 14:39:13.955560","last_peered":"2022-04-28 14:39:13.955560","last_clean":"2022-04-28 14:39:13.955560","last_became_active":"2022-04-28 14:39:13.621872","last_became_peered":"2022-04-28 14:39:13.621872","last_unstale":"2022-04-28 14:39:13.955560","last_undegraded":"2022-04-28 14:39:13.955560","last_fullsized":"2022-04-28 14:39:13.955560","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967571","last_change":"2022-04-28 14:39:13.958395","last_active":"2022-04-28 14:39:13.967571","last_peered":"2022-04-28 14:39:13.967571","last_clean":"2022-04-28 14:39:13.967571","last_became_active":"2022-04-28 14:39:13.957976","last_became_peered":"2022-04-28 14:39:13.957976","last_unstale":"2022-04-28 14:39:13.967571","last_undegraded":"2022-04-28 14:39:13.967571","last_fullsized":"2022-04-28 14:39:13.967571","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.937046","last_change":"2022-04-28 14:39:13.622467","last_active":"2022-04-28 14:39:13.937046","last_peered":"2022-04-28 14:39:13.937046","last_clean":"2022-04-28 14:39:13.937046","last_became_active":"2022-04-28 14:39:13.621838","last_became_peered":"2022-04-28 14:39:13.621838","last_unstale":"2022-04-28 14:39:13.937046","last_undegraded":"2022-04-28 14:39:13.937046","last_fullsized":"2022-04-28 14:39:13.937046","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967649","last_change":"2022-04-28 14:39:13.958646","last_active":"2022-04-28 14:39:13.967649","last_peered":"2022-04-28 14:39:13.967649","last_clean":"2022-04-28 14:39:13.967649","last_became_active":"2022-04-28 14:39:13.957994","last_became_peered":"2022-04-28 14:39:13.957994","last_unstale":"2022-04-28 14:39:13.967649","last_undegraded":"2022-04-28 14:39:13.967649","last_fullsized":"2022-04-28 14:39:13.967649","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.942257","last_change":"2022-04-28 14:39:13.614008","last_active":"2022-04-28 14:39:13.942257","last_peered":"2022-04-28 14:39:13.942257","last_clean":"2022-04-28 14:39:13.942257","last_became_active":"2022-04-28 14:39:13.613702","last_became_peered":"2022-04-28 14:39:13.613702","last_unstale":"2022-04-28 14:39:13.942257","last_undegraded":"2022-04-28 14:39:13.942257","last_fullsized":"2022-04-28 14:39:13.942257","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.956962","last_change":"2022-04-28 14:39:13.950979","last_active":"2022-04-28 14:39:13.956962","last_peered":"2022-04-28 14:39:13.956962","last_clean":"2022-04-28 14:39:13.956962","last_became_active":"2022-04-28 14:39:13.950168","last_became_peered":"2022-04-28 14:39:13.950168","last_unstale":"2022-04-28 14:39:13.956962","last_undegraded":"2022-04-28 14:39:13.956962","last_fullsized":"2022-04-28 14:39:13.956962","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.942015","last_change":"2022-04-28 14:39:13.617031","last_active":"2022-04-28 14:39:13.942015","last_peered":"2022-04-28 14:39:13.942015","last_clean":"2022-04-28 14:39:13.942015","last_became_active":"2022-04-28 14:39:13.615420","last_became_peered":"2022-04-28 14:39:13.615420","last_unstale":"2022-04-28 14:39:13.942015","last_undegraded":"2022-04-28 14:39:13.942015","last_fullsized":"2022-04-28 14:39:13.942015","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.963546","last_change":"2022-04-28 14:39:13.954485","last_active":"2022-04-28 14:39:13.963546","last_peered":"2022-04-28 14:39:13.963546","last_clean":"2022-04-28 14:39:13.963546","last_became_active":"2022-04-28 14:39:13.954179","last_became_peered":"2022-04-28 14:39:13.954179","last_unstale":"2022-04-28 14:39:13.963546","last_undegraded":"2022-04-28 14:39:13.963546","last_fullsized":"2022-04-28 14:39:13.963546","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.970981","last_change":"2022-04-28 14:39:13.608868","last_active":"2022-04-28 14:39:13.970981","last_peered":"2022-04-28 14:39:13.970981","last_clean":"2022-04-28 14:39:13.970981","last_became_active":"2022-04-28 14:39:13.608590","last_became_peered":"2022-04-28 14:39:13.608590","last_unstale":"2022-04-28 14:39:13.970981","last_undegraded":"2022-04-28 14:39:13.970981","last_fullsized":"2022-04-28 14:39:13.970981","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.969788","last_change":"2022-04-28 14:39:13.966189","last_active":"2022-04-28 14:39:13.969788","last_peered":"2022-04-28 14:39:13.969788","last_clean":"2022-04-28 14:39:13.969788","last_became_active":"2022-04-28 14:39:13.965877","last_became_peered":"2022-04-28 14:39:13.965877","last_unstale":"2022-04-28 14:39:13.969788","last_undegraded":"2022-04-28 14:39:13.969788","last_fullsized":"2022-04-28 14:39:13.969788","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943233","last_change":"2022-04-28 14:39:13.601488","last_active":"2022-04-28 14:39:13.943233","last_peered":"2022-04-28 14:39:13.943233","last_clean":"2022-04-28 14:39:13.943233","last_became_active":"2022-04-28 14:39:13.601122","last_became_peered":"2022-04-28 14:39:13.601122","last_unstale":"2022-04-28 14:39:13.943233","last_undegraded":"2022-04-28 14:39:13.943233","last_fullsized":"2022-04-28 14:39:13.943233","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.956513","last_change":"2022-04-28 14:39:13.951897","last_active":"2022-04-28 14:39:13.956513","last_peered":"2022-04-28 14:39:13.956513","last_clean":"2022-04-28 14:39:13.956513","last_became_active":"2022-04-28 14:39:13.951314","last_became_peered":"2022-04-28 14:39:13.951314","last_unstale":"2022-04-28 14:39:13.956513","last_undegraded":"2022-04-28 14:39:13.956513","last_fullsized":"2022-04-28 14:39:13.956513","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.974243","last_change":"2022-04-28 14:39:13.615041","last_active":"2022-04-28 14:39:13.974243","last_peered":"2022-04-28 14:39:13.974243","last_clean":"2022-04-28 14:39:13.974243","last_became_active":"2022-04-28 14:39:13.614710","last_became_peered":"2022-04-28 14:39:13.614710","last_unstale":"2022-04-28 14:39:13.974243","last_undegraded":"2022-04-28 14:39:13.974243","last_fullsized":"2022-04-28 14:39:13.974243","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.975312","last_change":"2022-04-28 14:39:13.971986","last_active":"2022-04-28 14:39:13.975312","last_peered":"2022-04-28 14:39:13.975312","last_clean":"2022-04-28 14:39:13.975312","last_became_active":"2022-04-28 14:39:13.971243","last_became_peered":"2022-04-28 14:39:13.971243","last_unstale":"2022-04-28 14:39:13.975312","last_undegraded":"2022-04-28 14:39:13.975312","last_fullsized":"2022-04-28 14:39:13.975312","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.941578","last_change":"2022-04-28 14:39:13.613362","last_active":"2022-04-28 14:39:13.941578","last_peered":"2022-04-28 14:39:13.941578","last_clean":"2022-04-28 14:39:13.941578","last_became_active":"2022-04-28 14:39:13.612969","last_became_peered":"2022-04-28 14:39:13.612969","last_unstale":"2022-04-28 14:39:13.941578","last_undegraded":"2022-04-28 14:39:13.941578","last_fullsized":"2022-04-28 14:39:13.941578","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.973650","last_change":"2022-04-28 14:39:13.972552","last_active":"2022-04-28 14:39:13.973650","last_peered":"2022-04-28 14:39:13.973650","last_clean":"2022-04-28 14:39:13.973650","last_became_active":"2022-04-28 14:39:13.970887","last_became_peered":"2022-04-28 14:39:13.970887","last_unstale":"2022-04-28 14:39:13.973650","last_undegraded":"2022-04-28 14:39:13.973650","last_fullsized":"2022-04-28 14:39:13.973650","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.955661","last_change":"2022-04-28 14:39:13.628138","last_active":"2022-04-28 14:39:13.955661","last_peered":"2022-04-28 14:39:13.955661","last_clean":"2022-04-28 14:39:13.955661","last_became_active":"2022-04-28 14:39:13.627785","last_became_peered":"2022-04-28 14:39:13.627785","last_unstale":"2022-04-28 14:39:13.955661","last_undegraded":"2022-04-28 14:39:13.955661","last_fullsized":"2022-04-28 14:39:13.955661","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.962842","last_change":"2022-04-28 14:39:13.955799","last_active":"2022-04-28 14:39:13.962842","last_peered":"2022-04-28 14:39:13.962842","last_clean":"2022-04-28 14:39:13.962842","last_became_active":"2022-04-28 14:39:13.955495","last_became_peered":"2022-04-28 14:39:13.955495","last_unstale":"2022-04-28 14:39:13.962842","last_undegraded":"2022-04-28 14:39:13.962842","last_fullsized":"2022-04-28 14:39:13.962842","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.965267","last_change":"2022-04-28 14:39:13.621432","last_active":"2022-04-28 14:39:13.965267","last_peered":"2022-04-28 14:39:13.965267","last_clean":"2022-04-28 14:39:13.965267","last_became_active":"2022-04-28 14:39:13.621080","last_became_peered":"2022-04-28 14:39:13.621080","last_unstale":"2022-04-28 14:39:13.965267","last_undegraded":"2022-04-28 14:39:13.965267","last_fullsized":"2022-04-28 14:39:13.965267","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.957517","last_change":"2022-04-28 14:39:13.956112","last_active":"2022-04-28 14:39:13.957517","last_peered":"2022-04-28 14:39:13.957517","last_clean":"2022-04-28 14:39:13.957517","last_became_active":"2022-04-28 14:39:13.955792","last_became_peered":"2022-04-28 14:39:13.955792","last_unstale":"2022-04-28 14:39:13.957517","last_undegraded":"2022-04-28 14:39:13.957517","last_fullsized":"2022-04-28 14:39:13.957517","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943395","last_change":"2022-04-28 14:39:13.622128","last_active":"2022-04-28 14:39:13.943395","last_peered":"2022-04-28 14:39:13.943395","last_clean":"2022-04-28 14:39:13.943395","last_became_active":"2022-04-28 14:39:13.621790","last_became_peered":"2022-04-28 14:39:13.621790","last_unstale":"2022-04-28 14:39:13.943395","last_undegraded":"2022-04-28 14:39:13.943395","last_fullsized":"2022-04-28 14:39:13.943395","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.969380","last_change":"2022-04-28 14:39:13.967323","last_active":"2022-04-28 14:39:13.969380","last_peered":"2022-04-28 14:39:13.969380","last_clean":"2022-04-28 14:39:13.969380","last_became_active":"2022-04-28 14:39:13.961173","last_became_peered":"2022-04-28 14:39:13.961173","last_unstale":"2022-04-28 14:39:13.969380","last_undegraded":"2022-04-28 14:39:13.969380","last_fullsized":"2022-04-28 14:39:13.969380","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.937877","last_change":"2022-04-28 14:39:13.609625","last_active":"2022-04-28 14:39:13.937877","last_peered":"2022-04-28 14:39:13.937877","last_clean":"2022-04-28 14:39:13.937877","last_became_active":"2022-04-28 14:39:13.609062","last_became_peered":"2022-04-28 14:39:13.609062","last_unstale":"2022-04-28 14:39:13.937877","last_undegraded":"2022-04-28 14:39:13.937877","last_fullsized":"2022-04-28 14:39:13.937877","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.966595","last_change":"2022-04-28 14:39:13.963123","last_active":"2022-04-28 14:39:13.966595","last_peered":"2022-04-28 14:39:13.966595","last_clean":"2022-04-28 14:39:13.966595","last_became_active":"2022-04-28 14:39:13.962825","last_became_peered":"2022-04-28 14:39:13.962825","last_unstale":"2022-04-28 14:39:13.966595","last_undegraded":"2022-04-28 14:39:13.966595","last_fullsized":"2022-04-28 14:39:13.966595","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.959564","last_change":"2022-04-28 14:39:13.603083","last_active":"2022-04-28 14:39:13.959564","last_peered":"2022-04-28 14:39:13.959564","last_clean":"2022-04-28 14:39:13.959564","last_became_active":"2022-04-28 14:39:13.602776","last_became_peered":"2022-04-28 14:39:13.602776","last_unstale":"2022-04-28 14:39:13.959564","last_undegraded":"2022-04-28 14:39:13.959564","last_fullsized":"2022-04-28 14:39:13.959564","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.974419","last_change":"2022-04-28 14:39:13.971833","last_active":"2022-04-28 14:39:13.974419","last_peered":"2022-04-28 14:39:13.974419","last_clean":"2022-04-28 14:39:13.974419","last_became_active":"2022-04-28 14:39:13.971513","last_became_peered":"2022-04-28 14:39:13.971513","last_unstale":"2022-04-28 14:39:13.974419","last_undegraded":"2022-04-28 14:39:13.974419","last_fullsized":"2022-04-28 14:39:13.974419","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.975464","last_change":"2022-04-28 14:39:13.619098","last_active":"2022-04-28 14:39:13.975464","last_peered":"2022-04-28 14:39:13.975464","last_clean":"2022-04-28 14:39:13.975464","last_became_active":"2022-04-28 14:39:13.618737","last_became_peered":"2022-04-28 14:39:13.618737","last_unstale":"2022-04-28 14:39:13.975464","last_undegraded":"2022-04-28 14:39:13.975464","last_fullsized":"2022-04-28 14:39:13.975464","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.956440","last_change":"2022-04-28 14:39:13.951611","last_active":"2022-04-28 14:39:13.956440","last_peered":"2022-04-28 14:39:13.956440","last_clean":"2022-04-28 14:39:13.956440","last_became_active":"2022-04-28 14:39:13.951102","last_became_peered":"2022-04-28 14:39:13.951102","last_unstale":"2022-04-28 14:39:13.956440","last_undegraded":"2022-04-28 14:39:13.956440","last_fullsized":"2022-04-28 14:39:13.956440","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.941816","last_change":"2022-04-28 14:39:13.618476","last_active":"2022-04-28 14:39:13.941816","last_peered":"2022-04-28 14:39:13.941816","last_clean":"2022-04-28 14:39:13.941816","last_became_active":"2022-04-28 14:39:13.617950","last_became_peered":"2022-04-28 14:39:13.617950","last_unstale":"2022-04-28 14:39:13.941816","last_undegraded":"2022-04-28 14:39:13.941816","last_fullsized":"2022-04-28 14:39:13.941816","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.973798","last_change":"2022-04-28 14:39:13.969503","last_active":"2022-04-28 14:39:13.973798","last_peered":"2022-04-28 14:39:13.973798","last_clean":"2022-04-28 14:39:13.973798","last_became_active":"2022-04-28 14:39:13.969200","last_became_peered":"2022-04-28 14:39:13.969200","last_unstale":"2022-04-28 14:39:13.973798","last_undegraded":"2022-04-28 14:39:13.973798","last_fullsized":"2022-04-28 14:39:13.973798","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.941382","last_change":"2022-04-28 14:39:13.613426","last_active":"2022-04-28 14:39:13.941382","last_peered":"2022-04-28 14:39:13.941382","last_clean":"2022-04-28 14:39:13.941382","last_became_active":"2022-04-28 14:39:13.613077","last_became_peered":"2022-04-28 14:39:13.613077","last_unstale":"2022-04-28 14:39:13.941382","last_undegraded":"2022-04-28 14:39:13.941382","last_fullsized":"2022-04-28 14:39:13.941382","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.962551","last_change":"2022-04-28 14:39:13.953772","last_active":"2022-04-28 14:39:13.962551","last_peered":"2022-04-28 14:39:13.962551","last_clean":"2022-04-28 14:39:13.962551","last_became_active":"2022-04-28 14:39:13.953478","last_became_peered":"2022-04-28 14:39:13.953478","last_unstale":"2022-04-28 14:39:13.962551","last_undegraded":"2022-04-28 14:39:13.962551","last_fullsized":"2022-04-28 14:39:13.962551","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.950662","last_change":"2022-04-28 14:39:13.606445","last_active":"2022-04-28 14:39:13.950662","last_peered":"2022-04-28 14:39:13.950662","last_clean":"2022-04-28 14:39:13.950662","last_became_active":"2022-04-28 14:39:13.606028","last_became_peered":"2022-04-28 14:39:13.606028","last_unstale":"2022-04-28 14:39:13.950662","last_undegraded":"2022-04-28 14:39:13.950662","last_fullsized":"2022-04-28 14:39:13.950662","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.956487","last_change":"2022-04-28 14:39:13.951780","last_active":"2022-04-28 14:39:13.956487","last_peered":"2022-04-28 14:39:13.956487","last_clean":"2022-04-28 14:39:13.956487","last_became_active":"2022-04-28 14:39:13.951236","last_became_peered":"2022-04-28 14:39:13.951236","last_unstale":"2022-04-28 14:39:13.956487","last_undegraded":"2022-04-28 14:39:13.956487","last_fullsized":"2022-04-28 14:39:13.956487","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.942534","last_change":"2022-04-28 14:39:13.621466","last_active":"2022-04-28 14:39:13.942534","last_peered":"2022-04-28 14:39:13.942534","last_clean":"2022-04-28 14:39:13.942534","last_became_active":"2022-04-28 14:39:13.621146","last_became_peered":"2022-04-28 14:39:13.621146","last_unstale":"2022-04-28 14:39:13.942534","last_undegraded":"2022-04-28 14:39:13.942534","last_fullsized":"2022-04-28 14:39:13.942534","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967697","last_change":"2022-04-28 14:39:13.960230","last_active":"2022-04-28 14:39:13.967697","last_peered":"2022-04-28 14:39:13.967697","last_clean":"2022-04-28 14:39:13.967697","last_became_active":"2022-04-28 14:39:13.958741","last_became_peered":"2022-04-28 14:39:13.958741","last_unstale":"2022-04-28 14:39:13.967697","last_undegraded":"2022-04-28 14:39:13.967697","last_fullsized":"2022-04-28 14:39:13.967697","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.937051","last_change":"2022-04-28 14:39:13.603448","last_active":"2022-04-28 14:39:13.937051","last_peered":"2022-04-28 14:39:13.937051","last_clean":"2022-04-28 14:39:13.937051","last_became_active":"2022-04-28 14:39:13.603117","last_became_peered":"2022-04-28 14:39:13.603117","last_unstale":"2022-04-28 14:39:13.937051","last_undegraded":"2022-04-28 14:39:13.937051","last_fullsized":"2022-04-28 14:39:13.937051","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.956983","last_change":"2022-04-28 14:39:13.951179","last_active":"2022-04-28 14:39:13.956983","last_peered":"2022-04-28 14:39:13.956983","last_clean":"2022-04-28 14:39:13.956983","last_became_active":"2022-04-28 14:39:13.950413","last_became_peered":"2022-04-28 14:39:13.950413","last_unstale":"2022-04-28 14:39:13.956983","last_undegraded":"2022-04-28 14:39:13.956983","last_fullsized":"2022-04-28 14:39:13.956983","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.972495","last_change":"2022-04-28 14:39:13.609803","last_active":"2022-04-28 14:39:13.972495","last_peered":"2022-04-28 14:39:13.972495","last_clean":"2022-04-28 14:39:13.972495","last_became_active":"2022-04-28 14:39:13.609320","last_became_peered":"2022-04-28 14:39:13.609320","last_unstale":"2022-04-28 14:39:13.972495","last_undegraded":"2022-04-28 14:39:13.972495","last_fullsized":"2022-04-28 14:39:13.972495","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.957157","last_change":"2022-04-28 14:39:13.953322","last_active":"2022-04-28 14:39:13.957157","last_peered":"2022-04-28 14:39:13.957157","last_clean":"2022-04-28 14:39:13.957157","last_became_active":"2022-04-28 14:39:13.952997","last_became_peered":"2022-04-28 14:39:13.952997","last_unstale":"2022-04-28 14:39:13.957157","last_undegraded":"2022-04-28 14:39:13.957157","last_fullsized":"2022-04-28 14:39:13.957157","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.964743","last_change":"2022-04-28 14:39:13.624451","last_active":"2022-04-28 14:39:13.964743","last_peered":"2022-04-28 14:39:13.964743","last_clean":"2022-04-28 14:39:13.964743","last_became_active":"2022-04-28 14:39:13.624118","last_became_peered":"2022-04-28 14:39:13.624118","last_unstale":"2022-04-28 14:39:13.964743","last_undegraded":"2022-04-28 14:39:13.964743","last_fullsized":"2022-04-28 14:39:13.964743","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.962340","last_change":"2022-04-28 14:39:13.956657","last_active":"2022-04-28 14:39:13.962340","last_peered":"2022-04-28 14:39:13.962340","last_clean":"2022-04-28 14:39:13.962340","last_became_active":"2022-04-28 14:39:13.956291","last_became_peered":"2022-04-28 14:39:13.956291","last_unstale":"2022-04-28 14:39:13.962340","last_undegraded":"2022-04-28 14:39:13.962340","last_fullsized":"2022-04-28 14:39:13.962340","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.964761","last_change":"2022-04-28 14:39:13.621131","last_active":"2022-04-28 14:39:13.964761","last_peered":"2022-04-28 14:39:13.964761","last_clean":"2022-04-28 14:39:13.964761","last_became_active":"2022-04-28 14:39:13.620764","last_became_peered":"2022-04-28 14:39:13.620764","last_unstale":"2022-04-28 14:39:13.964761","last_undegraded":"2022-04-28 14:39:13.964761","last_fullsized":"2022-04-28 14:39:13.964761","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.973522","last_change":"2022-04-28 14:39:13.971712","last_active":"2022-04-28 14:39:13.973522","last_peered":"2022-04-28 14:39:13.973522","last_clean":"2022-04-28 14:39:13.973522","last_became_active":"2022-04-28 14:39:13.970627","last_became_peered":"2022-04-28 14:39:13.970627","last_unstale":"2022-04-28 14:39:13.973522","last_undegraded":"2022-04-28 14:39:13.973522","last_fullsized":"2022-04-28 14:39:13.973522","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.941716","last_change":"2022-04-28 14:39:13.618500","last_active":"2022-04-28 14:39:13.941716","last_peered":"2022-04-28 14:39:13.941716","last_clean":"2022-04-28 14:39:13.941716","last_became_active":"2022-04-28 14:39:13.618171","last_became_peered":"2022-04-28 14:39:13.618171","last_unstale":"2022-04-28 14:39:13.941716","last_undegraded":"2022-04-28 14:39:13.941716","last_fullsized":"2022-04-28 14:39:13.941716","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967485","last_change":"2022-04-28 14:39:13.966833","last_active":"2022-04-28 14:39:13.967485","last_peered":"2022-04-28 14:39:13.967485","last_clean":"2022-04-28 14:39:13.967485","last_became_active":"2022-04-28 14:39:13.963563","last_became_peered":"2022-04-28 14:39:13.963563","last_unstale":"2022-04-28 14:39:13.967485","last_undegraded":"2022-04-28 14:39:13.967485","last_fullsized":"2022-04-28 14:39:13.967485","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.950038","last_change":"2022-04-28 14:39:13.622884","last_active":"2022-04-28 14:39:13.950038","last_peered":"2022-04-28 14:39:13.950038","last_clean":"2022-04-28 14:39:13.950038","last_became_active":"2022-04-28 14:39:13.617005","last_became_peered":"2022-04-28 14:39:13.617005","last_unstale":"2022-04-28 14:39:13.950038","last_undegraded":"2022-04-28 14:39:13.950038","last_fullsized":"2022-04-28 14:39:13.950038","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.959924","last_change":"2022-04-28 14:39:13.951972","last_active":"2022-04-28 14:39:13.959924","last_peered":"2022-04-28 14:39:13.959924","last_clean":"2022-04-28 14:39:13.959924","last_became_active":"2022-04-28 14:39:13.951647","last_became_peered":"2022-04-28 14:39:13.951647","last_unstale":"2022-04-28 14:39:13.959924","last_undegraded":"2022-04-28 14:39:13.959924","last_fullsized":"2022-04-28 14:39:13.959924","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.963369","last_change":"2022-04-28 14:39:13.619298","last_active":"2022-04-28 14:39:13.963369","last_peered":"2022-04-28 14:39:13.963369","last_clean":"2022-04-28 14:39:13.963369","last_became_active":"2022-04-28 14:39:13.618948","last_became_peered":"2022-04-28 14:39:13.618948","last_unstale":"2022-04-28 14:39:13.963369","last_undegraded":"2022-04-28 14:39:13.963369","last_fullsized":"2022-04-28 14:39:13.963369","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":2286,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048744,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323096,"statfs":{"total":96636764160,"available":95562850304,"internally_reserved":1073741824,"allocated":163840,"data_stored":41801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323108,"statfs":{"total":96636764160,"available":95562862592,"internally_reserved":1073741824,"allocated":151552,"data_stored":40785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048728,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323112,"statfs":{"total":96636764160,"available":95562866688,"internally_reserved":1073741824,"allocated":147456,"data_stored":37731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048732,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323108,"statfs":{"total":96636764160,"available":95562862592,"internally_reserved":1073741824,"allocated":151552,"data_stored":40737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.185}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.215}]}]}]}} 2022-04-28T14:39:18.821 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2022-04-28T14:39:18.821 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2022-04-28T14:39:18.821 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2022-04-28T14:39:18.821 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2022-04-28T14:39:18.822 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2022-04-28T14:39:18.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.946 7fccc5a45700 1 Processor -- start 2022-04-28T14:39:18.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.947 7fccc5a45700 1 -- start start 2022-04-28T14:39:18.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.947 7fccc5a45700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fccc00f6370 0x7fccc00f1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:18.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.947 7fccc5a45700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fccc00f67c0 0x7fccc00f18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:18.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.947 7fccc5a45700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fccc01b2470 0x7fccc01b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:18.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.947 7fccc5a45700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc0111c20 con 0x7fccc01b2470 2022-04-28T14:39:18.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.947 7fccc5a45700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc010cb00 con 0x7fccc00f67c0 2022-04-28T14:39:18.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.947 7fccc5a45700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccc010d3e0 con 0x7fccc00f6370 2022-04-28T14:39:18.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.947 7fccbe800700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fccc00f6370 0x7fccc00f1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:18.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.947 7fccbdfff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fccc00f67c0 0x7fccc00f18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:18.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.947 7fccbe800700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fccc00f6370 0x7fccc00f1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46190/0 (socket says 172.21.15.22:46190) 2022-04-28T14:39:18.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.947 7fccbe800700 1 -- 172.21.15.22:0/2017060820 learned_addr learned my addr 172.21.15.22:0/2017060820 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:18.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.947 7fccbdfff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fccc00f67c0 0x7fccc00f18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46408/0 (socket says 172.21.15.22:46408) 2022-04-28T14:39:18.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.947 7fccbf001700 1 --2- 172.21.15.22:0/2017060820 >> v2:172.21.15.22:3300/0 conn(0x7fccc01b2470 0x7fccc01b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:18.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.948 7fccbe800700 1 -- 172.21.15.22:0/2017060820 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fccc00f67c0 msgr2=0x7fccc00f18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:18.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.948 7fccbe800700 1 --2- 172.21.15.22:0/2017060820 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fccc00f67c0 0x7fccc00f18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.948 7fccbe800700 1 -- 172.21.15.22:0/2017060820 >> v2:172.21.15.22:3300/0 conn(0x7fccc01b2470 msgr2=0x7fccc01b28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:18.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.948 7fccbe800700 1 --2- 172.21.15.22:0/2017060820 >> v2:172.21.15.22:3300/0 conn(0x7fccc01b2470 0x7fccc01b28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.948 7fccbe800700 1 -- 172.21.15.22:0/2017060820 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc00f1ed0 con 0x7fccc00f6370 2022-04-28T14:39:18.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.948 7fccbdfff700 1 --2- 172.21.15.22:0/2017060820 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fccc00f67c0 0x7fccc00f18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:18.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.948 7fccbe800700 1 --2- 172.21.15.22:0/2017060820 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fccc00f6370 0x7fccc00f1270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fccb0002f70 tx=0x7fccb00099d0).ready entity=mon.2 client_cookie=85b415ac4d279c68 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:18.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.948 7fccbd7fe700 1 -- 172.21.15.22:0/2017060820 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fccc00f1ed0 con 0x7fccc00f6370 2022-04-28T14:39:18.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.948 7fccbd7fe700 1 -- 172.21.15.22:0/2017060820 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb000f510 con 0x7fccc00f6370 2022-04-28T14:39:18.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.948 7fccbd7fe700 1 -- 172.21.15.22:0/2017060820 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fccb000f6f0 con 0x7fccc00f6370 2022-04-28T14:39:18.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.948 7fccc5a45700 1 -- 172.21.15.22:0/2017060820 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fccc00f6370 msgr2=0x7fccc00f1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:18.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.948 7fccc5a45700 1 --2- 172.21.15.22:0/2017060820 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fccc00f6370 0x7fccc00f1270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fccb0002f70 tx=0x7fccb00099d0).stop 2022-04-28T14:39:18.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.949 7fccc5a45700 1 -- 172.21.15.22:0/2017060820 shutdown_connections 2022-04-28T14:39:18.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.949 7fccc5a45700 1 --2- 172.21.15.22:0/2017060820 >> v2:172.21.15.22:3300/0 conn(0x7fccc01b2470 0x7fccc01b28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.949 7fccc5a45700 1 --2- 172.21.15.22:0/2017060820 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fccc00f6370 0x7fccc00f1270 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.949 7fccc5a45700 1 --2- 172.21.15.22:0/2017060820 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fccc00f67c0 0x7fccc00f18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:18.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.949 7fccc5a45700 1 -- 172.21.15.22:0/2017060820 >> 172.21.15.22:0/2017060820 conn(0x7fccc0117120 msgr2=0x7fccc00f2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:18.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.949 7fccc5a45700 1 -- 172.21.15.22:0/2017060820 shutdown_connections 2022-04-28T14:39:18.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.949 7fccc5a45700 1 -- 172.21.15.22:0/2017060820 wait complete. 2022-04-28T14:39:18.980 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.973 7fccc5a45700 1 Processor -- start 2022-04-28T14:39:19.008 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.973 7fccc5a45700 1 -- start start 2022-04-28T14:39:19.008 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.973 7fccc5a45700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fccc00b3bb0 0x7fccc00b4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:19.008 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.973 7fccc5a45700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fccc00df2e0 0x7fccc00df730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:19.008 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.973 7fccc5a45700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccc00dfd60 0x7fccc01c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:19.008 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.973 7fccc5a45700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc00f2f80 con 0x7fccc00dfd60 2022-04-28T14:39:19.008 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.973 7fccc5a45700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc00b3710 con 0x7fccc00df2e0 2022-04-28T14:39:19.009 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.973 7fccc5a45700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccc00d1660 con 0x7fccc00b3bb0 2022-04-28T14:39:19.009 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.973 7fccbe800700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fccc00b3bb0 0x7fccc00b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:19.009 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.973 7fccbe800700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fccc00b3bb0 0x7fccc00b4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46196/0 (socket says 172.21.15.22:46196) 2022-04-28T14:39:19.009 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.973 7fccbf001700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccc00dfd60 0x7fccc01c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:19.009 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.974 7fccbe800700 1 -- 172.21.15.22:0/3256147755 learned_addr learned my addr 172.21.15.22:0/3256147755 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:19.009 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.974 7fccbdfff700 1 --2- 172.21.15.22:0/3256147755 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fccc00df2e0 0x7fccc00df730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:19.009 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.974 7fccbe800700 1 -- 172.21.15.22:0/3256147755 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fccc00df2e0 msgr2=0x7fccc00df730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:19.009 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.974 7fccbe800700 1 --2- 172.21.15.22:0/3256147755 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fccc00df2e0 0x7fccc00df730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.009 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.974 7fccbe800700 1 -- 172.21.15.22:0/3256147755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccc00dfd60 msgr2=0x7fccc01c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:19.009 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.974 7fccbe800700 1 --2- 172.21.15.22:0/3256147755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccc00dfd60 0x7fccc01c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.010 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.974 7fccbe800700 1 -- 172.21.15.22:0/3256147755 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc00d1960 con 0x7fccc00b3bb0 2022-04-28T14:39:19.010 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.974 7fccbf001700 1 --2- 172.21.15.22:0/3256147755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccc00dfd60 0x7fccc01c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:19.010 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.974 7fccbe800700 1 --2- 172.21.15.22:0/3256147755 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fccc00b3bb0 0x7fccc00b4000 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fccc0116b00 tx=0x7fccb00068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:19.010 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.974 7fccaf7fe700 1 -- 172.21.15.22:0/3256147755 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fccc00d1960 con 0x7fccc00b3bb0 2022-04-28T14:39:19.010 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.974 7fccaf7fe700 1 -- 172.21.15.22:0/3256147755 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb0011610 con 0x7fccc00b3bb0 2022-04-28T14:39:19.010 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.974 7fccc5a45700 1 -- 172.21.15.22:0/3256147755 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc01c3000 con 0x7fccc00b3bb0 2022-04-28T14:39:19.010 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.974 7fccaf7fe700 1 -- 172.21.15.22:0/3256147755 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fccb00119e0 con 0x7fccc00b3bb0 2022-04-28T14:39:19.010 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.974 7fccc5a45700 1 -- 172.21.15.22:0/3256147755 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc01c5bf0 con 0x7fccc00b3bb0 2022-04-28T14:39:19.010 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.975 7fccaf7fe700 1 -- 172.21.15.22:0/3256147755 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fccb0011be0 con 0x7fccc00b3bb0 2022-04-28T14:39:19.011 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.975 7fccaf7fe700 1 -- 172.21.15.22:0/3256147755 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fccb000ed40 con 0x7fccc00b3bb0 2022-04-28T14:39:19.011 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.975 7fccc5a45700 1 -- 172.21.15.22:0/3256147755 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc00f02c0 con 0x7fccc00b3bb0 2022-04-28T14:39:19.011 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:18.978 7fccaf7fe700 1 -- 172.21.15.22:0/3256147755 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fccb0011400 con 0x7fccc00b3bb0 2022-04-28T14:39:19.094 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.090 7fccc5a45700 1 -- 172.21.15.22:0/3256147755 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fccc01c6680 con 0x7fccc00b3bb0 2022-04-28T14:39:19.095 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.091 7fccaf7fe700 1 -- 172.21.15.22:0/3256147755 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v3) v1 ==== 74+0+47391 (secure 0 0 0) 0x7fccb0041930 con 0x7fccc00b3bb0 2022-04-28T14:39:19.096 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:19.097 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.092 7fccc5a45700 1 -- 172.21.15.22:0/3256147755 >> v1:172.21.15.22:6808/86956 conn(0x7fcc9c01c1b0 legacy=0x7fcc9c01e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:19.097 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.092 7fccc5a45700 1 -- 172.21.15.22:0/3256147755 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fccc00b3bb0 msgr2=0x7fccc00b4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:19.097 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.092 7fccc5a45700 1 --2- 172.21.15.22:0/3256147755 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fccc00b3bb0 0x7fccc00b4000 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fccc0116b00 tx=0x7fccb00068c0).stop 2022-04-28T14:39:19.098 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.092 7fccc5a45700 1 -- 172.21.15.22:0/3256147755 shutdown_connections 2022-04-28T14:39:19.098 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.092 7fccc5a45700 1 --2- 172.21.15.22:0/3256147755 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccc00dfd60 0x7fccc01c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.098 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.092 7fccc5a45700 1 --2- 172.21.15.22:0/3256147755 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fccc00b3bb0 0x7fccc00b4000 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.098 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.092 7fccc5a45700 1 --2- 172.21.15.22:0/3256147755 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fccc00df2e0 0x7fccc00df730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.098 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.092 7fccc5a45700 1 -- 172.21.15.22:0/3256147755 >> 172.21.15.22:0/3256147755 conn(0x7fccc00ae080 msgr2=0x7fccc00ad460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:19.098 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.092 7fccc5a45700 1 -- 172.21.15.22:0/3256147755 shutdown_connections 2022-04-28T14:39:19.098 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.092 7fccc5a45700 1 -- 172.21.15.22:0/3256147755 wait complete. 2022-04-28T14:39:19.108 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":3,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6808","nonce":86956}]},"active_addr":"172.21.15.22:6808/86956","active_change":"2022-04-28 14:38:56.256627","available":true,"standbys":[{"gid":4109,"name":"x","available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_url":{"name":"server_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_iterations":{"name":"upmap_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimization iterations","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_url":{"name":"server_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_iterations":{"name":"upmap_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimization iterations","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"]}} 2022-04-28T14:39:19.115 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2022-04-28T14:39:19.115 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2022-04-28T14:39:19.115 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-28T14:39:19.244 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.239 7f3e042a7700 1 Processor -- start 2022-04-28T14:39:19.244 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.240 7f3e042a7700 1 -- start start 2022-04-28T14:39:19.247 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.240 7f3e042a7700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3dfc0f6440 0x7f3dfc0f1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:19.247 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.240 7f3e042a7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3dfc1b7890 0x7f3dfc1b9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:19.247 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.240 7f3e042a7700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dfc0ab2b0 con 0x7f3dfc0f6890 2022-04-28T14:39:19.247 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.240 7f3e042a7700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dfc0f2170 con 0x7f3dfc1b7890 2022-04-28T14:39:19.247 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.240 7f3e042a7700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc111cf0 con 0x7f3dfc0f6440 2022-04-28T14:39:19.247 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.240 7f3e010a6700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3dfc0f6440 0x7f3dfc0f1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:19.248 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.240 7f3e010a6700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3dfc0f6440 0x7f3dfc0f1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46420/0 (socket says 172.21.15.22:46420) 2022-04-28T14:39:19.248 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.240 7f3e018a7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3dfc1b7890 0x7f3dfc1b9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:19.248 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.240 7f3e010a6700 1 -- 172.21.15.22:0/623181126 learned_addr learned my addr 172.21.15.22:0/623181126 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:19.248 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.240 7f3e018a7700 1 -- 172.21.15.22:0/623181126 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3dfc0f6440 msgr2=0x7f3dfc0f1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:19.248 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.240 7f3e018a7700 1 --2- 172.21.15.22:0/623181126 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3dfc0f6440 0x7f3dfc0f1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.248 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.240 7f3e018a7700 1 -- 172.21.15.22:0/623181126 >> v1:172.21.15.22:6789/0 conn(0x7f3dfc0f6890 legacy=0x7f3dfc0f1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:19.248 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.241 7f3deffff700 1 -- 172.21.15.22:0/623181126 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3428792606 0 0) 0x7f3df8001110 con 0x7f3dfc0f6890 2022-04-28T14:39:19.248 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.241 7f3e018a7700 1 -- 172.21.15.22:0/623181126 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dfc10cbd0 con 0x7f3dfc1b7890 2022-04-28T14:39:19.248 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.241 7f3e010a6700 1 --2- 172.21.15.22:0/623181126 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3dfc0f6440 0x7f3dfc0f1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:19.248 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.241 7f3e018a7700 1 --2- 172.21.15.22:0/623181126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3dfc1b7890 0x7f3dfc1b9cf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f3df40032f0 tx=0x7f3df4009d10).ready entity=mon.0 client_cookie=9a6868070f6c10f3 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:19.249 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.241 7f3deffff700 1 -- 172.21.15.22:0/623181126 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3dfc10cbd0 con 0x7f3dfc1b7890 2022-04-28T14:39:19.249 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.241 7f3deffff700 1 -- 172.21.15.22:0/623181126 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df400b800 con 0x7f3dfc1b7890 2022-04-28T14:39:19.249 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.241 7f3deffff700 1 -- 172.21.15.22:0/623181126 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3df400ba30 con 0x7f3dfc1b7890 2022-04-28T14:39:19.249 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.241 7f3e042a7700 1 -- 172.21.15.22:0/623181126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3dfc1b7890 msgr2=0x7f3dfc1b9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:19.249 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.241 7f3e042a7700 1 --2- 172.21.15.22:0/623181126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3dfc1b7890 0x7f3dfc1b9cf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f3df40032f0 tx=0x7f3df4009d10).stop 2022-04-28T14:39:19.249 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.241 7f3e042a7700 1 -- 172.21.15.22:0/623181126 shutdown_connections 2022-04-28T14:39:19.249 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.241 7f3e042a7700 1 --2- 172.21.15.22:0/623181126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3dfc1b7890 0x7f3dfc1b9cf0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.249 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.241 7f3e042a7700 1 --2- 172.21.15.22:0/623181126 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3dfc0f6440 0x7f3dfc0f1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.249 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.241 7f3e042a7700 1 -- 172.21.15.22:0/623181126 >> 172.21.15.22:0/623181126 conn(0x7f3dfc1171f0 msgr2=0x7f3dfc0f2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:19.250 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.242 7f3e042a7700 1 -- 172.21.15.22:0/623181126 shutdown_connections 2022-04-28T14:39:19.250 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.242 7f3e042a7700 1 -- 172.21.15.22:0/623181126 wait complete. 2022-04-28T14:39:19.270 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.265 7f3e042a7700 1 Processor -- start 2022-04-28T14:39:19.270 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.265 7f3e042a7700 1 -- start start 2022-04-28T14:39:19.272 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.266 7f3e042a7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3dfc115bf0 0x7f3dfc116040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:19.272 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.266 7f3e042a7700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3dfc0df6e0 0x7f3dfc0dfb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:19.272 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.266 7f3e042a7700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3dfc0e0160 0x7f3dfc1c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:19.273 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.266 7f3e042a7700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc115410 con 0x7f3dfc115bf0 2022-04-28T14:39:19.273 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.266 7f3e042a7700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc115750 con 0x7f3dfc0e0160 2022-04-28T14:39:19.273 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.266 7f3e042a7700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3dfc114d60 con 0x7f3dfc0df6e0 2022-04-28T14:39:19.273 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.266 7f3e010a6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3dfc115bf0 0x7f3dfc116040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:19.273 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.266 7f3e018a7700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3dfc0e0160 0x7f3dfc1c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:19.273 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.266 7f3e010a6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3dfc115bf0 0x7f3dfc116040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48858/0 (socket says 172.21.15.22:48858) 2022-04-28T14:39:19.273 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.266 7f3e010a6700 1 -- 172.21.15.22:0/4120203118 learned_addr learned my addr 172.21.15.22:0/4120203118 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:19.273 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.266 7f3e008a5700 1 --2- 172.21.15.22:0/4120203118 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3dfc0df6e0 0x7f3dfc0dfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:19.273 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.266 7f3e010a6700 1 -- 172.21.15.22:0/4120203118 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3dfc0df6e0 msgr2=0x7f3dfc0dfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:19.273 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.266 7f3e010a6700 1 --2- 172.21.15.22:0/4120203118 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3dfc0df6e0 0x7f3dfc0dfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.274 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.266 7f3e010a6700 1 -- 172.21.15.22:0/4120203118 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3dfc0e0160 msgr2=0x7f3dfc1c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:19.274 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.266 7f3e010a6700 1 --2- 172.21.15.22:0/4120203118 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3dfc0e0160 0x7f3dfc1c5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.274 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.266 7f3e010a6700 1 -- 172.21.15.22:0/4120203118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dfc116ad0 con 0x7f3dfc115bf0 2022-04-28T14:39:19.274 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.266 7f3e018a7700 1 --2- 172.21.15.22:0/4120203118 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3dfc0e0160 0x7f3dfc1c5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:19.274 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.266 7f3e010a6700 1 --2- 172.21.15.22:0/4120203118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3dfc115bf0 0x7f3dfc116040 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f3dfc115900 tx=0x7f3df000ed00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:19.274 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.267 7f3dee7fc700 1 -- 172.21.15.22:0/4120203118 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3dfc116ad0 con 0x7f3dfc115bf0 2022-04-28T14:39:19.274 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.267 7f3dee7fc700 1 -- 172.21.15.22:0/4120203118 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df000ee40 con 0x7f3dfc115bf0 2022-04-28T14:39:19.274 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.267 7f3e042a7700 1 -- 172.21.15.22:0/4120203118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dfc1c5da0 con 0x7f3dfc115bf0 2022-04-28T14:39:19.274 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.267 7f3dee7fc700 1 -- 172.21.15.22:0/4120203118 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3df000f040 con 0x7f3dfc115bf0 2022-04-28T14:39:19.275 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.267 7f3e042a7700 1 -- 172.21.15.22:0/4120203118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dfc1c62d0 con 0x7f3dfc115bf0 2022-04-28T14:39:19.275 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.267 7f3dee7fc700 1 -- 172.21.15.22:0/4120203118 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f3df0011070 con 0x7f3dfc115bf0 2022-04-28T14:39:19.275 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.267 7f3dee7fc700 1 -- 172.21.15.22:0/4120203118 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f3df0010040 con 0x7f3dfc115bf0 2022-04-28T14:39:19.275 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.268 7f3e042a7700 1 -- 172.21.15.22:0/4120203118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dfc0f0390 con 0x7f3dfc115bf0 2022-04-28T14:39:19.275 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.271 7f3dee7fc700 1 -- 172.21.15.22:0/4120203118 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f3df000c5a0 con 0x7f3dfc115bf0 2022-04-28T14:39:19.373 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.369 7f3e042a7700 1 -- 172.21.15.22:0/4120203118 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3dfc0a5b80 con 0x7f3dfc115bf0 2022-04-28T14:39:19.374 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.369 7f3dee7fc700 1 -- 172.21.15.22:0/4120203118 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8815 (secure 0 0 0) 0x7f3df0000c30 con 0x7f3dfc115bf0 2022-04-28T14:39:19.374 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:19.374 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":16,"fsid":"3047163a-0285-4058-8e05-ce74c6fbb9c5","created":"2022-04-28 14:38:54.232890","modified":"2022-04-28 14:39:14.929380","last_up_change":"2022-04-28 14:39:00.269721","last_in_change":"2022-04-28 14:39:00.269721","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-04-28 14:39:03.639717","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-04-28 14:39:12.000229","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-04-28 14:39:12.915097","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782ee638-1ada-48d9-9454-f9e0ca8a3135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6800","nonce":87556}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":87556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":87556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":87556}]},"public_addr":"172.21.15.22:6800/87556","cluster_addr":"172.21.15.22:6801/87556","heartbeat_back_addr":"172.21.15.22:6803/87556","heartbeat_front_addr":"172.21.15.22:6802/87556","state":["exists","up"]},{"osd":1,"uuid":"61ca6f96-fb4f-4c0f-b68b-edf1e7011f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":87557}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":87557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":87557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":87557}]},"public_addr":"172.21.15.22:6804/87557","cluster_addr":"172.21.15.22:6805/87557","heartbeat_back_addr":"172.21.15.22:6807/87557","heartbeat_front_addr":"172.21.15.22:6806/87557","state":["exists","up"]},{"osd":2,"uuid":"4b3043b9-50df-4b7f-a55a-ac8e6148c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":87558}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":87558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":87558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":87558}]},"public_addr":"172.21.15.22:6813/87558","cluster_addr":"172.21.15.22:6814/87558","heartbeat_back_addr":"172.21.15.22:6816/87558","heartbeat_front_addr":"172.21.15.22:6815/87558","state":["exists","up"]},{"osd":3,"uuid":"7807bcd1-53f8-44b5-9992-57c328e5b299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":87561}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":87561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":87561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":87561}]},"public_addr":"172.21.15.22:6809/87561","cluster_addr":"172.21.15.22:6810/87561","heartbeat_back_addr":"172.21.15.22:6812/87561","heartbeat_front_addr":"172.21.15.22:6811/87561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-04-28T14:39:19.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.370 7f3e042a7700 1 -- 172.21.15.22:0/4120203118 >> v1:172.21.15.22:6808/86956 conn(0x7f3ddc01c1b0 legacy=0x7f3ddc01e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:19.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.370 7f3e042a7700 1 -- 172.21.15.22:0/4120203118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3dfc115bf0 msgr2=0x7f3dfc116040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:19.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.370 7f3e042a7700 1 --2- 172.21.15.22:0/4120203118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3dfc115bf0 0x7f3dfc116040 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f3dfc115900 tx=0x7f3df000ed00).stop 2022-04-28T14:39:19.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.370 7f3e042a7700 1 -- 172.21.15.22:0/4120203118 shutdown_connections 2022-04-28T14:39:19.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.370 7f3e042a7700 1 --2- 172.21.15.22:0/4120203118 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3dfc0e0160 0x7f3dfc1c5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.370 7f3e042a7700 1 --2- 172.21.15.22:0/4120203118 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3dfc115bf0 0x7f3dfc116040 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.370 7f3e042a7700 1 --2- 172.21.15.22:0/4120203118 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3dfc0df6e0 0x7f3dfc0dfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.371 7f3e042a7700 1 -- 172.21.15.22:0/4120203118 >> 172.21.15.22:0/4120203118 conn(0x7f3dfc0ad110 msgr2=0x7f3dfc0bb260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:19.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.371 7f3e042a7700 1 -- 172.21.15.22:0/4120203118 shutdown_connections 2022-04-28T14:39:19.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.371 7f3e042a7700 1 -- 172.21.15.22:0/4120203118 wait complete. 2022-04-28T14:39:19.386 INFO:tasks.ceph.ceph_manager.ceph:all up! 2022-04-28T14:39:19.386 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-28T14:39:19.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.511 7fe9567ab700 1 Processor -- start 2022-04-28T14:39:19.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.511 7fe9567ab700 1 -- start start 2022-04-28T14:39:19.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.511 7fe9567ab700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe9500f6300 0x7fe9500f1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:19.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.511 7fe9567ab700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe9500f1970 0x7fe9501b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:19.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.511 7fe9567ab700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe9500f1dc0 0x7fe9501b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:19.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.511 7fe9567ab700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe95010ecb0 con 0x7fe9500f1dc0 2022-04-28T14:39:19.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.511 7fe9567ab700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95010f240 con 0x7fe9500f1970 2022-04-28T14:39:19.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.511 7fe9567ab700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9501151f0 con 0x7fe9500f6300 2022-04-28T14:39:19.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.511 7fe94f3b0700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe9500f6300 0x7fe9500f1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:19.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.512 7fe94ebaf700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe9500f1970 0x7fe9501b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:19.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.512 7fe94f3b0700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe9500f6300 0x7fe9500f1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46218/0 (socket says 172.21.15.22:46218) 2022-04-28T14:39:19.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.512 7fe94f3b0700 1 -- 172.21.15.22:0/2096846756 learned_addr learned my addr 172.21.15.22:0/2096846756 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:19.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.512 7fe94fbb1700 1 --2- 172.21.15.22:0/2096846756 >> v2:172.21.15.22:3300/0 conn(0x7fe9500f1dc0 0x7fe9501b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:19.520 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.512 7fe94f3b0700 1 -- 172.21.15.22:0/2096846756 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe9500f1970 msgr2=0x7fe9501b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:19.520 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.512 7fe94f3b0700 1 --2- 172.21.15.22:0/2096846756 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe9500f1970 0x7fe9501b46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.520 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.512 7fe94f3b0700 1 -- 172.21.15.22:0/2096846756 >> v2:172.21.15.22:3300/0 conn(0x7fe9500f1dc0 msgr2=0x7fe9501b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:19.520 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.512 7fe94f3b0700 1 --2- 172.21.15.22:0/2096846756 >> v2:172.21.15.22:3300/0 conn(0x7fe9500f1dc0 0x7fe9501b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.520 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.512 7fe94f3b0700 1 -- 172.21.15.22:0/2096846756 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9501161d0 con 0x7fe9500f6300 2022-04-28T14:39:19.520 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.512 7fe94ebaf700 1 --2- 172.21.15.22:0/2096846756 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe9500f1970 0x7fe9501b46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:19.520 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.512 7fe94f3b0700 1 --2- 172.21.15.22:0/2096846756 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe9500f6300 0x7fe9500f1340 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fe95010f3f0 tx=0x7fe938009a00).ready entity=mon.2 client_cookie=cec622eba927ff29 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:19.520 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.512 7fe94e3ae700 1 -- 172.21.15.22:0/2096846756 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe9501161d0 con 0x7fe9500f6300 2022-04-28T14:39:19.520 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.512 7fe94e3ae700 1 -- 172.21.15.22:0/2096846756 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93800f510 con 0x7fe9500f6300 2022-04-28T14:39:19.520 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.512 7fe94e3ae700 1 -- 172.21.15.22:0/2096846756 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe93800f6f0 con 0x7fe9500f6300 2022-04-28T14:39:19.521 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.512 7fe9567ab700 1 -- 172.21.15.22:0/2096846756 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe9500f6300 msgr2=0x7fe9500f1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:19.521 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.512 7fe9567ab700 1 --2- 172.21.15.22:0/2096846756 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe9500f6300 0x7fe9500f1340 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fe95010f3f0 tx=0x7fe938009a00).stop 2022-04-28T14:39:19.521 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.513 7fe9567ab700 1 -- 172.21.15.22:0/2096846756 shutdown_connections 2022-04-28T14:39:19.521 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.513 7fe9567ab700 1 --2- 172.21.15.22:0/2096846756 >> v2:172.21.15.22:3300/0 conn(0x7fe9500f1dc0 0x7fe9501b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.521 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.513 7fe9567ab700 1 --2- 172.21.15.22:0/2096846756 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe9500f6300 0x7fe9500f1340 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.521 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.513 7fe9567ab700 1 --2- 172.21.15.22:0/2096846756 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe9500f1970 0x7fe9501b46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.521 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.513 7fe9567ab700 1 -- 172.21.15.22:0/2096846756 >> 172.21.15.22:0/2096846756 conn(0x7fe9501171f0 msgr2=0x7fe9500f2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:19.521 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.513 7fe9567ab700 1 -- 172.21.15.22:0/2096846756 shutdown_connections 2022-04-28T14:39:19.521 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.513 7fe9567ab700 1 -- 172.21.15.22:0/2096846756 wait complete. 2022-04-28T14:39:19.543 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.536 7fe9567ab700 1 Processor -- start 2022-04-28T14:39:19.543 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.537 7fe9567ab700 1 -- start start 2022-04-28T14:39:19.543 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.537 7fe9567ab700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9500d0850 0x7fe9500d5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:19.543 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.537 7fe9567ab700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe9500b7360 0x7fe9500b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:19.544 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.537 7fe9567ab700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe9500b7de0 0x7fe9501c5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:19.544 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.537 7fe9567ab700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9500b89a0 con 0x7fe9500d0850 2022-04-28T14:39:19.544 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.537 7fe9567ab700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9500b8ce0 con 0x7fe9500b7360 2022-04-28T14:39:19.544 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.537 7fe9567ab700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9500b83f0 con 0x7fe9500b7de0 2022-04-28T14:39:19.544 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.537 7fe94ebaf700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe9500b7360 0x7fe9500b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:19.544 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.537 7fe94f3b0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9500d0850 0x7fe9500d5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:19.544 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.537 7fe94fbb1700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe9500b7de0 0x7fe9501c5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:19.544 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.537 7fe94ebaf700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe9500b7360 0x7fe9500b77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46442/0 (socket says 172.21.15.22:46442) 2022-04-28T14:39:19.544 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.537 7fe94ebaf700 1 -- 172.21.15.22:0/2469132855 learned_addr learned my addr 172.21.15.22:0/2469132855 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:19.545 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.537 7fe94ebaf700 1 -- 172.21.15.22:0/2469132855 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe9500b7de0 msgr2=0x7fe9501c5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:19.545 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.537 7fe94ebaf700 1 --2- 172.21.15.22:0/2469132855 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe9500b7de0 0x7fe9501c5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.545 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.538 7fe94ebaf700 1 -- 172.21.15.22:0/2469132855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9500d0850 msgr2=0x7fe9500d5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:19.545 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.538 7fe94ebaf700 1 --2- 172.21.15.22:0/2469132855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9500d0850 0x7fe9500d5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.545 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.538 7fe94ebaf700 1 -- 172.21.15.22:0/2469132855 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9500ba410 con 0x7fe9500b7360 2022-04-28T14:39:19.545 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.538 7fe94fbb1700 1 --2- 172.21.15.22:0/2469132855 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe9500b7de0 0x7fe9501c5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:19.545 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.538 7fe94f3b0700 1 --2- 172.21.15.22:0/2469132855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9500d0850 0x7fe9500d5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:19.545 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.538 7fe94ebaf700 1 --2- 172.21.15.22:0/2469132855 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe9500b7360 0x7fe9500b77b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fe95010f1c0 tx=0x7fe94000ed00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:19.545 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.538 7fe94cbab700 1 -- 172.21.15.22:0/2469132855 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe9500ba410 con 0x7fe9500b7360 2022-04-28T14:39:19.545 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.538 7fe94cbab700 1 -- 172.21.15.22:0/2469132855 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94000c940 con 0x7fe9500b7360 2022-04-28T14:39:19.546 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.538 7fe9567ab700 1 -- 172.21.15.22:0/2469132855 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9501c5d50 con 0x7fe9500b7360 2022-04-28T14:39:19.546 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.538 7fe94cbab700 1 -- 172.21.15.22:0/2469132855 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe94000f040 con 0x7fe9500b7360 2022-04-28T14:39:19.546 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.538 7fe9567ab700 1 -- 172.21.15.22:0/2469132855 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9501c62a0 con 0x7fe9500b7360 2022-04-28T14:39:19.546 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.538 7fe94cbab700 1 -- 172.21.15.22:0/2469132855 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fe940011070 con 0x7fe9500b7360 2022-04-28T14:39:19.546 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.538 7fe94cbab700 1 -- 172.21.15.22:0/2469132855 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fe940010040 con 0x7fe9500b7360 2022-04-28T14:39:19.547 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.539 7fe9567ab700 1 -- 172.21.15.22:0/2469132855 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9500ab2b0 con 0x7fe9500b7360 2022-04-28T14:39:19.547 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.542 7fe94cbab700 1 -- 172.21.15.22:0/2469132855 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fe94000c540 con 0x7fe9500b7360 2022-04-28T14:39:19.645 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.641 7fe9567ab700 1 -- 172.21.15.22:0/2469132855 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9500a5b80 con 0x7fe9500b7360 2022-04-28T14:39:19.646 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.641 7fe94cbab700 1 -- 172.21.15.22:0/2469132855 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8815 (secure 0 0 0) 0x7fe940000c30 con 0x7fe9500b7360 2022-04-28T14:39:19.646 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:19.646 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":16,"fsid":"3047163a-0285-4058-8e05-ce74c6fbb9c5","created":"2022-04-28 14:38:54.232890","modified":"2022-04-28 14:39:14.929380","last_up_change":"2022-04-28 14:39:00.269721","last_in_change":"2022-04-28 14:39:00.269721","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-04-28 14:39:03.639717","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-04-28 14:39:12.000229","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-04-28 14:39:12.915097","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782ee638-1ada-48d9-9454-f9e0ca8a3135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6800","nonce":87556}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":87556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":87556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":87556}]},"public_addr":"172.21.15.22:6800/87556","cluster_addr":"172.21.15.22:6801/87556","heartbeat_back_addr":"172.21.15.22:6803/87556","heartbeat_front_addr":"172.21.15.22:6802/87556","state":["exists","up"]},{"osd":1,"uuid":"61ca6f96-fb4f-4c0f-b68b-edf1e7011f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":87557}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":87557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":87557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":87557}]},"public_addr":"172.21.15.22:6804/87557","cluster_addr":"172.21.15.22:6805/87557","heartbeat_back_addr":"172.21.15.22:6807/87557","heartbeat_front_addr":"172.21.15.22:6806/87557","state":["exists","up"]},{"osd":2,"uuid":"4b3043b9-50df-4b7f-a55a-ac8e6148c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":87558}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":87558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":87558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":87558}]},"public_addr":"172.21.15.22:6813/87558","cluster_addr":"172.21.15.22:6814/87558","heartbeat_back_addr":"172.21.15.22:6816/87558","heartbeat_front_addr":"172.21.15.22:6815/87558","state":["exists","up"]},{"osd":3,"uuid":"7807bcd1-53f8-44b5-9992-57c328e5b299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":87561}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":87561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":87561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":87561}]},"public_addr":"172.21.15.22:6809/87561","cluster_addr":"172.21.15.22:6810/87561","heartbeat_back_addr":"172.21.15.22:6812/87561","heartbeat_front_addr":"172.21.15.22:6811/87561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-04-28T14:39:19.648 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.642 7fe9567ab700 1 -- 172.21.15.22:0/2469132855 >> v1:172.21.15.22:6808/86956 conn(0x7fe93401c1b0 legacy=0x7fe93401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:19.648 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.642 7fe9567ab700 1 -- 172.21.15.22:0/2469132855 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe9500b7360 msgr2=0x7fe9500b77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:19.648 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.642 7fe9567ab700 1 --2- 172.21.15.22:0/2469132855 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe9500b7360 0x7fe9500b77b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fe95010f1c0 tx=0x7fe94000ed00).stop 2022-04-28T14:39:19.648 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.642 7fe9567ab700 1 -- 172.21.15.22:0/2469132855 shutdown_connections 2022-04-28T14:39:19.648 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.642 7fe9567ab700 1 --2- 172.21.15.22:0/2469132855 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe9500b7de0 0x7fe9501c5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.648 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.643 7fe9567ab700 1 --2- 172.21.15.22:0/2469132855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9500d0850 0x7fe9500d5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.648 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.643 7fe9567ab700 1 --2- 172.21.15.22:0/2469132855 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe9500b7360 0x7fe9500b77b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.649 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.643 7fe9567ab700 1 -- 172.21.15.22:0/2469132855 >> 172.21.15.22:0/2469132855 conn(0x7fe9500acea0 msgr2=0x7fe9500bb070 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:19.649 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.643 7fe9567ab700 1 -- 172.21.15.22:0/2469132855 shutdown_connections 2022-04-28T14:39:19.649 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.643 7fe9567ab700 1 -- 172.21.15.22:0/2469132855 wait complete. 2022-04-28T14:39:19.658 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2022-04-28T14:39:19.791 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.784 7fd7ff041700 1 Processor -- start 2022-04-28T14:39:19.791 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.784 7fd7ff041700 1 -- start start 2022-04-28T14:39:19.791 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.784 7fd7ff041700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd7f8103890 0x7fd7f81b6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:19.791 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.784 7fd7ff041700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd7f8103ce0 0x7fd7f81b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:19.791 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.784 7fd7ff041700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f80ff930 con 0x7fd7f80f6500 2022-04-28T14:39:19.791 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.784 7fd7ff041700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f81116a0 con 0x7fd7f8103ce0 2022-04-28T14:39:19.791 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.784 7fd7ff041700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f8115fb0 con 0x7fd7f8103890 2022-04-28T14:39:19.792 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.784 7fd7f6ffd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd7f8103890 0x7fd7f81b6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:19.792 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.785 7fd7f7fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd7f8103ce0 0x7fd7f81b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:19.792 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.785 7fd7f6ffd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd7f8103890 0x7fd7f81b6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46234/0 (socket says 172.21.15.22:46234) 2022-04-28T14:39:19.792 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.785 7fd7f6ffd700 1 -- 172.21.15.22:0/3511373881 learned_addr learned my addr 172.21.15.22:0/3511373881 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:19.792 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.785 7fd7f7fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd7f8103ce0 0x7fd7f81b9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48884/0 (socket says 172.21.15.22:48884) 2022-04-28T14:39:19.792 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.785 7fd7f77fe700 1 --1- 172.21.15.22:0/3511373881 >> v1:172.21.15.22:6789/0 conn(0x7fd7f80f6500 0x7fd7f8103090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38276/0 (socket says 172.21.15.22:38276) 2022-04-28T14:39:19.792 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.785 7fd7f6ffd700 1 -- 172.21.15.22:0/3511373881 >> v2:172.21.15.22:3300/0 conn(0x7fd7f8103ce0 msgr2=0x7fd7f81b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:19.792 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.785 7fd7f6ffd700 1 --2- 172.21.15.22:0/3511373881 >> v2:172.21.15.22:3300/0 conn(0x7fd7f8103ce0 0x7fd7f81b9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.792 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.785 7fd7f6ffd700 1 -- 172.21.15.22:0/3511373881 >> v1:172.21.15.22:6789/0 conn(0x7fd7f80f6500 legacy=0x7fd7f8103090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:19.793 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.785 7fd7f67fc700 1 -- 172.21.15.22:0/3511373881 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190681602 0 0) 0x7fd7e8001110 con 0x7fd7f80f6500 2022-04-28T14:39:19.793 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.785 7fd7f6ffd700 1 -- 172.21.15.22:0/3511373881 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f810c2c0 con 0x7fd7f8103890 2022-04-28T14:39:19.793 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.785 7fd7f7fff700 1 --2- 172.21.15.22:0/3511373881 >> v2:172.21.15.22:3300/0 conn(0x7fd7f8103ce0 0x7fd7f81b9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:19.793 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.785 7fd7f6ffd700 1 --2- 172.21.15.22:0/3511373881 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd7f8103890 0x7fd7f81b6b40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fd7e0002f70 tx=0x7fd7e000bc00).ready entity=mon.2 client_cookie=957977c35d680de1 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:19.793 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.785 7fd7f67fc700 1 -- 172.21.15.22:0/3511373881 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd7f810c2c0 con 0x7fd7f8103890 2022-04-28T14:39:19.793 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.785 7fd7f67fc700 1 -- 172.21.15.22:0/3511373881 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e000dc20 con 0x7fd7f8103890 2022-04-28T14:39:19.793 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.785 7fd7f67fc700 1 -- 172.21.15.22:0/3511373881 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd7e0010470 con 0x7fd7f8103890 2022-04-28T14:39:19.793 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.785 7fd7ff041700 1 -- 172.21.15.22:0/3511373881 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd7f8103890 msgr2=0x7fd7f81b6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:19.793 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.785 7fd7ff041700 1 --2- 172.21.15.22:0/3511373881 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd7f8103890 0x7fd7f81b6b40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fd7e0002f70 tx=0x7fd7e000bc00).stop 2022-04-28T14:39:19.794 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.786 7fd7ff041700 1 -- 172.21.15.22:0/3511373881 shutdown_connections 2022-04-28T14:39:19.794 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.786 7fd7ff041700 1 --2- 172.21.15.22:0/3511373881 >> v2:172.21.15.22:3300/0 conn(0x7fd7f8103ce0 0x7fd7f81b9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.794 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.786 7fd7ff041700 1 --2- 172.21.15.22:0/3511373881 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd7f8103890 0x7fd7f81b6b40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.794 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.786 7fd7ff041700 1 -- 172.21.15.22:0/3511373881 >> 172.21.15.22:0/3511373881 conn(0x7fd7f8117270 msgr2=0x7fd7f80f2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:19.794 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.786 7fd7ff041700 1 -- 172.21.15.22:0/3511373881 shutdown_connections 2022-04-28T14:39:19.794 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.786 7fd7ff041700 1 -- 172.21.15.22:0/3511373881 wait complete. 2022-04-28T14:39:19.815 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.810 7fd7ff041700 1 Processor -- start 2022-04-28T14:39:19.815 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.810 7fd7ff041700 1 -- start start 2022-04-28T14:39:19.817 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.810 7fd7ff041700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd7f80dc7f0 0x7fd7f80b3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:19.817 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.810 7fd7ff041700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd7f80b3eb0 0x7fd7f81c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:19.817 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.810 7fd7ff041700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7f80b4300 0x7fd7f81c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:19.817 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.810 7fd7ff041700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f8117250 con 0x7fd7f80b4300 2022-04-28T14:39:19.818 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.810 7fd7ff041700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80b7400 con 0x7fd7f80dc7f0 2022-04-28T14:39:19.818 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.810 7fd7ff041700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80bc480 con 0x7fd7f80b3eb0 2022-04-28T14:39:19.818 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.811 7fd7f77fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd7f80dc7f0 0x7fd7f80b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:19.818 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.811 7fd7f7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7f80b4300 0x7fd7f81c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:19.818 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.811 7fd7f6ffd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd7f80b3eb0 0x7fd7f81c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:19.818 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.811 7fd7f7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7f80b4300 0x7fd7f81c6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48890/0 (socket says 172.21.15.22:48890) 2022-04-28T14:39:19.818 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.811 7fd7f77fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd7f80dc7f0 0x7fd7f80b3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46454/0 (socket says 172.21.15.22:46454) 2022-04-28T14:39:19.818 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.811 7fd7f7fff700 1 -- 172.21.15.22:0/882598618 learned_addr learned my addr 172.21.15.22:0/882598618 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:19.819 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.811 7fd7f7fff700 1 -- 172.21.15.22:0/882598618 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd7f80b3eb0 msgr2=0x7fd7f81c5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:19.819 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.811 7fd7f7fff700 1 --2- 172.21.15.22:0/882598618 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd7f80b3eb0 0x7fd7f81c5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.819 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.811 7fd7f7fff700 1 -- 172.21.15.22:0/882598618 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd7f80dc7f0 msgr2=0x7fd7f80b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:19.819 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.811 7fd7f7fff700 1 --2- 172.21.15.22:0/882598618 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd7f80dc7f0 0x7fd7f80b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.819 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.811 7fd7f7fff700 1 -- 172.21.15.22:0/882598618 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f80bc6f0 con 0x7fd7f80b4300 2022-04-28T14:39:19.819 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.811 7fd7f77fe700 1 --2- 172.21.15.22:0/882598618 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd7f80dc7f0 0x7fd7f80b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:19.819 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.811 7fd7f6ffd700 1 --2- 172.21.15.22:0/882598618 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd7f80b3eb0 0x7fd7f81c5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:19.819 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.811 7fd7f7fff700 1 --2- 172.21.15.22:0/882598618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7f80b4300 0x7fd7f81c6270 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fd7f80bdde0 tx=0x7fd7f000eea0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:19.819 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.811 7fd7f4ff9700 1 -- 172.21.15.22:0/882598618 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd7f80bc6f0 con 0x7fd7f80b4300 2022-04-28T14:39:19.820 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.811 7fd7f4ff9700 1 -- 172.21.15.22:0/882598618 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f000c8e0 con 0x7fd7f80b4300 2022-04-28T14:39:19.820 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.811 7fd7ff041700 1 -- 172.21.15.22:0/882598618 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f80dd080 con 0x7fd7f80b4300 2022-04-28T14:39:19.820 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.811 7fd7f4ff9700 1 -- 172.21.15.22:0/882598618 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd7f000f040 con 0x7fd7f80b4300 2022-04-28T14:39:19.820 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.811 7fd7ff041700 1 -- 172.21.15.22:0/882598618 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f81c68a0 con 0x7fd7f80b4300 2022-04-28T14:39:19.820 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.812 7fd7f4ff9700 1 -- 172.21.15.22:0/882598618 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fd7f0022060 con 0x7fd7f80b4300 2022-04-28T14:39:19.820 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.812 7fd7f4ff9700 1 -- 172.21.15.22:0/882598618 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fd7f0010040 con 0x7fd7f80b4300 2022-04-28T14:39:19.820 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.812 7fd7ff041700 1 -- 172.21.15.22:0/882598618 --> v1:172.21.15.22:6800/87556 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd7f80882a0 con 0x7fd7f81b59f0 2022-04-28T14:39:19.820 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.813 7fd7f4ff9700 1 -- 172.21.15.22:0/882598618 <== osd.0 v1:172.21.15.22:6800/87556 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7fd7e0010470 con 0x7fd7f81b59f0 2022-04-28T14:39:19.824 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.819 7fd7ff041700 1 -- 172.21.15.22:0/882598618 --> v1:172.21.15.22:6800/87556 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd7f80f0410 con 0x7fd7f81b59f0 2022-04-28T14:39:19.824 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.819 7fd7f4ff9700 1 -- 172.21.15.22:0/882598618 <== osd.0 v1:172.21.15.22:6800/87556 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2374206864) 0x7fd7f80f0410 con 0x7fd7f81b59f0 2022-04-28T14:39:19.824 INFO:teuthology.orchestra.run.smithi022.stdout:38654705670 2022-04-28T14:39:19.826 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.820 7fd7ff041700 1 -- 172.21.15.22:0/882598618 >> v1:172.21.15.22:6800/87556 conn(0x7fd7f81b59f0 legacy=0x7fd7f80a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:19.826 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.820 7fd7ff041700 1 -- 172.21.15.22:0/882598618 >> v1:172.21.15.22:6808/86956 conn(0x7fd7dc01c1b0 legacy=0x7fd7dc01e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:19.826 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.820 7fd7ff041700 1 -- 172.21.15.22:0/882598618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7f80b4300 msgr2=0x7fd7f81c6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:19.826 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.820 7fd7ff041700 1 --2- 172.21.15.22:0/882598618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7f80b4300 0x7fd7f81c6270 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fd7f80bdde0 tx=0x7fd7f000eea0).stop 2022-04-28T14:39:19.826 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.820 7fd7f7fff700 1 -- 172.21.15.22:0/882598618 reap_dead start 2022-04-28T14:39:19.826 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.820 7fd7ff041700 1 -- 172.21.15.22:0/882598618 shutdown_connections 2022-04-28T14:39:19.827 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.820 7fd7ff041700 1 -- 172.21.15.22:0/882598618 >> 172.21.15.22:0/882598618 conn(0x7fd7f80bcc80 msgr2=0x7fd7f81b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:19.827 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.820 7fd7ff041700 1 -- 172.21.15.22:0/882598618 shutdown_connections 2022-04-28T14:39:19.827 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.820 7fd7ff041700 1 -- 172.21.15.22:0/882598618 wait complete. 2022-04-28T14:39:19.835 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2022-04-28T14:39:19.968 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.961 7fb61a59b700 1 Processor -- start 2022-04-28T14:39:19.968 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.961 7fb61a59b700 1 -- start start 2022-04-28T14:39:19.968 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.961 7fb61a59b700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb6140f64d0 0x7fb6140feab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:19.968 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.961 7fb61a59b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb6140ff0e0 0x7fb6141b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:19.968 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.961 7fb61a59b700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6140ab2e0 con 0x7fb6140ff530 2022-04-28T14:39:19.968 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.961 7fb61a59b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6141b23d0 con 0x7fb6140ff0e0 2022-04-28T14:39:19.969 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.961 7fb61a59b700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb614115f10 con 0x7fb6140f64d0 2022-04-28T14:39:19.969 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.961 7fb6132c1700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb6140f64d0 0x7fb6140feab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:19.969 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.961 7fb612ac0700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb6140ff0e0 0x7fb6141b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:19.969 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.961 7fb613ac2700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb6140ff530 0x7fb6141b1bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38296/0 (socket says 172.21.15.22:38296) 2022-04-28T14:39:19.969 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.961 7fb613ac2700 1 -- 172.21.15.22:0/3812084234 learned_addr learned my addr 172.21.15.22:0/3812084234 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:39:19.969 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.962 7fb6132c1700 1 -- 172.21.15.22:0/3812084234 >> v2:172.21.15.22:3300/0 conn(0x7fb6140ff0e0 msgr2=0x7fb6141b15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:19.969 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.962 7fb6132c1700 1 --2- 172.21.15.22:0/3812084234 >> v2:172.21.15.22:3300/0 conn(0x7fb6140ff0e0 0x7fb6141b15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.969 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.962 7fb6132c1700 1 -- 172.21.15.22:0/3812084234 >> v1:172.21.15.22:6789/0 conn(0x7fb6140ff530 legacy=0x7fb6141b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:19.969 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.962 7fb6132c1700 1 -- 172.21.15.22:0/3812084234 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61410b910 con 0x7fb6140f64d0 2022-04-28T14:39:19.970 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.962 7fb612ac0700 1 --2- 172.21.15.22:0/3812084234 >> v2:172.21.15.22:3300/0 conn(0x7fb6140ff0e0 0x7fb6141b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:19.970 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.962 7fb6132c1700 1 --2- 172.21.15.22:0/3812084234 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb6140f64d0 0x7fb6140feab0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fb608002f70 tx=0x7fb60800b970).ready entity=mon.2 client_cookie=c317a7477f7349c6 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:19.971 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.962 7fb6122bf700 1 -- 172.21.15.22:0/3812084234 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb61410b910 con 0x7fb6140f64d0 2022-04-28T14:39:19.971 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.962 7fb6122bf700 1 -- 172.21.15.22:0/3812084234 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60800d5c0 con 0x7fb6140f64d0 2022-04-28T14:39:19.971 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.962 7fb6122bf700 1 -- 172.21.15.22:0/3812084234 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb60800d990 con 0x7fb6140f64d0 2022-04-28T14:39:19.971 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.962 7fb61a59b700 1 -- 172.21.15.22:0/3812084234 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb6140f64d0 msgr2=0x7fb6140feab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:19.971 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.962 7fb61a59b700 1 --2- 172.21.15.22:0/3812084234 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb6140f64d0 0x7fb6140feab0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fb608002f70 tx=0x7fb60800b970).stop 2022-04-28T14:39:19.971 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.963 7fb61a59b700 1 -- 172.21.15.22:0/3812084234 shutdown_connections 2022-04-28T14:39:19.971 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.963 7fb61a59b700 1 --2- 172.21.15.22:0/3812084234 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb6140f64d0 0x7fb6140feab0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.971 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.963 7fb61a59b700 1 --2- 172.21.15.22:0/3812084234 >> v2:172.21.15.22:3300/0 conn(0x7fb6140ff0e0 0x7fb6141b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.971 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.963 7fb61a59b700 1 -- 172.21.15.22:0/3812084234 >> 172.21.15.22:0/3812084234 conn(0x7fb614117260 msgr2=0x7fb6140f2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:19.972 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.963 7fb61a59b700 1 -- 172.21.15.22:0/3812084234 shutdown_connections 2022-04-28T14:39:19.972 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.963 7fb61a59b700 1 -- 172.21.15.22:0/3812084234 wait complete. 2022-04-28T14:39:19.991 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.987 7fb61a59b700 1 Processor -- start 2022-04-28T14:39:19.991 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.987 7fb61a59b700 1 -- start start 2022-04-28T14:39:19.994 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.987 7fb61a59b700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb6140bd100 0x7fb6141c1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:19.995 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.987 7fb61a59b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6141c1c60 0x7fb6141b3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:19.995 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.987 7fb61a59b700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb6141c20b0 0x7fb6141b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:19.995 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.987 7fb61a59b700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6140d2110 con 0x7fb6141c1c60 2022-04-28T14:39:19.995 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.987 7fb61a59b700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6140d00b0 con 0x7fb6140bd100 2022-04-28T14:39:19.995 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.987 7fb61a59b700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6140bd8a0 con 0x7fb6141c20b0 2022-04-28T14:39:19.995 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.987 7fb6132c1700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb6140bd100 0x7fb6141c1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:19.995 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.987 7fb613ac2700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb6141c20b0 0x7fb6141b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:19.995 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.987 7fb612ac0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6141c1c60 0x7fb6141b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:19.996 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.988 7fb612ac0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6141c1c60 0x7fb6141b3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48904/0 (socket says 172.21.15.22:48904) 2022-04-28T14:39:19.996 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.988 7fb6132c1700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb6140bd100 0x7fb6141c1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46470/0 (socket says 172.21.15.22:46470) 2022-04-28T14:39:19.996 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.988 7fb612ac0700 1 -- 172.21.15.22:0/3338301769 learned_addr learned my addr 172.21.15.22:0/3338301769 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:19.996 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.988 7fb613ac2700 1 -- 172.21.15.22:0/3338301769 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb6140bd100 msgr2=0x7fb6141c1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:19.996 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.988 7fb613ac2700 1 --2- 172.21.15.22:0/3338301769 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb6140bd100 0x7fb6141c1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.996 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.988 7fb613ac2700 1 -- 172.21.15.22:0/3338301769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6141c1c60 msgr2=0x7fb6141b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:19.996 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.988 7fb613ac2700 1 --2- 172.21.15.22:0/3338301769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6141c1c60 0x7fb6141b3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:19.996 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.988 7fb613ac2700 1 -- 172.21.15.22:0/3338301769 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6140bd550 con 0x7fb6141c20b0 2022-04-28T14:39:19.996 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.988 7fb612ac0700 1 --2- 172.21.15.22:0/3338301769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6141c1c60 0x7fb6141b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:19.997 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.988 7fb613ac2700 1 --2- 172.21.15.22:0/3338301769 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb6141c20b0 0x7fb6141b3b70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fb6140d0350 tx=0x7fb60c00c8e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:19.997 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.988 7fb610abc700 1 -- 172.21.15.22:0/3338301769 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb6140bd550 con 0x7fb6141c20b0 2022-04-28T14:39:19.997 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.988 7fb610abc700 1 -- 172.21.15.22:0/3338301769 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60c005bb0 con 0x7fb6141c20b0 2022-04-28T14:39:19.997 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.988 7fb61a59b700 1 -- 172.21.15.22:0/3338301769 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6141b4720 con 0x7fb6141c20b0 2022-04-28T14:39:19.997 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.988 7fb610abc700 1 -- 172.21.15.22:0/3338301769 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb60c0048b0 con 0x7fb6141c20b0 2022-04-28T14:39:19.997 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.988 7fb61a59b700 1 -- 172.21.15.22:0/3338301769 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6140cf680 con 0x7fb6141c20b0 2022-04-28T14:39:19.997 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.989 7fb610abc700 1 -- 172.21.15.22:0/3338301769 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fb60c004ab0 con 0x7fb6141c20b0 2022-04-28T14:39:19.997 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.989 7fb610abc700 1 -- 172.21.15.22:0/3338301769 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fb60c029150 con 0x7fb6141c20b0 2022-04-28T14:39:19.997 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.989 7fb61a59b700 1 -- 172.21.15.22:0/3338301769 --> v1:172.21.15.22:6804/87557 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb6140a9050 con 0x7fb6141205d0 2022-04-28T14:39:19.998 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.990 7fb610abc700 1 -- 172.21.15.22:0/3338301769 <== osd.1 v1:172.21.15.22:6804/87557 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7fb6140a9050 con 0x7fb6141205d0 2022-04-28T14:39:20.001 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.996 7fb61a59b700 1 -- 172.21.15.22:0/3338301769 --> v1:172.21.15.22:6804/87557 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb6140882a0 con 0x7fb6141205d0 2022-04-28T14:39:20.001 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.996 7fb610abc700 1 -- 172.21.15.22:0/3338301769 <== osd.1 v1:172.21.15.22:6804/87557 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2792639521) 0x7fb60400dcf0 con 0x7fb6141205d0 2022-04-28T14:39:20.001 INFO:teuthology.orchestra.run.smithi022.stdout:38654705669 2022-04-28T14:39:20.002 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.997 7fb61a59b700 1 -- 172.21.15.22:0/3338301769 >> v1:172.21.15.22:6804/87557 conn(0x7fb6141205d0 legacy=0x7fb6140a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:20.003 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.997 7fb61a59b700 1 -- 172.21.15.22:0/3338301769 >> v1:172.21.15.22:6808/86956 conn(0x7fb5f401c1b0 legacy=0x7fb5f401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:20.003 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.997 7fb61a59b700 1 -- 172.21.15.22:0/3338301769 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb6141c20b0 msgr2=0x7fb6141b3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:20.003 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.997 7fb61a59b700 1 --2- 172.21.15.22:0/3338301769 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb6141c20b0 0x7fb6141b3b70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fb6140d0350 tx=0x7fb60c00c8e0).stop 2022-04-28T14:39:20.003 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.997 7fb613ac2700 1 -- 172.21.15.22:0/3338301769 reap_dead start 2022-04-28T14:39:20.003 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.997 7fb61a59b700 1 -- 172.21.15.22:0/3338301769 shutdown_connections 2022-04-28T14:39:20.003 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.997 7fb61a59b700 1 -- 172.21.15.22:0/3338301769 >> 172.21.15.22:0/3338301769 conn(0x7fb6140acf90 msgr2=0x7fb6140ac400 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:20.003 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.997 7fb61a59b700 1 -- 172.21.15.22:0/3338301769 shutdown_connections 2022-04-28T14:39:20.003 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:19.997 7fb61a59b700 1 -- 172.21.15.22:0/3338301769 wait complete. 2022-04-28T14:39:20.012 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2022-04-28T14:39:20.142 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.137 7f3de5e1f700 1 Processor -- start 2022-04-28T14:39:20.142 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.137 7f3de5e1f700 1 -- start start 2022-04-28T14:39:20.145 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.138 7f3de5e1f700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3de0115840 0x7f3de00f13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:20.145 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.138 7f3de5e1f700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3de00f19f0 0x7f3de01b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:20.145 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.138 7f3de5e1f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3de00f1e40 0x7f3de01b5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:20.145 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.138 7f3de5e1f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de010efe0 con 0x7f3de00f1e40 2022-04-28T14:39:20.145 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.138 7f3de5e1f700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de01153a0 con 0x7f3de00f19f0 2022-04-28T14:39:20.145 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.138 7f3de5e1f700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3de01160a0 con 0x7f3de0115840 2022-04-28T14:39:20.146 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.138 7f3ddeab2700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3de0115840 0x7f3de00f13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:20.146 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.138 7f3ddf2b3700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3de00f1e40 0x7f3de01b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:20.146 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.138 7f3dde2b1700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3de00f19f0 0x7f3de01b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:20.146 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.138 7f3ddeab2700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3de0115840 0x7f3de00f13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46264/0 (socket says 172.21.15.22:46264) 2022-04-28T14:39:20.146 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.138 7f3ddf2b3700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3de00f1e40 0x7f3de01b5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48916/0 (socket says 172.21.15.22:48916) 2022-04-28T14:39:20.146 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.138 7f3dde2b1700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3de00f19f0 0x7f3de01b4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46482/0 (socket says 172.21.15.22:46482) 2022-04-28T14:39:20.146 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.138 7f3ddeab2700 1 -- 172.21.15.22:0/408565199 learned_addr learned my addr 172.21.15.22:0/408565199 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:20.146 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.138 7f3ddeab2700 1 -- 172.21.15.22:0/408565199 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3de00f19f0 msgr2=0x7f3de01b4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:20.146 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.138 7f3ddeab2700 1 --2- 172.21.15.22:0/408565199 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3de00f19f0 0x7f3de01b4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:20.146 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.138 7f3ddeab2700 1 -- 172.21.15.22:0/408565199 >> v2:172.21.15.22:3300/0 conn(0x7f3de00f1e40 msgr2=0x7f3de01b5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:20.147 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.138 7f3ddeab2700 1 --2- 172.21.15.22:0/408565199 >> v2:172.21.15.22:3300/0 conn(0x7f3de00f1e40 0x7f3de01b5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:20.147 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.138 7f3ddeab2700 1 -- 172.21.15.22:0/408565199 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de010ec20 con 0x7f3de0115840 2022-04-28T14:39:20.147 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.138 7f3dde2b1700 1 --2- 172.21.15.22:0/408565199 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3de00f19f0 0x7f3de01b4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:20.147 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.138 7f3ddf2b3700 1 --2- 172.21.15.22:0/408565199 >> v2:172.21.15.22:3300/0 conn(0x7f3de00f1e40 0x7f3de01b5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:20.147 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.138 7f3ddeab2700 1 --2- 172.21.15.22:0/408565199 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3de0115840 0x7f3de00f13c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f3dc8002f70 tx=0x7f3dc80099d0).ready entity=mon.2 client_cookie=b799b7e43b8bdf12 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:20.147 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.138 7f3dddab0700 1 -- 172.21.15.22:0/408565199 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3de010ec20 con 0x7f3de0115840 2022-04-28T14:39:20.147 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.138 7f3dddab0700 1 -- 172.21.15.22:0/408565199 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc800f510 con 0x7f3de0115840 2022-04-28T14:39:20.147 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.138 7f3dddab0700 1 -- 172.21.15.22:0/408565199 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3dc800f6f0 con 0x7f3de0115840 2022-04-28T14:39:20.147 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.138 7f3de5e1f700 1 -- 172.21.15.22:0/408565199 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3de0115840 msgr2=0x7f3de00f13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:20.147 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.138 7f3de5e1f700 1 --2- 172.21.15.22:0/408565199 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3de0115840 0x7f3de00f13c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f3dc8002f70 tx=0x7f3dc80099d0).stop 2022-04-28T14:39:20.148 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.139 7f3de5e1f700 1 -- 172.21.15.22:0/408565199 shutdown_connections 2022-04-28T14:39:20.148 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.139 7f3de5e1f700 1 --2- 172.21.15.22:0/408565199 >> v2:172.21.15.22:3300/0 conn(0x7f3de00f1e40 0x7f3de01b5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:20.148 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.139 7f3de5e1f700 1 --2- 172.21.15.22:0/408565199 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3de0115840 0x7f3de00f13c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:20.148 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.139 7f3de5e1f700 1 --2- 172.21.15.22:0/408565199 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3de00f19f0 0x7f3de01b4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:20.148 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.139 7f3de5e1f700 1 -- 172.21.15.22:0/408565199 >> 172.21.15.22:0/408565199 conn(0x7f3de0117270 msgr2=0x7f3de00f2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:20.148 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.139 7f3de5e1f700 1 -- 172.21.15.22:0/408565199 shutdown_connections 2022-04-28T14:39:20.148 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.139 7f3de5e1f700 1 -- 172.21.15.22:0/408565199 wait complete. 2022-04-28T14:39:20.168 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.163 7f3de5e1f700 1 Processor -- start 2022-04-28T14:39:20.168 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.163 7f3de5e1f700 1 -- start start 2022-04-28T14:39:20.171 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.164 7f3de5e1f700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3de00c9520 0x7f3de01bf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:20.171 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.164 7f3de5e1f700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3de01bf6f0 0x7f3de01c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:20.171 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.164 7f3de5e1f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3de01bfb40 0x7f3de01c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:20.171 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.164 7f3de5e1f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de00df5a0 con 0x7f3de01bfb40 2022-04-28T14:39:20.171 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.164 7f3de5e1f700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de00c9080 con 0x7f3de01bf6f0 2022-04-28T14:39:20.171 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.164 7f3de5e1f700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3de00c8d40 con 0x7f3de00c9520 2022-04-28T14:39:20.171 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.164 7f3ddeab2700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3de00c9520 0x7f3de01bf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:20.172 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.164 7f3ddeab2700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3de00c9520 0x7f3de01bf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46270/0 (socket says 172.21.15.22:46270) 2022-04-28T14:39:20.172 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.164 7f3ddeab2700 1 -- 172.21.15.22:0/3953981105 learned_addr learned my addr 172.21.15.22:0/3953981105 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:20.172 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.164 7f3ddf2b3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3de01bfb40 0x7f3de01c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:20.172 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.164 7f3dde2b1700 1 --2- 172.21.15.22:0/3953981105 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3de01bf6f0 0x7f3de01c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:20.172 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.164 7f3ddeab2700 1 -- 172.21.15.22:0/3953981105 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3de01bf6f0 msgr2=0x7f3de01c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:20.172 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.164 7f3ddeab2700 1 --2- 172.21.15.22:0/3953981105 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3de01bf6f0 0x7f3de01c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:20.172 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.164 7f3ddeab2700 1 -- 172.21.15.22:0/3953981105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3de01bfb40 msgr2=0x7f3de01c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:20.172 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.164 7f3ddeab2700 1 --2- 172.21.15.22:0/3953981105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3de01bfb40 0x7f3de01c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:20.172 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.164 7f3ddeab2700 1 -- 172.21.15.22:0/3953981105 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de00c9e10 con 0x7f3de00c9520 2022-04-28T14:39:20.173 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.164 7f3ddf2b3700 1 --2- 172.21.15.22:0/3953981105 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3de01bfb40 0x7f3de01c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:20.173 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.164 7f3dde2b1700 1 --2- 172.21.15.22:0/3953981105 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3de01bf6f0 0x7f3de01c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:20.173 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.164 7f3ddeab2700 1 --2- 172.21.15.22:0/3953981105 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3de00c9520 0x7f3de01bf0c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f3dc8002f70 tx=0x7f3dc80068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:20.173 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.165 7f3dd7fff700 1 -- 172.21.15.22:0/3953981105 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3de00c9e10 con 0x7f3de00c9520 2022-04-28T14:39:20.173 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.165 7f3dd7fff700 1 -- 172.21.15.22:0/3953981105 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc801c650 con 0x7f3de00c9520 2022-04-28T14:39:20.173 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.165 7f3dd7fff700 1 -- 172.21.15.22:0/3953981105 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3dc801ca20 con 0x7f3de00c9520 2022-04-28T14:39:20.173 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.165 7f3de5e1f700 1 -- 172.21.15.22:0/3953981105 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de00dfaa0 con 0x7f3de00c9520 2022-04-28T14:39:20.173 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.165 7f3de5e1f700 1 -- 172.21.15.22:0/3953981105 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de00c9970 con 0x7f3de00c9520 2022-04-28T14:39:20.173 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.165 7f3dd7fff700 1 -- 172.21.15.22:0/3953981105 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f3dc8019030 con 0x7f3de00c9520 2022-04-28T14:39:20.173 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.165 7f3dd7fff700 1 -- 172.21.15.22:0/3953981105 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f3dc8018040 con 0x7f3de00c9520 2022-04-28T14:39:20.174 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.166 7f3de5e1f700 1 -- 172.21.15.22:0/3953981105 --> v1:172.21.15.22:6813/87558 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3de00882a0 con 0x7f3de01c6b50 2022-04-28T14:39:20.174 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.166 7f3dd7fff700 1 -- 172.21.15.22:0/3953981105 <== osd.2 v1:172.21.15.22:6813/87558 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7f3dd8009cb0 con 0x7f3de01c6b50 2022-04-28T14:39:20.177 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.173 7f3de5e1f700 1 -- 172.21.15.22:0/3953981105 --> v1:172.21.15.22:6813/87558 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3de00f0410 con 0x7f3de01c6b50 2022-04-28T14:39:20.177 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.173 7f3dd7fff700 1 -- 172.21.15.22:0/3953981105 <== osd.2 v1:172.21.15.22:6813/87558 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2374206864) 0x7f3de00f0410 con 0x7f3de01c6b50 2022-04-28T14:39:20.178 INFO:teuthology.orchestra.run.smithi022.stdout:38654705670 2022-04-28T14:39:20.179 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.173 7f3de5e1f700 1 -- 172.21.15.22:0/3953981105 >> v1:172.21.15.22:6813/87558 conn(0x7f3de01c6b50 legacy=0x7f3de00a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:20.179 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.173 7f3de5e1f700 1 -- 172.21.15.22:0/3953981105 >> v1:172.21.15.22:6808/86956 conn(0x7f3dc401c1b0 legacy=0x7f3dc401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:20.179 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.173 7f3de5e1f700 1 -- 172.21.15.22:0/3953981105 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3de00c9520 msgr2=0x7f3de01bf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:20.179 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.173 7f3de5e1f700 1 --2- 172.21.15.22:0/3953981105 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3de00c9520 0x7f3de01bf0c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f3dc8002f70 tx=0x7f3dc80068c0).stop 2022-04-28T14:39:20.179 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.173 7f3ddf2b3700 1 -- 172.21.15.22:0/3953981105 reap_dead start 2022-04-28T14:39:20.179 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.173 7f3de5e1f700 1 -- 172.21.15.22:0/3953981105 shutdown_connections 2022-04-28T14:39:20.179 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.173 7f3de5e1f700 1 -- 172.21.15.22:0/3953981105 >> 172.21.15.22:0/3953981105 conn(0x7f3de0124d10 msgr2=0x7f3de00ad370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:20.179 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.173 7f3de5e1f700 1 -- 172.21.15.22:0/3953981105 shutdown_connections 2022-04-28T14:39:20.179 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.173 7f3de5e1f700 1 -- 172.21.15.22:0/3953981105 wait complete. 2022-04-28T14:39:20.188 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2022-04-28T14:39:20.318 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.313 7f8bcc169700 1 Processor -- start 2022-04-28T14:39:20.318 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.313 7f8bcc169700 1 -- start start 2022-04-28T14:39:20.321 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.314 7f8bcc169700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8bc40f6530 0x7f8bc41b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:20.321 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.314 7f8bcc169700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8bc41b3220 0x7f8bc40f1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:20.321 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.314 7f8bcc169700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bc40ab2e0 con 0x7f8bc41b2dd0 2022-04-28T14:39:20.321 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.314 7f8bcc169700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc410d320 con 0x7f8bc40f6530 2022-04-28T14:39:20.321 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.314 7f8bcc169700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc410ce80 con 0x7f8bc41b3220 2022-04-28T14:39:20.321 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.314 7f8bc8f68700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8bc40f6530 0x7f8bc41b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:20.321 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.314 7f8bc9769700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8bc41b3220 0x7f8bc40f1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:20.322 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.314 7f8bc8f68700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8bc40f6530 0x7f8bc41b27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46496/0 (socket says 172.21.15.22:46496) 2022-04-28T14:39:20.322 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.314 7f8bc8f68700 1 -- 172.21.15.22:0/2917156856 learned_addr learned my addr 172.21.15.22:0/2917156856 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:20.322 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.315 7f8bc8f68700 1 -- 172.21.15.22:0/2917156856 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8bc41b3220 msgr2=0x7f8bc40f1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:20.322 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.315 7f8bc8f68700 1 --2- 172.21.15.22:0/2917156856 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8bc41b3220 0x7f8bc40f1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:20.322 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.315 7f8bc8f68700 1 -- 172.21.15.22:0/2917156856 >> v1:172.21.15.22:6789/0 conn(0x7f8bc41b2dd0 legacy=0x7f8bc40f13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:20.322 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.315 7f8bc8f68700 1 -- 172.21.15.22:0/2917156856 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc410d550 con 0x7f8bc40f6530 2022-04-28T14:39:20.322 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.315 7f8bc37fe700 1 -- 172.21.15.22:0/2917156856 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2381892417 0 0) 0x7f8bac001110 con 0x7f8bc41b2dd0 2022-04-28T14:39:20.322 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.315 7f8bc9769700 1 --2- 172.21.15.22:0/2917156856 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8bc41b3220 0x7f8bc40f1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:20.322 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.315 7f8bc8f68700 1 --2- 172.21.15.22:0/2917156856 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8bc40f6530 0x7f8bc41b27a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f8bb4002f70 tx=0x7f8bb4009a80).ready entity=mon.1 client_cookie=aa97839b582759a0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:20.322 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.315 7f8bc37fe700 1 -- 172.21.15.22:0/2917156856 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8bb400f510 con 0x7f8bc40f6530 2022-04-28T14:39:20.323 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.315 7f8bc37fe700 1 -- 172.21.15.22:0/2917156856 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb400f710 con 0x7f8bc40f6530 2022-04-28T14:39:20.323 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.315 7f8bc37fe700 1 -- 172.21.15.22:0/2917156856 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8bb400f8f0 con 0x7f8bc40f6530 2022-04-28T14:39:20.323 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.315 7f8bcc169700 1 -- 172.21.15.22:0/2917156856 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8bc40f6530 msgr2=0x7f8bc41b27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:20.323 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.315 7f8bcc169700 1 --2- 172.21.15.22:0/2917156856 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8bc40f6530 0x7f8bc41b27a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f8bb4002f70 tx=0x7f8bb4009a80).stop 2022-04-28T14:39:20.323 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.316 7f8bcc169700 1 -- 172.21.15.22:0/2917156856 shutdown_connections 2022-04-28T14:39:20.323 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.316 7f8bcc169700 1 --2- 172.21.15.22:0/2917156856 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8bc41b3220 0x7f8bc40f1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:20.323 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.316 7f8bcc169700 1 --2- 172.21.15.22:0/2917156856 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8bc40f6530 0x7f8bc41b27a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:20.323 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.316 7f8bcc169700 1 -- 172.21.15.22:0/2917156856 >> 172.21.15.22:0/2917156856 conn(0x7f8bc4117260 msgr2=0x7f8bc40f2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:20.323 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.316 7f8bcc169700 1 -- 172.21.15.22:0/2917156856 shutdown_connections 2022-04-28T14:39:20.324 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.316 7f8bcc169700 1 -- 172.21.15.22:0/2917156856 wait complete. 2022-04-28T14:39:20.344 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.340 7f8bcc169700 1 Processor -- start 2022-04-28T14:39:20.345 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.340 7f8bcc169700 1 -- start start 2022-04-28T14:39:20.347 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.340 7f8bcc169700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bc40bb690 0x7f8bc40dfa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:20.347 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.340 7f8bcc169700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8bc40e00c0 0x7f8bc41c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:20.347 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.340 7f8bcc169700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8bc40e0510 0x7f8bc41c4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:20.348 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.340 7f8bcc169700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc40d3b50 con 0x7f8bc40bb690 2022-04-28T14:39:20.348 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.340 7f8bcc169700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc41b6fd0 con 0x7f8bc40e0510 2022-04-28T14:39:20.348 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.340 7f8bcc169700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc40bdbc0 con 0x7f8bc40e00c0 2022-04-28T14:39:20.348 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.341 7f8bc8f68700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bc40bb690 0x7f8bc40dfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:20.348 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.341 7f8bc8f68700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bc40bb690 0x7f8bc40dfa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48934/0 (socket says 172.21.15.22:48934) 2022-04-28T14:39:20.348 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.341 7f8bc8f68700 1 -- 172.21.15.22:0/2443879758 learned_addr learned my addr 172.21.15.22:0/2443879758 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:20.348 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.341 7f8bc3fff700 1 --2- 172.21.15.22:0/2443879758 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8bc40e00c0 0x7f8bc41c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:20.348 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.341 7f8bc9769700 1 --2- 172.21.15.22:0/2443879758 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8bc40e0510 0x7f8bc41c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:20.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.341 7f8bc8f68700 1 -- 172.21.15.22:0/2443879758 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8bc40e00c0 msgr2=0x7f8bc41c3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:20.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.341 7f8bc8f68700 1 --2- 172.21.15.22:0/2443879758 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8bc40e00c0 0x7f8bc41c3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:20.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.341 7f8bc8f68700 1 -- 172.21.15.22:0/2443879758 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8bc40e0510 msgr2=0x7f8bc41c4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:20.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.341 7f8bc8f68700 1 --2- 172.21.15.22:0/2443879758 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8bc40e0510 0x7f8bc41c4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:20.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.341 7f8bc8f68700 1 -- 172.21.15.22:0/2443879758 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc40bd640 con 0x7f8bc40bb690 2022-04-28T14:39:20.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.341 7f8bc9769700 1 --2- 172.21.15.22:0/2443879758 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8bc40e0510 0x7f8bc41c4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:20.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.341 7f8bc3fff700 1 --2- 172.21.15.22:0/2443879758 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8bc40e00c0 0x7f8bc41c3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:20.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.341 7f8bc8f68700 1 --2- 172.21.15.22:0/2443879758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bc40bb690 0x7f8bc40dfa90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f8bb4002f70 tx=0x7f8bb40068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:20.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.341 7f8bc1ffb700 1 -- 172.21.15.22:0/2443879758 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8bc40bd640 con 0x7f8bc40bb690 2022-04-28T14:39:20.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.341 7f8bc1ffb700 1 -- 172.21.15.22:0/2443879758 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb401d450 con 0x7f8bc40bb690 2022-04-28T14:39:20.350 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.341 7f8bcc169700 1 -- 172.21.15.22:0/2443879758 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc40bbae0 con 0x7f8bc40bb690 2022-04-28T14:39:20.350 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.341 7f8bc1ffb700 1 -- 172.21.15.22:0/2443879758 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8bb401d820 con 0x7f8bc40bb690 2022-04-28T14:39:20.350 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.341 7f8bcc169700 1 -- 172.21.15.22:0/2443879758 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc41c48b0 con 0x7f8bc40bb690 2022-04-28T14:39:20.350 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.342 7f8bc1ffb700 1 -- 172.21.15.22:0/2443879758 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f8bb401da20 con 0x7f8bc40bb690 2022-04-28T14:39:20.350 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.342 7f8bc1ffb700 1 -- 172.21.15.22:0/2443879758 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f8bb400e990 con 0x7f8bc40bb690 2022-04-28T14:39:20.350 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.342 7f8bcc169700 1 -- 172.21.15.22:0/2443879758 --> v1:172.21.15.22:6809/87561 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8bc40f0430 con 0x7f8bc40effe0 2022-04-28T14:39:20.350 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.343 7f8bc1ffb700 1 -- 172.21.15.22:0/2443879758 <== osd.3 v1:172.21.15.22:6809/87561 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7f8bc40f0430 con 0x7f8bc40effe0 2022-04-28T14:39:20.353 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.349 7f8bcc169700 1 -- 172.21.15.22:0/2443879758 --> v1:172.21.15.22:6809/87561 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8bc40d3920 con 0x7f8bc40effe0 2022-04-28T14:39:20.354 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.349 7f8bc1ffb700 1 -- 172.21.15.22:0/2443879758 <== osd.3 v1:172.21.15.22:6809/87561 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2374206864) 0x7f8bbc009d30 con 0x7f8bc40effe0 2022-04-28T14:39:20.354 INFO:teuthology.orchestra.run.smithi022.stdout:38654705670 2022-04-28T14:39:20.355 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.350 7f8bcc169700 1 -- 172.21.15.22:0/2443879758 >> v1:172.21.15.22:6809/87561 conn(0x7f8bc40effe0 legacy=0x7f8bc40a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:20.355 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.350 7f8bcc169700 1 -- 172.21.15.22:0/2443879758 >> v1:172.21.15.22:6808/86956 conn(0x7f8ba801c1b0 legacy=0x7f8ba801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:20.356 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.350 7f8bcc169700 1 -- 172.21.15.22:0/2443879758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bc40bb690 msgr2=0x7f8bc40dfa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:20.356 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.350 7f8bcc169700 1 --2- 172.21.15.22:0/2443879758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bc40bb690 0x7f8bc40dfa90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f8bb4002f70 tx=0x7f8bb40068c0).stop 2022-04-28T14:39:20.356 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.350 7f8bc9769700 1 -- 172.21.15.22:0/2443879758 reap_dead start 2022-04-28T14:39:20.356 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.350 7f8bcc169700 1 -- 172.21.15.22:0/2443879758 shutdown_connections 2022-04-28T14:39:20.356 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.350 7f8bcc169700 1 -- 172.21.15.22:0/2443879758 >> 172.21.15.22:0/2443879758 conn(0x7f8bc4120ea0 msgr2=0x7f8bc40ab5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:20.356 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.350 7f8bcc169700 1 -- 172.21.15.22:0/2443879758 shutdown_connections 2022-04-28T14:39:20.356 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.350 7f8bcc169700 1 -- 172.21.15.22:0/2443879758 wait complete. 2022-04-28T14:39:20.365 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-04-28T14:39:20.498 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.491 7f0755823700 1 Processor -- start 2022-04-28T14:39:20.498 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.491 7f0755823700 1 -- start start 2022-04-28T14:39:20.498 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.491 7f0755823700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0750103890 0x7f07501b6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:20.498 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.491 7f0755823700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0750103ce0 0x7f07501b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:20.498 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.491 7f0755823700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07500ff930 con 0x7f07500f6500 2022-04-28T14:39:20.498 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.491 7f0755823700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07501116a0 con 0x7f0750103890 2022-04-28T14:39:20.499 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.491 7f0755823700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0750115fb0 con 0x7f0750103ce0 2022-04-28T14:39:20.499 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.491 7f074e5c5700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f07500f6500 0x7f0750103090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38340/0 (socket says 172.21.15.22:38340) 2022-04-28T14:39:20.499 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.491 7f074e5c5700 1 -- 172.21.15.22:0/2133222750 learned_addr learned my addr 172.21.15.22:0/2133222750 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:39:20.499 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.491 7f074edc6700 1 --2- 172.21.15.22:0/2133222750 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0750103ce0 0x7f07501b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:20.499 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.491 7f074ddc4700 1 --2- 172.21.15.22:0/2133222750 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0750103890 0x7f07501b6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:20.499 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.492 7f074d5c3700 1 -- 172.21.15.22:0/2133222750 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911435709 0 0) 0x7f0740001110 con 0x7f07500f6500 2022-04-28T14:39:20.499 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.492 7f074ddc4700 1 -- 172.21.15.22:0/2133222750 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0750103ce0 msgr2=0x7f07501b9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:20.499 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.492 7f074ddc4700 1 --2- 172.21.15.22:0/2133222750 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0750103ce0 0x7f07501b9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:20.500 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.492 7f074ddc4700 1 -- 172.21.15.22:0/2133222750 >> v1:172.21.15.22:6789/0 conn(0x7f07500f6500 legacy=0x7f0750103090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:20.500 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.492 7f074ddc4700 1 -- 172.21.15.22:0/2133222750 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075010c2c0 con 0x7f0750103890 2022-04-28T14:39:20.500 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.492 7f074edc6700 1 --2- 172.21.15.22:0/2133222750 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0750103ce0 0x7f07501b9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:20.500 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.492 7f074ddc4700 1 --2- 172.21.15.22:0/2133222750 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0750103890 0x7f07501b6b40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f07501163f0 tx=0x7f074400ba50).ready entity=mon.1 client_cookie=7075150feba10239 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:20.500 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.492 7f074d5c3700 1 -- 172.21.15.22:0/2133222750 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f075010c2c0 con 0x7f0750103890 2022-04-28T14:39:20.500 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.492 7f074d5c3700 1 -- 172.21.15.22:0/2133222750 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074400d570 con 0x7f0750103890 2022-04-28T14:39:20.500 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.492 7f074d5c3700 1 -- 172.21.15.22:0/2133222750 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f074400d940 con 0x7f0750103890 2022-04-28T14:39:20.500 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.492 7f0755823700 1 -- 172.21.15.22:0/2133222750 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0750103890 msgr2=0x7f07501b6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:20.500 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.492 7f0755823700 1 --2- 172.21.15.22:0/2133222750 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0750103890 0x7f07501b6b40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f07501163f0 tx=0x7f074400ba50).stop 2022-04-28T14:39:20.500 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.493 7f0755823700 1 -- 172.21.15.22:0/2133222750 shutdown_connections 2022-04-28T14:39:20.501 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.493 7f0755823700 1 --2- 172.21.15.22:0/2133222750 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0750103ce0 0x7f07501b9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:20.501 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.493 7f0755823700 1 --2- 172.21.15.22:0/2133222750 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0750103890 0x7f07501b6b40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:20.501 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.493 7f0755823700 1 -- 172.21.15.22:0/2133222750 >> 172.21.15.22:0/2133222750 conn(0x7f0750117270 msgr2=0x7f07500f2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:20.501 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.493 7f0755823700 1 -- 172.21.15.22:0/2133222750 shutdown_connections 2022-04-28T14:39:20.501 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.493 7f0755823700 1 -- 172.21.15.22:0/2133222750 wait complete. 2022-04-28T14:39:20.524 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.517 7f0755823700 1 Processor -- start 2022-04-28T14:39:20.524 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.517 7f0755823700 1 -- start start 2022-04-28T14:39:20.524 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.517 7f0755823700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f07500dba00 0x7f07501bf210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:20.524 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.517 7f0755823700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07501bf840 0x7f07501c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:20.525 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.517 7f0755823700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f07501bfc90 0x7f07501c6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:20.525 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.517 7f0755823700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07501b4ec0 con 0x7f07501bf840 2022-04-28T14:39:20.525 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.517 7f0755823700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07501b6340 con 0x7f07500dba00 2022-04-28T14:39:20.525 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.517 7f0755823700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07500e0150 con 0x7f07501bfc90 2022-04-28T14:39:20.525 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.517 7f074e5c5700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f07500dba00 0x7f07501bf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:20.525 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.517 7f074e5c5700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f07500dba00 0x7f07501bf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46518/0 (socket says 172.21.15.22:46518) 2022-04-28T14:39:20.525 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.517 7f074e5c5700 1 -- 172.21.15.22:0/2133406868 learned_addr learned my addr 172.21.15.22:0/2133406868 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:20.525 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.517 7f074ddc4700 1 --2- 172.21.15.22:0/2133406868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07501bf840 0x7f07501c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:20.525 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.517 7f074edc6700 1 --2- 172.21.15.22:0/2133406868 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f07501bfc90 0x7f07501c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:20.526 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.518 7f074e5c5700 1 -- 172.21.15.22:0/2133406868 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f07501bfc90 msgr2=0x7f07501c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:20.526 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.518 7f074e5c5700 1 --2- 172.21.15.22:0/2133406868 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f07501bfc90 0x7f07501c6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:20.526 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.518 7f074e5c5700 1 -- 172.21.15.22:0/2133406868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07501bf840 msgr2=0x7f07501c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:20.526 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.518 7f074e5c5700 1 --2- 172.21.15.22:0/2133406868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07501bf840 0x7f07501c5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:20.526 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.518 7f074e5c5700 1 -- 172.21.15.22:0/2133406868 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07500dc1d0 con 0x7f07500dba00 2022-04-28T14:39:20.526 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.518 7f074ddc4700 1 --2- 172.21.15.22:0/2133406868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07501bf840 0x7f07501c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:20.527 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.518 7f074e5c5700 1 --2- 172.21.15.22:0/2133406868 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f07500dba00 0x7f07501bf210 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f07500e0750 tx=0x7f074000c860).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:20.527 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.518 7f073f7fe700 1 -- 172.21.15.22:0/2133406868 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f07500dc1d0 con 0x7f07500dba00 2022-04-28T14:39:20.527 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.518 7f073f7fe700 1 -- 172.21.15.22:0/2133406868 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07400072e0 con 0x7f07500dba00 2022-04-28T14:39:20.527 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.518 7f0755823700 1 -- 172.21.15.22:0/2133406868 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07501c3810 con 0x7f07500dba00 2022-04-28T14:39:20.527 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.518 7f073f7fe700 1 -- 172.21.15.22:0/2133406868 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0740005810 con 0x7f07500dba00 2022-04-28T14:39:20.527 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.518 7f0755823700 1 -- 172.21.15.22:0/2133406868 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07500dbe50 con 0x7f07500dba00 2022-04-28T14:39:20.527 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.519 7f073f7fe700 1 -- 172.21.15.22:0/2133406868 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f0740005a10 con 0x7f07500dba00 2022-04-28T14:39:20.527 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.519 7f073f7fe700 1 -- 172.21.15.22:0/2133406868 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f0740028620 con 0x7f07500dba00 2022-04-28T14:39:20.527 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.519 7f0755823700 1 -- 172.21.15.22:0/2133406868 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07500f0410 con 0x7f07500dba00 2022-04-28T14:39:20.528 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.522 7f073f7fe700 1 -- 172.21.15.22:0/2133406868 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f07400070d0 con 0x7f07500dba00 2022-04-28T14:39:20.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.621 7f0755823700 1 -- 172.21.15.22:0/2133406868 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f07501110c0 con 0x7f07500dba00 2022-04-28T14:39:20.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.622 7f073f7fe700 1 -- 172.21.15.22:0/2133406868 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0740000c30 con 0x7f07500dba00 2022-04-28T14:39:20.627 INFO:teuthology.orchestra.run.smithi022.stdout:38654705670 2022-04-28T14:39:20.628 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.623 7f0755823700 1 -- 172.21.15.22:0/2133406868 >> v1:172.21.15.22:6808/86956 conn(0x7f072c01c220 legacy=0x7f072c01e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:20.628 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.623 7f0755823700 1 -- 172.21.15.22:0/2133406868 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f07500dba00 msgr2=0x7f07501bf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:20.629 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.623 7f0755823700 1 --2- 172.21.15.22:0/2133406868 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f07500dba00 0x7f07501bf210 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f07500e0750 tx=0x7f074000c860).stop 2022-04-28T14:39:20.629 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.623 7f0755823700 1 -- 172.21.15.22:0/2133406868 shutdown_connections 2022-04-28T14:39:20.629 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.623 7f0755823700 1 --2- 172.21.15.22:0/2133406868 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f07501bfc90 0x7f07501c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:20.629 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.623 7f0755823700 1 --2- 172.21.15.22:0/2133406868 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f07500dba00 0x7f07501bf210 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:20.629 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.623 7f0755823700 1 --2- 172.21.15.22:0/2133406868 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07501bf840 0x7f07501c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:20.629 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.623 7f0755823700 1 -- 172.21.15.22:0/2133406868 >> 172.21.15.22:0/2133406868 conn(0x7f07500de300 msgr2=0x7f07500b15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:20.629 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.623 7f0755823700 1 -- 172.21.15.22:0/2133406868 shutdown_connections 2022-04-28T14:39:20.630 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.623 7f0755823700 1 -- 172.21.15.22:0/2133406868 wait complete. 2022-04-28T14:39:20.639 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2022-04-28T14:39:20.639 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2022-04-28T14:39:20.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.764 7f1a498fe700 1 Processor -- start 2022-04-28T14:39:20.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.764 7f1a498fe700 1 -- start start 2022-04-28T14:39:20.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.765 7f1a498fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1a440f6500 0x7f1a44103090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:20.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.765 7f1a498fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1a441036c0 0x7f1a441b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:20.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.765 7f1a498fe700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a440ff930 con 0x7f1a44103b10 2022-04-28T14:39:20.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.765 7f1a498fe700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a441116a0 con 0x7f1a441036c0 2022-04-28T14:39:20.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.765 7f1a498fe700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a44103f60 con 0x7f1a440f6500 2022-04-28T14:39:20.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.765 7f1a425c5700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1a440f6500 0x7f1a44103090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:20.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.765 7f1a425c5700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1a440f6500 0x7f1a44103090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46526/0 (socket says 172.21.15.22:46526) 2022-04-28T14:39:20.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.765 7f1a41dc4700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1a441036c0 0x7f1a441b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:20.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.765 7f1a425c5700 1 -- 172.21.15.22:0/3503090241 learned_addr learned my addr 172.21.15.22:0/3503090241 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:20.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.765 7f1a425c5700 1 -- 172.21.15.22:0/3503090241 >> v2:172.21.15.22:3300/0 conn(0x7f1a441036c0 msgr2=0x7f1a441b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:20.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.765 7f1a425c5700 1 --2- 172.21.15.22:0/3503090241 >> v2:172.21.15.22:3300/0 conn(0x7f1a441036c0 0x7f1a441b5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:20.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.765 7f1a425c5700 1 -- 172.21.15.22:0/3503090241 >> v1:172.21.15.22:6789/0 conn(0x7f1a44103b10 legacy=0x7f1a441b8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:20.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.765 7f1a425c5700 1 -- 172.21.15.22:0/3503090241 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4410c2c0 con 0x7f1a440f6500 2022-04-28T14:39:20.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.765 7f1a41dc4700 1 --2- 172.21.15.22:0/3503090241 >> v2:172.21.15.22:3300/0 conn(0x7f1a441036c0 0x7f1a441b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:20.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.765 7f1a425c5700 1 --2- 172.21.15.22:0/3503090241 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1a440f6500 0x7f1a44103090 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f1a38002f70 tx=0x7f1a3800bc00).ready entity=mon.1 client_cookie=bb1a0ccaea1660ca server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:20.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.766 7f1a415c3700 1 -- 172.21.15.22:0/3503090241 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1a4410c2c0 con 0x7f1a440f6500 2022-04-28T14:39:20.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.766 7f1a415c3700 1 -- 172.21.15.22:0/3503090241 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3800dc20 con 0x7f1a440f6500 2022-04-28T14:39:20.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.766 7f1a415c3700 1 -- 172.21.15.22:0/3503090241 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1a38010470 con 0x7f1a440f6500 2022-04-28T14:39:20.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.766 7f1a498fe700 1 -- 172.21.15.22:0/3503090241 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1a440f6500 msgr2=0x7f1a44103090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:20.774 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.766 7f1a498fe700 1 --2- 172.21.15.22:0/3503090241 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1a440f6500 0x7f1a44103090 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f1a38002f70 tx=0x7f1a3800bc00).stop 2022-04-28T14:39:20.774 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.766 7f1a498fe700 1 -- 172.21.15.22:0/3503090241 shutdown_connections 2022-04-28T14:39:20.774 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.766 7f1a498fe700 1 --2- 172.21.15.22:0/3503090241 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1a440f6500 0x7f1a44103090 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:20.774 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.766 7f1a498fe700 1 --2- 172.21.15.22:0/3503090241 >> v2:172.21.15.22:3300/0 conn(0x7f1a441036c0 0x7f1a441b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:20.774 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.766 7f1a498fe700 1 -- 172.21.15.22:0/3503090241 >> 172.21.15.22:0/3503090241 conn(0x7f1a44117270 msgr2=0x7f1a440f2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:20.774 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.766 7f1a498fe700 1 -- 172.21.15.22:0/3503090241 shutdown_connections 2022-04-28T14:39:20.774 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.766 7f1a498fe700 1 -- 172.21.15.22:0/3503090241 wait complete. 2022-04-28T14:39:20.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.790 7f1a498fe700 1 Processor -- start 2022-04-28T14:39:20.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.790 7f1a498fe700 1 -- start start 2022-04-28T14:39:20.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.791 7f1a498fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1a440dc3c0 0x7f1a441b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:20.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.791 7f1a498fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1a441b0e70 0x7f1a441c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:20.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.791 7f1a498fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a441c5cd0 0x7f1a441c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:20.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.791 7f1a498fe700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a440a7fb0 con 0x7f1a441c5cd0 2022-04-28T14:39:20.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.791 7f1a498fe700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a440dbbe0 con 0x7f1a440dc3c0 2022-04-28T14:39:20.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.791 7f1a498fe700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a441c32c0 con 0x7f1a441b0e70 2022-04-28T14:39:20.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.791 7f1a425c5700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1a440dc3c0 0x7f1a441b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:20.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.791 7f1a42dc6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a441c5cd0 0x7f1a441c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:20.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.791 7f1a425c5700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1a440dc3c0 0x7f1a441b0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46532/0 (socket says 172.21.15.22:46532) 2022-04-28T14:39:20.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.791 7f1a425c5700 1 -- 172.21.15.22:0/3390499365 learned_addr learned my addr 172.21.15.22:0/3390499365 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:20.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.791 7f1a41dc4700 1 --2- 172.21.15.22:0/3390499365 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1a441b0e70 0x7f1a441c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:20.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.791 7f1a425c5700 1 -- 172.21.15.22:0/3390499365 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1a441b0e70 msgr2=0x7f1a441c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:20.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.791 7f1a425c5700 1 --2- 172.21.15.22:0/3390499365 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1a441b0e70 0x7f1a441c56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:20.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.791 7f1a425c5700 1 -- 172.21.15.22:0/3390499365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a441c5cd0 msgr2=0x7f1a441c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:20.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.791 7f1a425c5700 1 --2- 172.21.15.22:0/3390499365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a441c5cd0 0x7f1a441c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:20.799 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.791 7f1a425c5700 1 -- 172.21.15.22:0/3390499365 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a441b16f0 con 0x7f1a440dc3c0 2022-04-28T14:39:20.799 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.791 7f1a425c5700 1 --2- 172.21.15.22:0/3390499365 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1a440dc3c0 0x7f1a441b0840 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f1a4410bda0 tx=0x7f1a380068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:20.799 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.791 7f1a337fe700 1 -- 172.21.15.22:0/3390499365 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1a441b16f0 con 0x7f1a440dc3c0 2022-04-28T14:39:20.799 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.791 7f1a337fe700 1 -- 172.21.15.22:0/3390499365 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a38022410 con 0x7f1a440dc3c0 2022-04-28T14:39:20.799 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.791 7f1a498fe700 1 -- 172.21.15.22:0/3390499365 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a440dc810 con 0x7f1a440dc3c0 2022-04-28T14:39:20.799 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.791 7f1a337fe700 1 -- 172.21.15.22:0/3390499365 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1a3801e070 con 0x7f1a440dc3c0 2022-04-28T14:39:20.799 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.792 7f1a498fe700 1 -- 172.21.15.22:0/3390499365 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a441ccb80 con 0x7f1a440dc3c0 2022-04-28T14:39:20.799 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.792 7f1a337fe700 1 -- 172.21.15.22:0/3390499365 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f1a38018400 con 0x7f1a440dc3c0 2022-04-28T14:39:20.799 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.792 7f1a337fe700 1 -- 172.21.15.22:0/3390499365 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f1a3800d010 con 0x7f1a440dc3c0 2022-04-28T14:39:20.800 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.793 7f1a498fe700 1 -- 172.21.15.22:0/3390499365 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a440f0410 con 0x7f1a440dc3c0 2022-04-28T14:39:20.800 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.795 7f1a337fe700 1 -- 172.21.15.22:0/3390499365 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f1a38010b00 con 0x7f1a440dc3c0 2022-04-28T14:39:20.898 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.893 7f1a498fe700 1 -- 172.21.15.22:0/3390499365 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1a441c6940 con 0x7f1a440dc3c0 2022-04-28T14:39:20.898 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.893 7f1a337fe700 1 -- 172.21.15.22:0/3390499365 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a3800d820 con 0x7f1a440dc3c0 2022-04-28T14:39:20.898 INFO:teuthology.orchestra.run.smithi022.stdout:38654705669 2022-04-28T14:39:20.899 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.894 7f1a498fe700 1 -- 172.21.15.22:0/3390499365 >> v1:172.21.15.22:6808/86956 conn(0x7f1a2001c1b0 legacy=0x7f1a2001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:20.900 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.894 7f1a498fe700 1 -- 172.21.15.22:0/3390499365 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1a440dc3c0 msgr2=0x7f1a441b0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:20.900 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.894 7f1a498fe700 1 --2- 172.21.15.22:0/3390499365 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1a440dc3c0 0x7f1a441b0840 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f1a4410bda0 tx=0x7f1a380068c0).stop 2022-04-28T14:39:20.900 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.894 7f1a498fe700 1 -- 172.21.15.22:0/3390499365 shutdown_connections 2022-04-28T14:39:20.900 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.894 7f1a498fe700 1 --2- 172.21.15.22:0/3390499365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a441c5cd0 0x7f1a441c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:20.900 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.894 7f1a498fe700 1 --2- 172.21.15.22:0/3390499365 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1a440dc3c0 0x7f1a441b0840 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:20.900 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.894 7f1a498fe700 1 --2- 172.21.15.22:0/3390499365 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1a441b0e70 0x7f1a441c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:20.900 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.894 7f1a498fe700 1 -- 172.21.15.22:0/3390499365 >> 172.21.15.22:0/3390499365 conn(0x7f1a440ddb90 msgr2=0x7f1a440daba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:20.900 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.894 7f1a498fe700 1 -- 172.21.15.22:0/3390499365 shutdown_connections 2022-04-28T14:39:20.900 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:20.894 7f1a498fe700 1 -- 172.21.15.22:0/3390499365 wait complete. 2022-04-28T14:39:20.910 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.1 2022-04-28T14:39:20.910 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2022-04-28T14:39:21.040 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.035 7f51bc242700 1 Processor -- start 2022-04-28T14:39:21.040 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.035 7f51bc242700 1 -- start start 2022-04-28T14:39:21.042 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.036 7f51bc242700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f51b4103890 0x7f51b41b6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:21.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.036 7f51bc242700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f51b4103ce0 0x7f51b41b9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:21.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.036 7f51bc242700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b40ff930 con 0x7f51b40f6500 2022-04-28T14:39:21.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.036 7f51bc242700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b41116a0 con 0x7f51b4103ce0 2022-04-28T14:39:21.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.036 7f51bc242700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51b4115fb0 con 0x7f51b4103890 2022-04-28T14:39:21.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.036 7f51b9041700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f51b40f6500 0x7f51b4103090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38368/0 (socket says 172.21.15.22:38368) 2022-04-28T14:39:21.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.036 7f51b9041700 1 -- 172.21.15.22:0/1526543832 learned_addr learned my addr 172.21.15.22:0/1526543832 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:39:21.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.036 7f51b9842700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f51b4103ce0 0x7f51b41b9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:21.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.036 7f51b8840700 1 --2- 172.21.15.22:0/1526543832 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f51b4103890 0x7f51b41b6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:21.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.036 7f51b9842700 1 -- 172.21.15.22:0/1526543832 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f51b4103890 msgr2=0x7f51b41b6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:21.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.036 7f51b9842700 1 --2- 172.21.15.22:0/1526543832 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f51b4103890 0x7f51b41b6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:21.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.036 7f51a7fff700 1 -- 172.21.15.22:0/1526543832 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624212431 0 0) 0x7f51b0001110 con 0x7f51b40f6500 2022-04-28T14:39:21.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.036 7f51b9842700 1 -- 172.21.15.22:0/1526543832 >> v1:172.21.15.22:6789/0 conn(0x7f51b40f6500 legacy=0x7f51b4103090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:21.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.036 7f51b9842700 1 -- 172.21.15.22:0/1526543832 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b410c2c0 con 0x7f51b4103ce0 2022-04-28T14:39:21.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.036 7f51b8840700 1 --2- 172.21.15.22:0/1526543832 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f51b4103890 0x7f51b41b6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:21.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.037 7f51b9842700 1 --2- 172.21.15.22:0/1526543832 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f51b4103ce0 0x7f51b41b9180 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f51b41163f0 tx=0x7f51ac009d70).ready entity=mon.1 client_cookie=da5f2f55d4c2b1e server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:21.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.037 7f51a7fff700 1 -- 172.21.15.22:0/1526543832 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f51b410c2c0 con 0x7f51b4103ce0 2022-04-28T14:39:21.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.037 7f51a7fff700 1 -- 172.21.15.22:0/1526543832 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ac00b9b0 con 0x7f51b4103ce0 2022-04-28T14:39:21.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.037 7f51a7fff700 1 -- 172.21.15.22:0/1526543832 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f51ac00bd80 con 0x7f51b4103ce0 2022-04-28T14:39:21.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.037 7f51bc242700 1 -- 172.21.15.22:0/1526543832 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f51b4103ce0 msgr2=0x7f51b41b9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:21.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.037 7f51bc242700 1 --2- 172.21.15.22:0/1526543832 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f51b4103ce0 0x7f51b41b9180 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f51b41163f0 tx=0x7f51ac009d70).stop 2022-04-28T14:39:21.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.037 7f51bc242700 1 -- 172.21.15.22:0/1526543832 shutdown_connections 2022-04-28T14:39:21.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.037 7f51bc242700 1 --2- 172.21.15.22:0/1526543832 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f51b4103ce0 0x7f51b41b9180 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:21.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.037 7f51bc242700 1 --2- 172.21.15.22:0/1526543832 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f51b4103890 0x7f51b41b6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:21.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.037 7f51bc242700 1 -- 172.21.15.22:0/1526543832 >> 172.21.15.22:0/1526543832 conn(0x7f51b4117270 msgr2=0x7f51b40f2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:21.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.037 7f51bc242700 1 -- 172.21.15.22:0/1526543832 shutdown_connections 2022-04-28T14:39:21.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.038 7f51bc242700 1 -- 172.21.15.22:0/1526543832 wait complete. 2022-04-28T14:39:21.066 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.061 7f51bc242700 1 Processor -- start 2022-04-28T14:39:21.066 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.062 7f51bc242700 1 -- start start 2022-04-28T14:39:21.069 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.062 7f51bc242700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51b40ddcb0 0x7f51b40d1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:21.069 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.062 7f51bc242700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f51b40d19a0 0x7f51b41c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:21.069 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.062 7f51bc242700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f51b40d1df0 0x7f51b41c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:21.069 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.062 7f51bc242700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b40bd890 con 0x7f51b40ddcb0 2022-04-28T14:39:21.069 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.062 7f51bc242700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b40dc450 con 0x7f51b40d1df0 2022-04-28T14:39:21.069 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.062 7f51bc242700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51b40bb0e0 con 0x7f51b40d19a0 2022-04-28T14:39:21.069 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.062 7f51b9041700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51b40ddcb0 0x7f51b40d1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:21.069 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.062 7f51b9842700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f51b40d1df0 0x7f51b41c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:21.069 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.062 7f51b9842700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f51b40d1df0 0x7f51b41c64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46550/0 (socket says 172.21.15.22:46550) 2022-04-28T14:39:21.070 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.062 7f51b8840700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f51b40d19a0 0x7f51b41c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:21.070 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.062 7f51b9041700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51b40ddcb0 0x7f51b40d1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48978/0 (socket says 172.21.15.22:48978) 2022-04-28T14:39:21.070 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.062 7f51b9842700 1 -- 172.21.15.22:0/3102525826 learned_addr learned my addr 172.21.15.22:0/3102525826 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:21.070 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.062 7f51b9842700 1 -- 172.21.15.22:0/3102525826 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f51b40d19a0 msgr2=0x7f51b41c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:21.070 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.062 7f51b9842700 1 --2- 172.21.15.22:0/3102525826 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f51b40d19a0 0x7f51b41c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:21.070 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.062 7f51b9842700 1 -- 172.21.15.22:0/3102525826 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51b40ddcb0 msgr2=0x7f51b40d1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:21.070 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.062 7f51b9842700 1 --2- 172.21.15.22:0/3102525826 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51b40ddcb0 0x7f51b40d1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:21.070 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.062 7f51b9842700 1 -- 172.21.15.22:0/3102525826 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b41c04a0 con 0x7f51b40d1df0 2022-04-28T14:39:21.070 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.062 7f51b9041700 1 --2- 172.21.15.22:0/3102525826 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51b40ddcb0 0x7f51b40d1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:21.071 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.063 7f51b9842700 1 --2- 172.21.15.22:0/3102525826 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f51b40d1df0 0x7f51b41c64b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f51b410bda0 tx=0x7f51ac006c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:21.071 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.063 7f51a67fc700 1 -- 172.21.15.22:0/3102525826 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f51ac010c30 con 0x7f51b40d1df0 2022-04-28T14:39:21.071 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.063 7f51a67fc700 1 -- 172.21.15.22:0/3102525826 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ac018400 con 0x7f51b40d1df0 2022-04-28T14:39:21.071 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.063 7f51bc242700 1 -- 172.21.15.22:0/3102525826 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b40dd7d0 con 0x7f51b40d1df0 2022-04-28T14:39:21.071 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.063 7f51a67fc700 1 -- 172.21.15.22:0/3102525826 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f51ac0187d0 con 0x7f51b40d1df0 2022-04-28T14:39:21.071 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.063 7f51bc242700 1 -- 172.21.15.22:0/3102525826 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b41b5740 con 0x7f51b40d1df0 2022-04-28T14:39:21.071 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.064 7f51a67fc700 1 -- 172.21.15.22:0/3102525826 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f51ac0189d0 con 0x7f51b40d1df0 2022-04-28T14:39:21.071 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.064 7f51a67fc700 1 -- 172.21.15.22:0/3102525826 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f51ac019d50 con 0x7f51b40d1df0 2022-04-28T14:39:21.071 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.064 7f51bc242700 1 -- 172.21.15.22:0/3102525826 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b40f0410 con 0x7f51b40d1df0 2022-04-28T14:39:21.072 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.067 7f51a67fc700 1 -- 172.21.15.22:0/3102525826 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f51ac00b5b0 con 0x7f51b40d1df0 2022-04-28T14:39:21.169 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.164 7f51bc242700 1 -- 172.21.15.22:0/3102525826 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f51b41c7120 con 0x7f51b40d1df0 2022-04-28T14:39:21.169 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.164 7f51a67fc700 1 -- 172.21.15.22:0/3102525826 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f51ac010830 con 0x7f51b40d1df0 2022-04-28T14:39:21.169 INFO:teuthology.orchestra.run.smithi022.stdout:38654705670 2022-04-28T14:39:21.170 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.165 7f51bc242700 1 -- 172.21.15.22:0/3102525826 >> v1:172.21.15.22:6808/86956 conn(0x7f519401c290 legacy=0x7f519401e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:21.170 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.165 7f51bc242700 1 -- 172.21.15.22:0/3102525826 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f51b40d1df0 msgr2=0x7f51b41c64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:21.170 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.165 7f51bc242700 1 --2- 172.21.15.22:0/3102525826 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f51b40d1df0 0x7f51b41c64b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f51b410bda0 tx=0x7f51ac006c40).stop 2022-04-28T14:39:21.171 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.165 7f51bc242700 1 -- 172.21.15.22:0/3102525826 shutdown_connections 2022-04-28T14:39:21.171 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.165 7f51bc242700 1 --2- 172.21.15.22:0/3102525826 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f51b40d1df0 0x7f51b41c64b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:21.171 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.165 7f51bc242700 1 --2- 172.21.15.22:0/3102525826 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51b40ddcb0 0x7f51b40d1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:21.171 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.165 7f51bc242700 1 --2- 172.21.15.22:0/3102525826 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f51b40d19a0 0x7f51b41c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:21.171 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.165 7f51bc242700 1 -- 172.21.15.22:0/3102525826 >> 172.21.15.22:0/3102525826 conn(0x7f51b40e0be0 msgr2=0x7f51b40df5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:21.171 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.165 7f51bc242700 1 -- 172.21.15.22:0/3102525826 shutdown_connections 2022-04-28T14:39:21.171 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.165 7f51bc242700 1 -- 172.21.15.22:0/3102525826 wait complete. 2022-04-28T14:39:21.181 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.2 2022-04-28T14:39:21.181 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2022-04-28T14:39:21.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.306 7f32087cb700 1 Processor -- start 2022-04-28T14:39:21.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.306 7f32087cb700 1 -- start start 2022-04-28T14:39:21.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.307 7f32087cb700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f32000f13c0 0x7f32000f1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:21.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.307 7f32087cb700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f32000f1e40 0x7f32001b99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:21.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.307 7f32087cb700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32000ab0e0 con 0x7f320010cba0 2022-04-28T14:39:21.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.307 7f32087cb700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3200111e20 con 0x7f32000f1e40 2022-04-28T14:39:21.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.307 7f32087cb700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32000f2290 con 0x7f32000f13c0 2022-04-28T14:39:21.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.307 7f32055ca700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f320010cba0 0x7f32000f62e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38382/0 (socket says 172.21.15.22:38382) 2022-04-28T14:39:21.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.307 7f3204dc9700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f32000f13c0 0x7f32000f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:21.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.307 7f32055ca700 1 -- 172.21.15.22:0/1984094779 learned_addr learned my addr 172.21.15.22:0/1984094779 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:39:21.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.307 7f3205dcb700 1 --2- 172.21.15.22:0/1984094779 >> v2:172.21.15.22:3300/0 conn(0x7f32000f1e40 0x7f32001b99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:21.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.307 7f31f3fff700 1 -- 172.21.15.22:0/1984094779 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 20102343 0 0) 0x7f31fc001110 con 0x7f320010cba0 2022-04-28T14:39:21.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.307 7f31f3fff700 1 -- 172.21.15.22:0/1984094779 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31e8003270 con 0x7f320010cba0 2022-04-28T14:39:21.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.307 7f3204dc9700 1 -- 172.21.15.22:0/1984094779 >> v2:172.21.15.22:3300/0 conn(0x7f32000f1e40 msgr2=0x7f32001b99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:21.317 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.307 7f3204dc9700 1 --2- 172.21.15.22:0/1984094779 >> v2:172.21.15.22:3300/0 conn(0x7f32000f1e40 0x7f32001b99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:21.317 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.307 7f3204dc9700 1 -- 172.21.15.22:0/1984094779 >> v1:172.21.15.22:6789/0 conn(0x7f320010cba0 legacy=0x7f32000f62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:21.317 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.307 7f3204dc9700 1 -- 172.21.15.22:0/1984094779 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3200111730 con 0x7f32000f13c0 2022-04-28T14:39:21.317 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.307 7f3204dc9700 1 --2- 172.21.15.22:0/1984094779 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f32000f13c0 0x7f32000f1810 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f31f4002f70 tx=0x7f31f400b970).ready entity=mon.2 client_cookie=aee4699cf0149ef8 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:21.317 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.307 7f31f3fff700 1 -- 172.21.15.22:0/1984094779 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3200111730 con 0x7f32000f13c0 2022-04-28T14:39:21.317 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.308 7f31f3fff700 1 -- 172.21.15.22:0/1984094779 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f400d5c0 con 0x7f32000f13c0 2022-04-28T14:39:21.318 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.308 7f31f3fff700 1 -- 172.21.15.22:0/1984094779 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f31f400d990 con 0x7f32000f13c0 2022-04-28T14:39:21.318 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.308 7f32087cb700 1 -- 172.21.15.22:0/1984094779 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f32000f13c0 msgr2=0x7f32000f1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:21.318 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.308 7f32087cb700 1 --2- 172.21.15.22:0/1984094779 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f32000f13c0 0x7f32000f1810 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f31f4002f70 tx=0x7f31f400b970).stop 2022-04-28T14:39:21.318 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.308 7f32087cb700 1 -- 172.21.15.22:0/1984094779 shutdown_connections 2022-04-28T14:39:21.318 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.308 7f32087cb700 1 --2- 172.21.15.22:0/1984094779 >> v2:172.21.15.22:3300/0 conn(0x7f32000f1e40 0x7f32001b99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:21.318 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.308 7f32087cb700 1 --2- 172.21.15.22:0/1984094779 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f32000f13c0 0x7f32000f1810 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:21.319 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.308 7f32087cb700 1 -- 172.21.15.22:0/1984094779 >> 172.21.15.22:0/1984094779 conn(0x7f3200117270 msgr2=0x7f32000f2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:21.319 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.308 7f32087cb700 1 -- 172.21.15.22:0/1984094779 shutdown_connections 2022-04-28T14:39:21.319 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.308 7f32087cb700 1 -- 172.21.15.22:0/1984094779 wait complete. 2022-04-28T14:39:21.339 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.332 7f32087cb700 1 Processor -- start 2022-04-28T14:39:21.339 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.332 7f32087cb700 1 -- start start 2022-04-28T14:39:21.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.333 7f32087cb700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f32001b8160 0x7f32000d5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:21.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.333 7f32087cb700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32000d5e50 0x7f32000df6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:21.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.333 7f32087cb700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3200116980 0x7f32000dfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:21.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.333 7f32087cb700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3200122170 con 0x7f32000d5e50 2022-04-28T14:39:21.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.333 7f32087cb700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32000e0320 con 0x7f3200116980 2022-04-28T14:39:21.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.333 7f32087cb700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f32000e0520 con 0x7f32001b8160 2022-04-28T14:39:21.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.333 7f32055ca700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f32001b8160 0x7f32000d5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:21.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.333 7f32055ca700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f32001b8160 0x7f32000d5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46344/0 (socket says 172.21.15.22:46344) 2022-04-28T14:39:21.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.333 7f3204dc9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32000d5e50 0x7f32000df6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:21.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.333 7f32055ca700 1 -- 172.21.15.22:0/516615004 learned_addr learned my addr 172.21.15.22:0/516615004 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:21.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.333 7f3205dcb700 1 --2- 172.21.15.22:0/516615004 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3200116980 0x7f32000dfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:21.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.333 7f3204dc9700 1 -- 172.21.15.22:0/516615004 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f32001b8160 msgr2=0x7f32000d5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:21.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.333 7f3204dc9700 1 --2- 172.21.15.22:0/516615004 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f32001b8160 0x7f32000d5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:21.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.333 7f3204dc9700 1 -- 172.21.15.22:0/516615004 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3200116980 msgr2=0x7f32000dfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:21.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.333 7f3204dc9700 1 --2- 172.21.15.22:0/516615004 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3200116980 0x7f32000dfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:21.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.333 7f3204dc9700 1 -- 172.21.15.22:0/516615004 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32001c5930 con 0x7f32000d5e50 2022-04-28T14:39:21.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.333 7f3204dc9700 1 --2- 172.21.15.22:0/516615004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32000d5e50 0x7f32000df6c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f31f4002f70 tx=0x7f31f40068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:21.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.333 7f31f27fc700 1 -- 172.21.15.22:0/516615004 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f32001c5930 con 0x7f32000d5e50 2022-04-28T14:39:21.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.333 7f31f27fc700 1 -- 172.21.15.22:0/516615004 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f40116e0 con 0x7f32000d5e50 2022-04-28T14:39:21.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.333 7f32087cb700 1 -- 172.21.15.22:0/516615004 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32001c5bf0 con 0x7f32000d5e50 2022-04-28T14:39:21.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.333 7f31f27fc700 1 -- 172.21.15.22:0/516615004 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f31f4017040 con 0x7f32000d5e50 2022-04-28T14:39:21.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.334 7f32087cb700 1 -- 172.21.15.22:0/516615004 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32001c6060 con 0x7f32000d5e50 2022-04-28T14:39:21.344 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.334 7f31f27fc700 1 -- 172.21.15.22:0/516615004 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f31f40263f0 con 0x7f32000d5e50 2022-04-28T14:39:21.344 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.334 7f31f27fc700 1 -- 172.21.15.22:0/516615004 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f31f4018070 con 0x7f32000d5e50 2022-04-28T14:39:21.344 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.335 7f32087cb700 1 -- 172.21.15.22:0/516615004 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32000f0410 con 0x7f32000d5e50 2022-04-28T14:39:21.345 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.337 7f31f27fc700 1 -- 172.21.15.22:0/516615004 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f31f40114d0 con 0x7f32000d5e50 2022-04-28T14:39:21.440 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.435 7f32087cb700 1 -- 172.21.15.22:0/516615004 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f32000a5bb0 con 0x7f32000d5e50 2022-04-28T14:39:21.441 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.436 7f31f27fc700 1 -- 172.21.15.22:0/516615004 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f31f400d3b0 con 0x7f32000d5e50 2022-04-28T14:39:21.441 INFO:teuthology.orchestra.run.smithi022.stdout:38654705669 2022-04-28T14:39:21.442 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.437 7f32087cb700 1 -- 172.21.15.22:0/516615004 >> v1:172.21.15.22:6808/86956 conn(0x7f31e001c1b0 legacy=0x7f31e001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:21.442 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.437 7f32087cb700 1 -- 172.21.15.22:0/516615004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32000d5e50 msgr2=0x7f32000df6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:21.442 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.437 7f32087cb700 1 --2- 172.21.15.22:0/516615004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32000d5e50 0x7f32000df6c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f31f4002f70 tx=0x7f31f40068c0).stop 2022-04-28T14:39:21.443 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.437 7f32087cb700 1 -- 172.21.15.22:0/516615004 shutdown_connections 2022-04-28T14:39:21.443 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.437 7f32087cb700 1 --2- 172.21.15.22:0/516615004 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3200116980 0x7f32000dfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:21.443 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.437 7f32087cb700 1 --2- 172.21.15.22:0/516615004 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f32001b8160 0x7f32000d5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:21.443 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.437 7f32087cb700 1 --2- 172.21.15.22:0/516615004 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32000d5e50 0x7f32000df6c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:21.443 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.437 7f32087cb700 1 -- 172.21.15.22:0/516615004 >> 172.21.15.22:0/516615004 conn(0x7f32000ca5c0 msgr2=0x7f3200120c40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:21.443 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.437 7f32087cb700 1 -- 172.21.15.22:0/516615004 shutdown_connections 2022-04-28T14:39:21.443 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:21.437 7f32087cb700 1 -- 172.21.15.22:0/516615004 wait complete. 2022-04-28T14:39:21.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.3 2022-04-28T14:39:22.453 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2022-04-28T14:39:22.597 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.592 7f0155d38700 1 Processor -- start 2022-04-28T14:39:22.597 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.592 7f0155d38700 1 -- start start 2022-04-28T14:39:22.599 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.593 7f0155d38700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f01500f6370 0x7f01500f13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:22.600 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.593 7f0155d38700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f01500f1e30 0x7f01501b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:22.600 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.593 7f0155d38700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01500ab2e0 con 0x7f01500f19e0 2022-04-28T14:39:22.600 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.593 7f0155d38700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015010ed20 con 0x7f01500f6370 2022-04-28T14:39:22.600 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.593 7f0155d38700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01501b5560 con 0x7f01500f1e30 2022-04-28T14:39:22.600 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.593 7f014eab2700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f01500f6370 0x7f01500f13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:22.600 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.593 7f014e2b1700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f01500f19e0 0x7f01501b4730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38398/0 (socket says 172.21.15.22:38398) 2022-04-28T14:39:22.600 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.593 7f014f2b3700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f01500f1e30 0x7f01501b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:22.600 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.593 7f014eab2700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f01500f6370 0x7f01500f13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46568/0 (socket says 172.21.15.22:46568) 2022-04-28T14:39:22.600 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.593 7f014e2b1700 1 -- 172.21.15.22:0/2666467786 learned_addr learned my addr 172.21.15.22:0/2666467786 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:39:22.601 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.593 7f014dab0700 1 -- 172.21.15.22:0/2666467786 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3341027625 0 0) 0x7f0138001110 con 0x7f01500f19e0 2022-04-28T14:39:22.601 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.593 7f014f2b3700 1 -- 172.21.15.22:0/2666467786 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f01500f6370 msgr2=0x7f01500f13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:22.601 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.593 7f014f2b3700 1 --2- 172.21.15.22:0/2666467786 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f01500f6370 0x7f01500f13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:22.601 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.593 7f014f2b3700 1 -- 172.21.15.22:0/2666467786 >> v1:172.21.15.22:6789/0 conn(0x7f01500f19e0 legacy=0x7f01501b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:22.601 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.593 7f014f2b3700 1 -- 172.21.15.22:0/2666467786 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0150116240 con 0x7f01500f1e30 2022-04-28T14:39:22.601 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.594 7f014eab2700 1 --2- 172.21.15.22:0/2666467786 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f01500f6370 0x7f01500f13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:22.601 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.594 7f014f2b3700 1 --2- 172.21.15.22:0/2666467786 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f01500f1e30 0x7f01501b4f30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f0150114da0 tx=0x7f0148009cf0).ready entity=mon.2 client_cookie=c959ff2ec19bedf7 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:22.601 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.594 7f014dab0700 1 -- 172.21.15.22:0/2666467786 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0150116240 con 0x7f01500f1e30 2022-04-28T14:39:22.601 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.594 7f014dab0700 1 -- 172.21.15.22:0/2666467786 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014800b840 con 0x7f01500f1e30 2022-04-28T14:39:22.601 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.594 7f014dab0700 1 -- 172.21.15.22:0/2666467786 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f014800ba20 con 0x7f01500f1e30 2022-04-28T14:39:22.602 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.594 7f0155d38700 1 -- 172.21.15.22:0/2666467786 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f01500f1e30 msgr2=0x7f01501b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:22.602 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.594 7f0155d38700 1 --2- 172.21.15.22:0/2666467786 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f01500f1e30 0x7f01501b4f30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f0150114da0 tx=0x7f0148009cf0).stop 2022-04-28T14:39:22.602 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.594 7f0155d38700 1 -- 172.21.15.22:0/2666467786 shutdown_connections 2022-04-28T14:39:22.602 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.594 7f0155d38700 1 --2- 172.21.15.22:0/2666467786 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f01500f1e30 0x7f01501b4f30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:22.602 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.594 7f0155d38700 1 --2- 172.21.15.22:0/2666467786 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f01500f6370 0x7f01500f13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:22.602 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.594 7f0155d38700 1 -- 172.21.15.22:0/2666467786 >> 172.21.15.22:0/2666467786 conn(0x7f0150117260 msgr2=0x7f01500f2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:22.602 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.594 7f0155d38700 1 -- 172.21.15.22:0/2666467786 shutdown_connections 2022-04-28T14:39:22.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.595 7f0155d38700 1 -- 172.21.15.22:0/2666467786 wait complete. 2022-04-28T14:39:22.623 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.619 7f0155d38700 1 Processor -- start 2022-04-28T14:39:22.623 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.619 7f0155d38700 1 -- start start 2022-04-28T14:39:22.625 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.619 7f0155d38700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f01501ba0c0 0x7f0150123d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:22.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.619 7f0155d38700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0150124370 0x7f01501c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:22.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.619 7f0155d38700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f01501247c0 0x7f01501c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:22.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.619 7f0155d38700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01500d1fd0 con 0x7f0150124370 2022-04-28T14:39:22.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.619 7f0155d38700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01500d5cb0 con 0x7f01501ba0c0 2022-04-28T14:39:22.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.619 7f0155d38700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0150124da0 con 0x7f01501247c0 2022-04-28T14:39:22.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.619 7f014eab2700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f01501ba0c0 0x7f0150123d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:22.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.619 7f014f2b3700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f01501247c0 0x7f01501c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:22.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.619 7f014eab2700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f01501ba0c0 0x7f0150123d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46574/0 (socket says 172.21.15.22:46574) 2022-04-28T14:39:22.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.619 7f014f2b3700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f01501247c0 0x7f01501c60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46360/0 (socket says 172.21.15.22:46360) 2022-04-28T14:39:22.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.619 7f014eab2700 1 -- 172.21.15.22:0/3164363875 learned_addr learned my addr 172.21.15.22:0/3164363875 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:22.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.619 7f014e2b1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0150124370 0x7f01501c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:22.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.620 7f014eab2700 1 -- 172.21.15.22:0/3164363875 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f01501247c0 msgr2=0x7f01501c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:22.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.620 7f014eab2700 1 --2- 172.21.15.22:0/3164363875 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f01501247c0 0x7f01501c60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:22.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.620 7f014eab2700 1 -- 172.21.15.22:0/3164363875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0150124370 msgr2=0x7f01501c5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:22.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.620 7f014eab2700 1 --2- 172.21.15.22:0/3164363875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0150124370 0x7f01501c5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:22.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.620 7f014eab2700 1 -- 172.21.15.22:0/3164363875 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01501ba510 con 0x7f01501ba0c0 2022-04-28T14:39:22.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.620 7f014eab2700 1 --2- 172.21.15.22:0/3164363875 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f01501ba0c0 0x7f0150123d40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f01500d45f0 tx=0x7f014000eca0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:22.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.620 7f0147fff700 1 -- 172.21.15.22:0/3164363875 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f01501ba510 con 0x7f01501ba0c0 2022-04-28T14:39:22.628 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.620 7f0147fff700 1 -- 172.21.15.22:0/3164363875 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014000c9a0 con 0x7f01501ba0c0 2022-04-28T14:39:22.628 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.620 7f0155d38700 1 -- 172.21.15.22:0/3164363875 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01500cff70 con 0x7f01501ba0c0 2022-04-28T14:39:22.628 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.620 7f0147fff700 1 -- 172.21.15.22:0/3164363875 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f014000f040 con 0x7f01501ba0c0 2022-04-28T14:39:22.628 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.620 7f0155d38700 1 -- 172.21.15.22:0/3164363875 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01501cd0e0 con 0x7f01501ba0c0 2022-04-28T14:39:22.628 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.620 7f0147fff700 1 -- 172.21.15.22:0/3164363875 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f0140011070 con 0x7f01501ba0c0 2022-04-28T14:39:22.628 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.621 7f0147fff700 1 -- 172.21.15.22:0/3164363875 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f0140010040 con 0x7f01501ba0c0 2022-04-28T14:39:22.628 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.621 7f0155d38700 1 -- 172.21.15.22:0/3164363875 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01500f0400 con 0x7f01501ba0c0 2022-04-28T14:39:22.629 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.624 7f0147fff700 1 -- 172.21.15.22:0/3164363875 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f014000c5a0 con 0x7f01501ba0c0 2022-04-28T14:39:22.726 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.722 7f0155d38700 1 -- 172.21.15.22:0/3164363875 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f01500aba80 con 0x7f01501ba0c0 2022-04-28T14:39:22.726 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.722 7f0147fff700 1 -- 172.21.15.22:0/3164363875 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0140000c30 con 0x7f01501ba0c0 2022-04-28T14:39:22.727 INFO:teuthology.orchestra.run.smithi022.stdout:38654705671 2022-04-28T14:39:22.728 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.723 7f0155d38700 1 -- 172.21.15.22:0/3164363875 >> v1:172.21.15.22:6808/86956 conn(0x7f013401c1b0 legacy=0x7f013401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:22.728 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.723 7f0155d38700 1 -- 172.21.15.22:0/3164363875 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f01501ba0c0 msgr2=0x7f0150123d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:22.728 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.723 7f0155d38700 1 --2- 172.21.15.22:0/3164363875 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f01501ba0c0 0x7f0150123d40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f01500d45f0 tx=0x7f014000eca0).stop 2022-04-28T14:39:22.728 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.723 7f0155d38700 1 -- 172.21.15.22:0/3164363875 shutdown_connections 2022-04-28T14:39:22.728 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.723 7f0155d38700 1 --2- 172.21.15.22:0/3164363875 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f01501247c0 0x7f01501c60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:22.728 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.723 7f0155d38700 1 --2- 172.21.15.22:0/3164363875 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f01501ba0c0 0x7f0150123d40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:22.728 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.723 7f0155d38700 1 --2- 172.21.15.22:0/3164363875 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0150124370 0x7f01501c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:22.729 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.723 7f0155d38700 1 -- 172.21.15.22:0/3164363875 >> 172.21.15.22:0/3164363875 conn(0x7f01500e0dd0 msgr2=0x7f01500af160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:22.729 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.723 7f0155d38700 1 -- 172.21.15.22:0/3164363875 shutdown_connections 2022-04-28T14:39:22.729 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.723 7f0155d38700 1 -- 172.21.15.22:0/3164363875 wait complete. 2022-04-28T14:39:22.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705671 for osd.3 2022-04-28T14:39:22.739 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2022-04-28T14:39:22.739 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-04-28T14:39:22.870 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.863 7f9c5a658700 1 Processor -- start 2022-04-28T14:39:22.870 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.863 7f9c5a658700 1 -- start start 2022-04-28T14:39:22.870 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.863 7f9c5a658700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9c540f6390 0x7f9c540fe970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:22.870 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.863 7f9c5a658700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9c540ff3f0 0x7f9c541b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:22.870 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.863 7f9c5a658700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c540ab0b0 con 0x7f9c540fefa0 2022-04-28T14:39:22.870 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.863 7f9c5a658700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c541b2290 con 0x7f9c540ff3f0 2022-04-28T14:39:22.871 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.863 7f9c5a658700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c54115dd0 con 0x7f9c540f6390 2022-04-28T14:39:22.871 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.863 7f9c533b0700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9c540f6390 0x7f9c540fe970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:22.871 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.863 7f9c52baf700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9c540fefa0 0x7f9c541b1460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38412/0 (socket says 172.21.15.22:38412) 2022-04-28T14:39:22.871 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.864 7f9c52baf700 1 -- 172.21.15.22:0/3553336070 learned_addr learned my addr 172.21.15.22:0/3553336070 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:39:22.871 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.864 7f9c53bb1700 1 --2- 172.21.15.22:0/3553336070 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9c540ff3f0 0x7f9c541b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:22.871 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.864 7f9c533b0700 1 -- 172.21.15.22:0/3553336070 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9c540ff3f0 msgr2=0x7f9c541b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:22.871 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.864 7f9c533b0700 1 --2- 172.21.15.22:0/3553336070 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9c540ff3f0 0x7f9c541b1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:22.871 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.864 7f9c523ae700 1 -- 172.21.15.22:0/3553336070 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3870803941 0 0) 0x7f9c3c001110 con 0x7f9c540fefa0 2022-04-28T14:39:22.871 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.864 7f9c533b0700 1 -- 172.21.15.22:0/3553336070 >> v1:172.21.15.22:6789/0 conn(0x7f9c540fefa0 legacy=0x7f9c541b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:22.872 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.864 7f9c533b0700 1 -- 172.21.15.22:0/3553336070 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5410b7d0 con 0x7f9c540f6390 2022-04-28T14:39:22.872 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.864 7f9c533b0700 1 --2- 172.21.15.22:0/3553336070 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9c540f6390 0x7f9c540fe970 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f9c44002f70 tx=0x7f9c4400b9a0).ready entity=mon.2 client_cookie=9b491423c870a93c server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:22.872 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.864 7f9c523ae700 1 -- 172.21.15.22:0/3553336070 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9c5410b7d0 con 0x7f9c540f6390 2022-04-28T14:39:22.872 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.864 7f9c523ae700 1 -- 172.21.15.22:0/3553336070 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4400f970 con 0x7f9c540f6390 2022-04-28T14:39:22.872 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.864 7f9c523ae700 1 -- 172.21.15.22:0/3553336070 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9c44015070 con 0x7f9c540f6390 2022-04-28T14:39:22.872 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.864 7f9c5a658700 1 -- 172.21.15.22:0/3553336070 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9c540f6390 msgr2=0x7f9c540fe970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:22.872 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.864 7f9c5a658700 1 --2- 172.21.15.22:0/3553336070 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9c540f6390 0x7f9c540fe970 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f9c44002f70 tx=0x7f9c4400b9a0).stop 2022-04-28T14:39:22.872 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.865 7f9c5a658700 1 -- 172.21.15.22:0/3553336070 shutdown_connections 2022-04-28T14:39:22.872 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.865 7f9c5a658700 1 --2- 172.21.15.22:0/3553336070 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9c540ff3f0 0x7f9c541b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:22.873 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.865 7f9c5a658700 1 --2- 172.21.15.22:0/3553336070 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9c540f6390 0x7f9c540fe970 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:22.873 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.865 7f9c5a658700 1 -- 172.21.15.22:0/3553336070 >> 172.21.15.22:0/3553336070 conn(0x7f9c54117120 msgr2=0x7f9c540f2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:22.873 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.865 7f9c5a658700 1 -- 172.21.15.22:0/3553336070 shutdown_connections 2022-04-28T14:39:22.873 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.865 7f9c5a658700 1 -- 172.21.15.22:0/3553336070 wait complete. 2022-04-28T14:39:22.893 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.889 7f9c5a658700 1 Processor -- start 2022-04-28T14:39:22.893 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.889 7f9c5a658700 1 -- start start 2022-04-28T14:39:22.896 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.889 7f9c5a658700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c540cc020 0x7f9c540cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:22.896 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.889 7f9c5a658700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9c541ba700 0x7f9c541bab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:22.896 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.889 7f9c5a658700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9c541bb180 0x7f9c541c0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:22.896 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.889 7f9c5a658700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c541beb50 con 0x7f9c540cc020 2022-04-28T14:39:22.896 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.889 7f9c5a658700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c540bd7a0 con 0x7f9c541ba700 2022-04-28T14:39:22.896 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.889 7f9c5a658700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c540bd460 con 0x7f9c541bb180 2022-04-28T14:39:22.896 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.889 7f9c53bb1700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9c541bb180 0x7f9c541c0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:22.897 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.889 7f9c533b0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c540cc020 0x7f9c540cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:22.897 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.889 7f9c53bb1700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9c541bb180 0x7f9c541c0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46376/0 (socket says 172.21.15.22:46376) 2022-04-28T14:39:22.897 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.889 7f9c53bb1700 1 -- 172.21.15.22:0/1659504873 learned_addr learned my addr 172.21.15.22:0/1659504873 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:22.897 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.889 7f9c52baf700 1 --2- 172.21.15.22:0/1659504873 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9c541ba700 0x7f9c541bab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:22.897 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.890 7f9c533b0700 1 -- 172.21.15.22:0/1659504873 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9c541bb180 msgr2=0x7f9c541c0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:22.897 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.890 7f9c533b0700 1 --2- 172.21.15.22:0/1659504873 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9c541bb180 0x7f9c541c0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:22.897 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.890 7f9c533b0700 1 -- 172.21.15.22:0/1659504873 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9c541ba700 msgr2=0x7f9c541bab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:22.897 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.890 7f9c533b0700 1 --2- 172.21.15.22:0/1659504873 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9c541ba700 0x7f9c541bab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:22.897 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.890 7f9c533b0700 1 -- 172.21.15.22:0/1659504873 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c540df870 con 0x7f9c540cc020 2022-04-28T14:39:22.898 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.890 7f9c53bb1700 1 --2- 172.21.15.22:0/1659504873 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9c541bb180 0x7f9c541c0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:22.898 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.890 7f9c52baf700 1 --2- 172.21.15.22:0/1659504873 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9c541ba700 0x7f9c541bab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:22.898 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.890 7f9c533b0700 1 --2- 172.21.15.22:0/1659504873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c540cc020 0x7f9c540cc470 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f9c5410bb10 tx=0x7f9c440068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:22.898 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.890 7f9c50bab700 1 -- 172.21.15.22:0/1659504873 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9c540df870 con 0x7f9c540cc020 2022-04-28T14:39:22.898 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.890 7f9c50bab700 1 -- 172.21.15.22:0/1659504873 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c44010bc0 con 0x7f9c540cc020 2022-04-28T14:39:22.898 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.890 7f9c5a658700 1 -- 172.21.15.22:0/1659504873 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c541c14e0 con 0x7f9c540cc020 2022-04-28T14:39:22.898 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.890 7f9c50bab700 1 -- 172.21.15.22:0/1659504873 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f9c44021030 con 0x7f9c540cc020 2022-04-28T14:39:22.898 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.890 7f9c5a658700 1 -- 172.21.15.22:0/1659504873 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c541c19b0 con 0x7f9c540cc020 2022-04-28T14:39:22.898 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.890 7f9c50bab700 1 -- 172.21.15.22:0/1659504873 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f9c4401a480 con 0x7f9c540cc020 2022-04-28T14:39:22.898 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.891 7f9c50bab700 1 -- 172.21.15.22:0/1659504873 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f9c440027a0 con 0x7f9c540cc020 2022-04-28T14:39:22.899 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.891 7f9c5a658700 1 -- 172.21.15.22:0/1659504873 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c540f02c0 con 0x7f9c540cc020 2022-04-28T14:39:22.899 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.894 7f9c50bab700 1 -- 172.21.15.22:0/1659504873 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f9c440107c0 con 0x7f9c540cc020 2022-04-28T14:39:22.992 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.987 7f9c5a658700 1 -- 172.21.15.22:0/1659504873 --> v1:172.21.15.22:6808/86956 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f9c540882a0 con 0x7f9c3801c1b0 2022-04-28T14:39:23.000 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.995 7f9c50bab700 1 -- 172.21.15.22:0/1659504873 <== mgr.4104 v1:172.21.15.22:6808/86956 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306065 (unknown 2965378022 0 2196085566) 0x7f9c3c001580 con 0x7f9c3801c1b0 2022-04-28T14:39:23.004 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:23.006 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.998 7f9c5a658700 1 -- 172.21.15.22:0/1659504873 >> v1:172.21.15.22:6808/86956 conn(0x7f9c3801c1b0 legacy=0x7f9c3801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:23.006 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.998 7f9c5a658700 1 -- 172.21.15.22:0/1659504873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c540cc020 msgr2=0x7f9c540cc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:23.006 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.998 7f9c5a658700 1 --2- 172.21.15.22:0/1659504873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c540cc020 0x7f9c540cc470 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f9c5410bb10 tx=0x7f9c440068c0).stop 2022-04-28T14:39:23.006 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.998 7f9c5a658700 1 -- 172.21.15.22:0/1659504873 shutdown_connections 2022-04-28T14:39:23.007 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.998 7f9c5a658700 1 --2- 172.21.15.22:0/1659504873 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9c541bb180 0x7f9c541c0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.007 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.998 7f9c5a658700 1 --2- 172.21.15.22:0/1659504873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c540cc020 0x7f9c540cc470 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.007 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.998 7f9c5a658700 1 --2- 172.21.15.22:0/1659504873 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9c541ba700 0x7f9c541bab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.007 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.998 7f9c5a658700 1 -- 172.21.15.22:0/1659504873 >> 172.21.15.22:0/1659504873 conn(0x7f9c540bdd00 msgr2=0x7f9c540ab3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:23.007 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.998 7f9c5a658700 1 -- 172.21.15.22:0/1659504873 shutdown_connections 2022-04-28T14:39:23.007 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:22.998 7f9c5a658700 1 -- 172.21.15.22:0/1659504873 wait complete. 2022-04-28T14:39:23.007 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2022-04-28T14:39:23.013 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2022-04-28 14:39:22.263563","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3606,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":272,"acting":272,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":272,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4194992,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292368,"statfs":{"total":386547056640,"available":382251384832,"internally_reserved":4294967296,"allocated":671744,"data_stored":167536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1320,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000965"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.952742","last_change":"2022-04-28 14:39:13.943418","last_active":"2022-04-28 14:39:13.952742","last_peered":"2022-04-28 14:39:13.952742","last_clean":"2022-04-28 14:39:13.952742","last_became_active":"2022-04-28 14:39:13.943111","last_became_peered":"2022-04-28 14:39:13.943111","last_unstale":"2022-04-28 14:39:13.952742","last_undegraded":"2022-04-28 14:39:13.952742","last_fullsized":"2022-04-28 14:39:13.952742","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"16'4","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:16.607461","last_change":"2022-04-28 14:39:13.619263","last_active":"2022-04-28 14:39:16.607461","last_peered":"2022-04-28 14:39:16.607461","last_clean":"2022-04-28 14:39:16.607461","last_became_active":"2022-04-28 14:39:13.618911","last_became_peered":"2022-04-28 14:39:13.618911","last_unstale":"2022-04-28 14:39:16.607461","last_undegraded":"2022-04-28 14:39:16.607461","last_fullsized":"2022-04-28 14:39:16.607461","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967103","last_change":"2022-04-28 14:39:13.964730","last_active":"2022-04-28 14:39:13.967103","last_peered":"2022-04-28 14:39:13.967103","last_clean":"2022-04-28 14:39:13.967103","last_became_active":"2022-04-28 14:39:13.964405","last_became_peered":"2022-04-28 14:39:13.964405","last_unstale":"2022-04-28 14:39:13.967103","last_undegraded":"2022-04-28 14:39:13.967103","last_fullsized":"2022-04-28 14:39:13.967103","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.939780","last_change":"2022-04-28 14:39:13.611678","last_active":"2022-04-28 14:39:13.939780","last_peered":"2022-04-28 14:39:13.939780","last_clean":"2022-04-28 14:39:13.939780","last_became_active":"2022-04-28 14:39:13.611166","last_became_peered":"2022-04-28 14:39:13.611166","last_unstale":"2022-04-28 14:39:13.939780","last_undegraded":"2022-04-28 14:39:13.939780","last_fullsized":"2022-04-28 14:39:13.939780","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967673","last_change":"2022-04-28 14:39:13.960149","last_active":"2022-04-28 14:39:13.967673","last_peered":"2022-04-28 14:39:13.967673","last_clean":"2022-04-28 14:39:13.967673","last_became_active":"2022-04-28 14:39:13.959509","last_became_peered":"2022-04-28 14:39:13.959509","last_unstale":"2022-04-28 14:39:13.967673","last_undegraded":"2022-04-28 14:39:13.967673","last_fullsized":"2022-04-28 14:39:13.967673","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.937531","last_change":"2022-04-28 14:39:13.610970","last_active":"2022-04-28 14:39:13.937531","last_peered":"2022-04-28 14:39:13.937531","last_clean":"2022-04-28 14:39:13.937531","last_became_active":"2022-04-28 14:39:13.610661","last_became_peered":"2022-04-28 14:39:13.610661","last_unstale":"2022-04-28 14:39:13.937531","last_undegraded":"2022-04-28 14:39:13.937531","last_fullsized":"2022-04-28 14:39:13.937531","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.964032","last_change":"2022-04-28 14:39:13.963240","last_active":"2022-04-28 14:39:13.964032","last_peered":"2022-04-28 14:39:13.964032","last_clean":"2022-04-28 14:39:13.964032","last_became_active":"2022-04-28 14:39:13.961860","last_became_peered":"2022-04-28 14:39:13.961860","last_unstale":"2022-04-28 14:39:13.964032","last_undegraded":"2022-04-28 14:39:13.964032","last_fullsized":"2022-04-28 14:39:13.964032","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.936595","last_change":"2022-04-28 14:39:13.607628","last_active":"2022-04-28 14:39:13.936595","last_peered":"2022-04-28 14:39:13.936595","last_clean":"2022-04-28 14:39:13.936595","last_became_active":"2022-04-28 14:39:13.607234","last_became_peered":"2022-04-28 14:39:13.607234","last_unstale":"2022-04-28 14:39:13.936595","last_undegraded":"2022-04-28 14:39:13.936595","last_fullsized":"2022-04-28 14:39:13.936595","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.974109","last_change":"2022-04-28 14:39:13.972780","last_active":"2022-04-28 14:39:13.974109","last_peered":"2022-04-28 14:39:13.974109","last_clean":"2022-04-28 14:39:13.974109","last_became_active":"2022-04-28 14:39:13.972189","last_became_peered":"2022-04-28 14:39:13.972189","last_unstale":"2022-04-28 14:39:13.974109","last_undegraded":"2022-04-28 14:39:13.974109","last_fullsized":"2022-04-28 14:39:13.974109","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"16'3","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:16.602876","last_change":"2022-04-28 14:39:13.615060","last_active":"2022-04-28 14:39:16.602876","last_peered":"2022-04-28 14:39:16.602876","last_clean":"2022-04-28 14:39:16.602876","last_became_active":"2022-04-28 14:39:13.614686","last_became_peered":"2022-04-28 14:39:13.614686","last_unstale":"2022-04-28 14:39:16.602876","last_undegraded":"2022-04-28 14:39:16.602876","last_fullsized":"2022-04-28 14:39:16.602876","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967350","last_change":"2022-04-28 14:39:13.963855","last_active":"2022-04-28 14:39:13.967350","last_peered":"2022-04-28 14:39:13.967350","last_clean":"2022-04-28 14:39:13.967350","last_became_active":"2022-04-28 14:39:13.963518","last_became_peered":"2022-04-28 14:39:13.963518","last_unstale":"2022-04-28 14:39:13.967350","last_undegraded":"2022-04-28 14:39:13.967350","last_fullsized":"2022-04-28 14:39:13.967350","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.949698","last_change":"2022-04-28 14:39:13.623926","last_active":"2022-04-28 14:39:13.949698","last_peered":"2022-04-28 14:39:13.949698","last_clean":"2022-04-28 14:39:13.949698","last_became_active":"2022-04-28 14:39:13.623608","last_became_peered":"2022-04-28 14:39:13.623608","last_unstale":"2022-04-28 14:39:13.949698","last_undegraded":"2022-04-28 14:39:13.949698","last_fullsized":"2022-04-28 14:39:13.949698","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.969853","last_change":"2022-04-28 14:39:13.968270","last_active":"2022-04-28 14:39:13.969853","last_peered":"2022-04-28 14:39:13.969853","last_clean":"2022-04-28 14:39:13.969853","last_became_active":"2022-04-28 14:39:13.967894","last_became_peered":"2022-04-28 14:39:13.967894","last_unstale":"2022-04-28 14:39:13.969853","last_undegraded":"2022-04-28 14:39:13.969853","last_fullsized":"2022-04-28 14:39:13.969853","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"16'4","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:14.934685","last_change":"2022-04-28 14:39:13.613942","last_active":"2022-04-28 14:39:14.934685","last_peered":"2022-04-28 14:39:14.934685","last_clean":"2022-04-28 14:39:14.934685","last_became_active":"2022-04-28 14:39:13.613151","last_became_peered":"2022-04-28 14:39:13.613151","last_unstale":"2022-04-28 14:39:14.934685","last_undegraded":"2022-04-28 14:39:14.934685","last_fullsized":"2022-04-28 14:39:14.934685","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.974442","last_change":"2022-04-28 14:39:13.972010","last_active":"2022-04-28 14:39:13.974442","last_peered":"2022-04-28 14:39:13.974442","last_clean":"2022-04-28 14:39:13.974442","last_became_active":"2022-04-28 14:39:13.971680","last_became_peered":"2022-04-28 14:39:13.971680","last_unstale":"2022-04-28 14:39:13.974442","last_undegraded":"2022-04-28 14:39:13.974442","last_fullsized":"2022-04-28 14:39:13.974442","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.970613","last_change":"2022-04-28 14:39:13.608578","last_active":"2022-04-28 14:39:13.970613","last_peered":"2022-04-28 14:39:13.970613","last_clean":"2022-04-28 14:39:13.970613","last_became_active":"2022-04-28 14:39:13.608208","last_became_peered":"2022-04-28 14:39:13.608208","last_unstale":"2022-04-28 14:39:13.970613","last_undegraded":"2022-04-28 14:39:13.970613","last_fullsized":"2022-04-28 14:39:13.970613","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.964577","last_change":"2022-04-28 14:39:13.959741","last_active":"2022-04-28 14:39:13.964577","last_peered":"2022-04-28 14:39:13.964577","last_clean":"2022-04-28 14:39:13.964577","last_became_active":"2022-04-28 14:39:13.959445","last_became_peered":"2022-04-28 14:39:13.959445","last_unstale":"2022-04-28 14:39:13.964577","last_undegraded":"2022-04-28 14:39:13.964577","last_fullsized":"2022-04-28 14:39:13.964577","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'3","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:16.604048","last_change":"2022-04-28 14:39:13.615947","last_active":"2022-04-28 14:39:16.604048","last_peered":"2022-04-28 14:39:16.604048","last_clean":"2022-04-28 14:39:16.604048","last_became_active":"2022-04-28 14:39:13.615589","last_became_peered":"2022-04-28 14:39:13.615589","last_unstale":"2022-04-28 14:39:16.604048","last_undegraded":"2022-04-28 14:39:16.604048","last_fullsized":"2022-04-28 14:39:16.604048","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.969361","last_change":"2022-04-28 14:39:13.966950","last_active":"2022-04-28 14:39:13.969361","last_peered":"2022-04-28 14:39:13.969361","last_clean":"2022-04-28 14:39:13.969361","last_became_active":"2022-04-28 14:39:13.961621","last_became_peered":"2022-04-28 14:39:13.961621","last_unstale":"2022-04-28 14:39:13.969361","last_undegraded":"2022-04-28 14:39:13.969361","last_fullsized":"2022-04-28 14:39:13.969361","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"16'3","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:16.605478","last_change":"2022-04-28 14:39:13.614233","last_active":"2022-04-28 14:39:16.605478","last_peered":"2022-04-28 14:39:16.605478","last_clean":"2022-04-28 14:39:16.605478","last_became_active":"2022-04-28 14:39:13.613890","last_became_peered":"2022-04-28 14:39:13.613890","last_unstale":"2022-04-28 14:39:16.605478","last_undegraded":"2022-04-28 14:39:16.605478","last_fullsized":"2022-04-28 14:39:16.605478","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.963364","last_change":"2022-04-28 14:39:13.953204","last_active":"2022-04-28 14:39:13.963364","last_peered":"2022-04-28 14:39:13.963364","last_clean":"2022-04-28 14:39:13.963364","last_became_active":"2022-04-28 14:39:13.952884","last_became_peered":"2022-04-28 14:39:13.952884","last_unstale":"2022-04-28 14:39:13.963364","last_undegraded":"2022-04-28 14:39:13.963364","last_fullsized":"2022-04-28 14:39:13.963364","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943168","last_change":"2022-04-28 14:39:13.616607","last_active":"2022-04-28 14:39:13.943168","last_peered":"2022-04-28 14:39:13.943168","last_clean":"2022-04-28 14:39:13.943168","last_became_active":"2022-04-28 14:39:13.616264","last_became_peered":"2022-04-28 14:39:13.616264","last_unstale":"2022-04-28 14:39:13.943168","last_undegraded":"2022-04-28 14:39:13.943168","last_fullsized":"2022-04-28 14:39:13.943168","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967596","last_change":"2022-04-28 14:39:13.958559","last_active":"2022-04-28 14:39:13.967596","last_peered":"2022-04-28 14:39:13.967596","last_clean":"2022-04-28 14:39:13.967596","last_became_active":"2022-04-28 14:39:13.958048","last_became_peered":"2022-04-28 14:39:13.958048","last_unstale":"2022-04-28 14:39:13.967596","last_undegraded":"2022-04-28 14:39:13.967596","last_fullsized":"2022-04-28 14:39:13.967596","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.963748","last_change":"2022-04-28 14:39:13.599319","last_active":"2022-04-28 14:39:13.963748","last_peered":"2022-04-28 14:39:13.963748","last_clean":"2022-04-28 14:39:13.963748","last_became_active":"2022-04-28 14:39:13.598926","last_became_peered":"2022-04-28 14:39:13.598926","last_unstale":"2022-04-28 14:39:13.963748","last_undegraded":"2022-04-28 14:39:13.963748","last_fullsized":"2022-04-28 14:39:13.963748","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.957215","last_change":"2022-04-28 14:39:13.953566","last_active":"2022-04-28 14:39:13.957215","last_peered":"2022-04-28 14:39:13.957215","last_clean":"2022-04-28 14:39:13.957215","last_became_active":"2022-04-28 14:39:13.953248","last_became_peered":"2022-04-28 14:39:13.953248","last_unstale":"2022-04-28 14:39:13.957215","last_undegraded":"2022-04-28 14:39:13.957215","last_fullsized":"2022-04-28 14:39:13.957215","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967268","last_change":"2022-04-28 14:39:13.621471","last_active":"2022-04-28 14:39:13.967268","last_peered":"2022-04-28 14:39:13.967268","last_clean":"2022-04-28 14:39:13.967268","last_became_active":"2022-04-28 14:39:13.621155","last_became_peered":"2022-04-28 14:39:13.621155","last_unstale":"2022-04-28 14:39:13.967268","last_undegraded":"2022-04-28 14:39:13.967268","last_fullsized":"2022-04-28 14:39:13.967268","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967331","last_change":"2022-04-28 14:39:13.961895","last_active":"2022-04-28 14:39:13.967331","last_peered":"2022-04-28 14:39:13.967331","last_clean":"2022-04-28 14:39:13.967331","last_became_active":"2022-04-28 14:39:13.961160","last_became_peered":"2022-04-28 14:39:13.961160","last_unstale":"2022-04-28 14:39:13.967331","last_undegraded":"2022-04-28 14:39:13.967331","last_fullsized":"2022-04-28 14:39:13.967331","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.972847","last_change":"2022-04-28 14:39:13.608696","last_active":"2022-04-28 14:39:13.972847","last_peered":"2022-04-28 14:39:13.972847","last_clean":"2022-04-28 14:39:13.972847","last_became_active":"2022-04-28 14:39:13.608335","last_became_peered":"2022-04-28 14:39:13.608335","last_unstale":"2022-04-28 14:39:13.972847","last_undegraded":"2022-04-28 14:39:13.972847","last_fullsized":"2022-04-28 14:39:13.972847","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.964505","last_change":"2022-04-28 14:39:13.959179","last_active":"2022-04-28 14:39:13.964505","last_peered":"2022-04-28 14:39:13.964505","last_clean":"2022-04-28 14:39:13.964505","last_became_active":"2022-04-28 14:39:13.958838","last_became_peered":"2022-04-28 14:39:13.958838","last_unstale":"2022-04-28 14:39:13.964505","last_undegraded":"2022-04-28 14:39:13.964505","last_fullsized":"2022-04-28 14:39:13.964505","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.940753","last_change":"2022-04-28 14:39:13.618291","last_active":"2022-04-28 14:39:13.940753","last_peered":"2022-04-28 14:39:13.940753","last_clean":"2022-04-28 14:39:13.940753","last_became_active":"2022-04-28 14:39:13.617912","last_became_peered":"2022-04-28 14:39:13.617912","last_unstale":"2022-04-28 14:39:13.940753","last_undegraded":"2022-04-28 14:39:13.940753","last_fullsized":"2022-04-28 14:39:13.940753","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.969809","last_change":"2022-04-28 14:39:13.966352","last_active":"2022-04-28 14:39:13.969809","last_peered":"2022-04-28 14:39:13.969809","last_clean":"2022-04-28 14:39:13.969809","last_became_active":"2022-04-28 14:39:13.966039","last_became_peered":"2022-04-28 14:39:13.966039","last_unstale":"2022-04-28 14:39:13.969809","last_undegraded":"2022-04-28 14:39:13.969809","last_fullsized":"2022-04-28 14:39:13.969809","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943346","last_change":"2022-04-28 14:39:13.601416","last_active":"2022-04-28 14:39:13.943346","last_peered":"2022-04-28 14:39:13.943346","last_clean":"2022-04-28 14:39:13.943346","last_became_active":"2022-04-28 14:39:13.601028","last_became_peered":"2022-04-28 14:39:13.601028","last_unstale":"2022-04-28 14:39:13.943346","last_undegraded":"2022-04-28 14:39:13.943346","last_fullsized":"2022-04-28 14:39:13.943346","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.970241","last_change":"2022-04-28 14:39:13.958313","last_active":"2022-04-28 14:39:13.970241","last_peered":"2022-04-28 14:39:13.970241","last_clean":"2022-04-28 14:39:13.970241","last_became_active":"2022-04-28 14:39:13.956853","last_became_peered":"2022-04-28 14:39:13.956853","last_unstale":"2022-04-28 14:39:13.970241","last_undegraded":"2022-04-28 14:39:13.970241","last_fullsized":"2022-04-28 14:39:13.970241","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.960773","last_change":"2022-04-28 14:39:13.613340","last_active":"2022-04-28 14:39:13.960773","last_peered":"2022-04-28 14:39:13.960773","last_clean":"2022-04-28 14:39:13.960773","last_became_active":"2022-04-28 14:39:13.612902","last_became_peered":"2022-04-28 14:39:13.612902","last_unstale":"2022-04-28 14:39:13.960773","last_undegraded":"2022-04-28 14:39:13.960773","last_fullsized":"2022-04-28 14:39:13.960773","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.969340","last_change":"2022-04-28 14:39:13.966772","last_active":"2022-04-28 14:39:13.969340","last_peered":"2022-04-28 14:39:13.969340","last_clean":"2022-04-28 14:39:13.969340","last_became_active":"2022-04-28 14:39:13.961393","last_became_peered":"2022-04-28 14:39:13.961393","last_unstale":"2022-04-28 14:39:13.969340","last_undegraded":"2022-04-28 14:39:13.969340","last_fullsized":"2022-04-28 14:39:13.969340","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.942112","last_change":"2022-04-28 14:39:13.619825","last_active":"2022-04-28 14:39:13.942112","last_peered":"2022-04-28 14:39:13.942112","last_clean":"2022-04-28 14:39:13.942112","last_became_active":"2022-04-28 14:39:13.619514","last_became_peered":"2022-04-28 14:39:13.619514","last_unstale":"2022-04-28 14:39:13.942112","last_undegraded":"2022-04-28 14:39:13.942112","last_fullsized":"2022-04-28 14:39:13.942112","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.957541","last_change":"2022-04-28 14:39:13.956243","last_active":"2022-04-28 14:39:13.957541","last_peered":"2022-04-28 14:39:13.957541","last_clean":"2022-04-28 14:39:13.957541","last_became_active":"2022-04-28 14:39:13.955924","last_became_peered":"2022-04-28 14:39:13.955924","last_unstale":"2022-04-28 14:39:13.957541","last_undegraded":"2022-04-28 14:39:13.957541","last_fullsized":"2022-04-28 14:39:13.957541","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"16'3","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:16.603217","last_change":"2022-04-28 14:39:13.607250","last_active":"2022-04-28 14:39:16.603217","last_peered":"2022-04-28 14:39:16.603217","last_clean":"2022-04-28 14:39:16.603217","last_became_active":"2022-04-28 14:39:13.606892","last_became_peered":"2022-04-28 14:39:13.606892","last_unstale":"2022-04-28 14:39:16.603217","last_undegraded":"2022-04-28 14:39:16.603217","last_fullsized":"2022-04-28 14:39:16.603217","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967619","last_change":"2022-04-28 14:39:13.958594","last_active":"2022-04-28 14:39:13.967619","last_peered":"2022-04-28 14:39:13.967619","last_clean":"2022-04-28 14:39:13.967619","last_became_active":"2022-04-28 14:39:13.958234","last_became_peered":"2022-04-28 14:39:13.958234","last_unstale":"2022-04-28 14:39:13.967619","last_undegraded":"2022-04-28 14:39:13.967619","last_fullsized":"2022-04-28 14:39:13.967619","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943967","last_change":"2022-04-28 14:39:13.610919","last_active":"2022-04-28 14:39:13.943967","last_peered":"2022-04-28 14:39:13.943967","last_clean":"2022-04-28 14:39:13.943967","last_became_active":"2022-04-28 14:39:13.610535","last_became_peered":"2022-04-28 14:39:13.610535","last_unstale":"2022-04-28 14:39:13.943967","last_undegraded":"2022-04-28 14:39:13.943967","last_fullsized":"2022-04-28 14:39:13.943967","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.970041","last_change":"2022-04-28 14:39:13.968427","last_active":"2022-04-28 14:39:13.970041","last_peered":"2022-04-28 14:39:13.970041","last_clean":"2022-04-28 14:39:13.970041","last_became_active":"2022-04-28 14:39:13.968116","last_became_peered":"2022-04-28 14:39:13.968116","last_unstale":"2022-04-28 14:39:13.970041","last_undegraded":"2022-04-28 14:39:13.970041","last_fullsized":"2022-04-28 14:39:13.970041","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943521","last_change":"2022-04-28 14:39:05.390479","last_active":"2022-04-28 14:39:13.943521","last_peered":"2022-04-28 14:39:13.943521","last_clean":"2022-04-28 14:39:13.943521","last_became_active":"2022-04-28 14:39:05.390111","last_became_peered":"2022-04-28 14:39:05.390111","last_unstale":"2022-04-28 14:39:13.943521","last_undegraded":"2022-04-28 14:39:13.943521","last_fullsized":"2022-04-28 14:39:13.943521","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.941477","last_change":"2022-04-28 14:39:13.610156","last_active":"2022-04-28 14:39:13.941477","last_peered":"2022-04-28 14:39:13.941477","last_clean":"2022-04-28 14:39:13.941477","last_became_active":"2022-04-28 14:39:13.609823","last_became_peered":"2022-04-28 14:39:13.609823","last_unstale":"2022-04-28 14:39:13.941477","last_undegraded":"2022-04-28 14:39:13.941477","last_fullsized":"2022-04-28 14:39:13.941477","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.962538","last_change":"2022-04-28 14:39:13.952310","last_active":"2022-04-28 14:39:13.962538","last_peered":"2022-04-28 14:39:13.962538","last_clean":"2022-04-28 14:39:13.962538","last_became_active":"2022-04-28 14:39:13.951984","last_became_peered":"2022-04-28 14:39:13.951984","last_unstale":"2022-04-28 14:39:13.962538","last_undegraded":"2022-04-28 14:39:13.962538","last_fullsized":"2022-04-28 14:39:13.962538","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.945719","last_change":"2022-04-28 14:39:05.388548","last_active":"2022-04-28 14:39:13.945719","last_peered":"2022-04-28 14:39:13.945719","last_clean":"2022-04-28 14:39:13.945719","last_became_active":"2022-04-28 14:39:05.388215","last_became_peered":"2022-04-28 14:39:05.388215","last_unstale":"2022-04-28 14:39:13.945719","last_undegraded":"2022-04-28 14:39:13.945719","last_fullsized":"2022-04-28 14:39:13.945719","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.971324","last_change":"2022-04-28 14:39:13.627277","last_active":"2022-04-28 14:39:13.971324","last_peered":"2022-04-28 14:39:13.971324","last_clean":"2022-04-28 14:39:13.971324","last_became_active":"2022-04-28 14:39:13.626883","last_became_peered":"2022-04-28 14:39:13.626883","last_unstale":"2022-04-28 14:39:13.971324","last_undegraded":"2022-04-28 14:39:13.971324","last_fullsized":"2022-04-28 14:39:13.971324","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.940615","last_change":"2022-04-28 14:39:05.388784","last_active":"2022-04-28 14:39:13.940615","last_peered":"2022-04-28 14:39:13.940615","last_clean":"2022-04-28 14:39:13.940615","last_became_active":"2022-04-28 14:39:05.388043","last_became_peered":"2022-04-28 14:39:05.388043","last_unstale":"2022-04-28 14:39:13.940615","last_undegraded":"2022-04-28 14:39:13.940615","last_fullsized":"2022-04-28 14:39:13.940615","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:15.554630","last_change":"2022-04-28 14:39:13.622411","last_active":"2022-04-28 14:39:15.554630","last_peered":"2022-04-28 14:39:15.554630","last_clean":"2022-04-28 14:39:15.554630","last_became_active":"2022-04-28 14:39:13.621590","last_became_peered":"2022-04-28 14:39:13.621590","last_unstale":"2022-04-28 14:39:15.554630","last_undegraded":"2022-04-28 14:39:15.554630","last_fullsized":"2022-04-28 14:39:15.554630","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.963743","last_change":"2022-04-28 14:39:13.955187","last_active":"2022-04-28 14:39:13.963743","last_peered":"2022-04-28 14:39:13.963743","last_clean":"2022-04-28 14:39:13.963743","last_became_active":"2022-04-28 14:39:13.954831","last_became_peered":"2022-04-28 14:39:13.954831","last_unstale":"2022-04-28 14:39:13.963743","last_undegraded":"2022-04-28 14:39:13.963743","last_fullsized":"2022-04-28 14:39:13.963743","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943544","last_change":"2022-04-28 14:39:05.390881","last_active":"2022-04-28 14:39:13.943544","last_peered":"2022-04-28 14:39:13.943544","last_clean":"2022-04-28 14:39:13.943544","last_became_active":"2022-04-28 14:39:05.390559","last_became_peered":"2022-04-28 14:39:05.390559","last_unstale":"2022-04-28 14:39:13.943544","last_undegraded":"2022-04-28 14:39:13.943544","last_fullsized":"2022-04-28 14:39:13.943544","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:14.932410","last_change":"2022-04-28 14:39:13.608628","last_active":"2022-04-28 14:39:14.932410","last_peered":"2022-04-28 14:39:14.932410","last_clean":"2022-04-28 14:39:14.932410","last_became_active":"2022-04-28 14:39:13.608261","last_became_peered":"2022-04-28 14:39:13.608261","last_unstale":"2022-04-28 14:39:14.932410","last_undegraded":"2022-04-28 14:39:14.932410","last_fullsized":"2022-04-28 14:39:14.932410","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.952043","last_change":"2022-04-28 14:39:13.944110","last_active":"2022-04-28 14:39:13.952043","last_peered":"2022-04-28 14:39:13.952043","last_clean":"2022-04-28 14:39:13.952043","last_became_active":"2022-04-28 14:39:13.943780","last_became_peered":"2022-04-28 14:39:13.943780","last_unstale":"2022-04-28 14:39:13.952043","last_undegraded":"2022-04-28 14:39:13.952043","last_fullsized":"2022-04-28 14:39:13.952043","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.935718","last_change":"2022-04-28 14:39:05.390962","last_active":"2022-04-28 14:39:13.935718","last_peered":"2022-04-28 14:39:13.935718","last_clean":"2022-04-28 14:39:13.935718","last_became_active":"2022-04-28 14:39:05.390602","last_became_peered":"2022-04-28 14:39:05.390602","last_unstale":"2022-04-28 14:39:13.935718","last_undegraded":"2022-04-28 14:39:13.935718","last_fullsized":"2022-04-28 14:39:13.935718","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'2","reported_seq":"12","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:16.603623","last_change":"2022-04-28 14:39:13.614524","last_active":"2022-04-28 14:39:16.603623","last_peered":"2022-04-28 14:39:16.603623","last_clean":"2022-04-28 14:39:16.603623","last_became_active":"2022-04-28 14:39:13.614177","last_became_peered":"2022-04-28 14:39:13.614177","last_unstale":"2022-04-28 14:39:16.603623","last_undegraded":"2022-04-28 14:39:16.603623","last_fullsized":"2022-04-28 14:39:16.603623","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.970262","last_change":"2022-04-28 14:39:13.960464","last_active":"2022-04-28 14:39:13.970262","last_peered":"2022-04-28 14:39:13.970262","last_clean":"2022-04-28 14:39:13.970262","last_became_active":"2022-04-28 14:39:13.958817","last_became_peered":"2022-04-28 14:39:13.958817","last_unstale":"2022-04-28 14:39:13.970262","last_undegraded":"2022-04-28 14:39:13.970262","last_fullsized":"2022-04-28 14:39:13.970262","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.937426","last_change":"2022-04-28 14:39:05.389329","last_active":"2022-04-28 14:39:13.937426","last_peered":"2022-04-28 14:39:13.937426","last_clean":"2022-04-28 14:39:13.937426","last_became_active":"2022-04-28 14:39:05.389030","last_became_peered":"2022-04-28 14:39:05.389030","last_unstale":"2022-04-28 14:39:13.937426","last_undegraded":"2022-04-28 14:39:13.937426","last_fullsized":"2022-04-28 14:39:13.937426","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.939667","last_change":"2022-04-28 14:39:13.624225","last_active":"2022-04-28 14:39:13.939667","last_peered":"2022-04-28 14:39:13.939667","last_clean":"2022-04-28 14:39:13.939667","last_became_active":"2022-04-28 14:39:13.623631","last_became_peered":"2022-04-28 14:39:13.623631","last_unstale":"2022-04-28 14:39:13.939667","last_undegraded":"2022-04-28 14:39:13.939667","last_fullsized":"2022-04-28 14:39:13.939667","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.957004","last_change":"2022-04-28 14:39:13.951379","last_active":"2022-04-28 14:39:13.957004","last_peered":"2022-04-28 14:39:13.957004","last_clean":"2022-04-28 14:39:13.957004","last_became_active":"2022-04-28 14:39:13.950657","last_became_peered":"2022-04-28 14:39:13.950657","last_unstale":"2022-04-28 14:39:13.957004","last_undegraded":"2022-04-28 14:39:13.957004","last_fullsized":"2022-04-28 14:39:13.957004","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.947902","last_change":"2022-04-28 14:39:05.388553","last_active":"2022-04-28 14:39:13.947902","last_peered":"2022-04-28 14:39:13.947902","last_clean":"2022-04-28 14:39:13.947902","last_became_active":"2022-04-28 14:39:05.388170","last_became_peered":"2022-04-28 14:39:05.388170","last_unstale":"2022-04-28 14:39:13.947902","last_undegraded":"2022-04-28 14:39:13.947902","last_fullsized":"2022-04-28 14:39:13.947902","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.953366","last_change":"2022-04-28 14:39:13.627446","last_active":"2022-04-28 14:39:13.953366","last_peered":"2022-04-28 14:39:13.953366","last_clean":"2022-04-28 14:39:13.953366","last_became_active":"2022-04-28 14:39:13.627067","last_became_peered":"2022-04-28 14:39:13.627067","last_unstale":"2022-04-28 14:39:13.953366","last_undegraded":"2022-04-28 14:39:13.953366","last_fullsized":"2022-04-28 14:39:13.953366","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.961324","last_change":"2022-04-28 14:39:13.951391","last_active":"2022-04-28 14:39:13.961324","last_peered":"2022-04-28 14:39:13.961324","last_clean":"2022-04-28 14:39:13.961324","last_became_active":"2022-04-28 14:39:13.951063","last_became_peered":"2022-04-28 14:39:13.951063","last_unstale":"2022-04-28 14:39:13.961324","last_undegraded":"2022-04-28 14:39:13.961324","last_fullsized":"2022-04-28 14:39:13.961324","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.941494","last_change":"2022-04-28 14:39:05.388412","last_active":"2022-04-28 14:39:13.941494","last_peered":"2022-04-28 14:39:13.941494","last_clean":"2022-04-28 14:39:13.941494","last_became_active":"2022-04-28 14:39:05.388067","last_became_peered":"2022-04-28 14:39:05.388067","last_unstale":"2022-04-28 14:39:13.941494","last_undegraded":"2022-04-28 14:39:13.941494","last_fullsized":"2022-04-28 14:39:13.941494","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.940916","last_change":"2022-04-28 14:39:13.609546","last_active":"2022-04-28 14:39:13.940916","last_peered":"2022-04-28 14:39:13.940916","last_clean":"2022-04-28 14:39:13.940916","last_became_active":"2022-04-28 14:39:13.609231","last_became_peered":"2022-04-28 14:39:13.609231","last_unstale":"2022-04-28 14:39:13.940916","last_undegraded":"2022-04-28 14:39:13.940916","last_fullsized":"2022-04-28 14:39:13.940916","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.973586","last_change":"2022-04-28 14:39:13.971977","last_active":"2022-04-28 14:39:13.973586","last_peered":"2022-04-28 14:39:13.973586","last_clean":"2022-04-28 14:39:13.973586","last_became_active":"2022-04-28 14:39:13.971343","last_became_peered":"2022-04-28 14:39:13.971343","last_unstale":"2022-04-28 14:39:13.973586","last_undegraded":"2022-04-28 14:39:13.973586","last_fullsized":"2022-04-28 14:39:13.973586","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.974303","last_change":"2022-04-28 14:39:13.970909","last_active":"2022-04-28 14:39:13.974303","last_peered":"2022-04-28 14:39:13.974303","last_clean":"2022-04-28 14:39:13.974303","last_became_active":"2022-04-28 14:39:13.970599","last_became_peered":"2022-04-28 14:39:13.970599","last_unstale":"2022-04-28 14:39:13.974303","last_undegraded":"2022-04-28 14:39:13.974303","last_fullsized":"2022-04-28 14:39:13.974303","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.948934","last_change":"2022-04-28 14:39:13.622383","last_active":"2022-04-28 14:39:13.948934","last_peered":"2022-04-28 14:39:13.948934","last_clean":"2022-04-28 14:39:13.948934","last_became_active":"2022-04-28 14:39:13.620810","last_became_peered":"2022-04-28 14:39:13.620810","last_unstale":"2022-04-28 14:39:13.948934","last_undegraded":"2022-04-28 14:39:13.948934","last_fullsized":"2022-04-28 14:39:13.948934","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.961345","last_change":"2022-04-28 14:39:13.951426","last_active":"2022-04-28 14:39:13.961345","last_peered":"2022-04-28 14:39:13.961345","last_clean":"2022-04-28 14:39:13.961345","last_became_active":"2022-04-28 14:39:13.951111","last_became_peered":"2022-04-28 14:39:13.951111","last_unstale":"2022-04-28 14:39:13.961345","last_undegraded":"2022-04-28 14:39:13.961345","last_fullsized":"2022-04-28 14:39:13.961345","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.964946","last_change":"2022-04-28 14:39:13.622151","last_active":"2022-04-28 14:39:13.964946","last_peered":"2022-04-28 14:39:13.964946","last_clean":"2022-04-28 14:39:13.964946","last_became_active":"2022-04-28 14:39:13.621812","last_became_peered":"2022-04-28 14:39:13.621812","last_unstale":"2022-04-28 14:39:13.964946","last_undegraded":"2022-04-28 14:39:13.964946","last_fullsized":"2022-04-28 14:39:13.964946","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967311","last_change":"2022-04-28 14:39:13.961409","last_active":"2022-04-28 14:39:13.967311","last_peered":"2022-04-28 14:39:13.967311","last_clean":"2022-04-28 14:39:13.967311","last_became_active":"2022-04-28 14:39:13.961034","last_became_peered":"2022-04-28 14:39:13.961034","last_unstale":"2022-04-28 14:39:13.967311","last_undegraded":"2022-04-28 14:39:13.967311","last_fullsized":"2022-04-28 14:39:13.967311","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.970906","last_change":"2022-04-28 14:39:13.627961","last_active":"2022-04-28 14:39:13.970906","last_peered":"2022-04-28 14:39:13.970906","last_clean":"2022-04-28 14:39:13.970906","last_became_active":"2022-04-28 14:39:13.627595","last_became_peered":"2022-04-28 14:39:13.627595","last_unstale":"2022-04-28 14:39:13.970906","last_undegraded":"2022-04-28 14:39:13.970906","last_fullsized":"2022-04-28 14:39:13.970906","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.975440","last_change":"2022-04-28 14:39:13.973251","last_active":"2022-04-28 14:39:13.975440","last_peered":"2022-04-28 14:39:13.975440","last_clean":"2022-04-28 14:39:13.975440","last_became_active":"2022-04-28 14:39:13.973008","last_became_peered":"2022-04-28 14:39:13.973008","last_unstale":"2022-04-28 14:39:13.975440","last_undegraded":"2022-04-28 14:39:13.975440","last_fullsized":"2022-04-28 14:39:13.975440","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.971384","last_change":"2022-04-28 14:39:13.619997","last_active":"2022-04-28 14:39:13.971384","last_peered":"2022-04-28 14:39:13.971384","last_clean":"2022-04-28 14:39:13.971384","last_became_active":"2022-04-28 14:39:13.619739","last_became_peered":"2022-04-28 14:39:13.619739","last_unstale":"2022-04-28 14:39:13.971384","last_undegraded":"2022-04-28 14:39:13.971384","last_fullsized":"2022-04-28 14:39:13.971384","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.949245","last_change":"2022-04-28 14:39:13.944278","last_active":"2022-04-28 14:39:13.949245","last_peered":"2022-04-28 14:39:13.949245","last_clean":"2022-04-28 14:39:13.949245","last_became_active":"2022-04-28 14:39:13.943973","last_became_peered":"2022-04-28 14:39:13.943973","last_unstale":"2022-04-28 14:39:13.949245","last_undegraded":"2022-04-28 14:39:13.949245","last_fullsized":"2022-04-28 14:39:13.949245","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.936304","last_change":"2022-04-28 14:39:13.622598","last_active":"2022-04-28 14:39:13.936304","last_peered":"2022-04-28 14:39:13.936304","last_clean":"2022-04-28 14:39:13.936304","last_became_active":"2022-04-28 14:39:13.622080","last_became_peered":"2022-04-28 14:39:13.622080","last_unstale":"2022-04-28 14:39:13.936304","last_undegraded":"2022-04-28 14:39:13.936304","last_fullsized":"2022-04-28 14:39:13.936304","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.955715","last_change":"2022-04-28 14:39:13.952416","last_active":"2022-04-28 14:39:13.955715","last_peered":"2022-04-28 14:39:13.955715","last_clean":"2022-04-28 14:39:13.955715","last_became_active":"2022-04-28 14:39:13.952100","last_became_peered":"2022-04-28 14:39:13.952100","last_unstale":"2022-04-28 14:39:13.955715","last_undegraded":"2022-04-28 14:39:13.955715","last_fullsized":"2022-04-28 14:39:13.955715","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.935394","last_change":"2022-04-28 14:39:13.602486","last_active":"2022-04-28 14:39:13.935394","last_peered":"2022-04-28 14:39:13.935394","last_clean":"2022-04-28 14:39:13.935394","last_became_active":"2022-04-28 14:39:13.602105","last_became_peered":"2022-04-28 14:39:13.602105","last_unstale":"2022-04-28 14:39:13.935394","last_undegraded":"2022-04-28 14:39:13.935394","last_fullsized":"2022-04-28 14:39:13.935394","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967037","last_change":"2022-04-28 14:39:13.964624","last_active":"2022-04-28 14:39:13.967037","last_peered":"2022-04-28 14:39:13.967037","last_clean":"2022-04-28 14:39:13.967037","last_became_active":"2022-04-28 14:39:13.964305","last_became_peered":"2022-04-28 14:39:13.964305","last_unstale":"2022-04-28 14:39:13.967037","last_undegraded":"2022-04-28 14:39:13.967037","last_fullsized":"2022-04-28 14:39:13.967037","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.939875","last_change":"2022-04-28 14:39:13.624420","last_active":"2022-04-28 14:39:13.939875","last_peered":"2022-04-28 14:39:13.939875","last_clean":"2022-04-28 14:39:13.939875","last_became_active":"2022-04-28 14:39:13.623884","last_became_peered":"2022-04-28 14:39:13.623884","last_unstale":"2022-04-28 14:39:13.939875","last_undegraded":"2022-04-28 14:39:13.939875","last_fullsized":"2022-04-28 14:39:13.939875","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.970283","last_change":"2022-04-28 14:39:13.960655","last_active":"2022-04-28 14:39:13.970283","last_peered":"2022-04-28 14:39:13.970283","last_clean":"2022-04-28 14:39:13.970283","last_became_active":"2022-04-28 14:39:13.960060","last_became_peered":"2022-04-28 14:39:13.960060","last_unstale":"2022-04-28 14:39:13.970283","last_undegraded":"2022-04-28 14:39:13.970283","last_fullsized":"2022-04-28 14:39:13.970283","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943941","last_change":"2022-04-28 14:39:13.624344","last_active":"2022-04-28 14:39:13.943941","last_peered":"2022-04-28 14:39:13.943941","last_clean":"2022-04-28 14:39:13.943941","last_became_active":"2022-04-28 14:39:13.623843","last_became_peered":"2022-04-28 14:39:13.623843","last_unstale":"2022-04-28 14:39:13.943941","last_undegraded":"2022-04-28 14:39:13.943941","last_fullsized":"2022-04-28 14:39:13.943941","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.973468","last_change":"2022-04-28 14:39:13.969259","last_active":"2022-04-28 14:39:13.973468","last_peered":"2022-04-28 14:39:13.973468","last_clean":"2022-04-28 14:39:13.973468","last_became_active":"2022-04-28 14:39:13.968448","last_became_peered":"2022-04-28 14:39:13.968448","last_unstale":"2022-04-28 14:39:13.973468","last_undegraded":"2022-04-28 14:39:13.973468","last_fullsized":"2022-04-28 14:39:13.973468","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.941007","last_change":"2022-04-28 14:39:13.609457","last_active":"2022-04-28 14:39:13.941007","last_peered":"2022-04-28 14:39:13.941007","last_clean":"2022-04-28 14:39:13.941007","last_became_active":"2022-04-28 14:39:13.609114","last_became_peered":"2022-04-28 14:39:13.609114","last_unstale":"2022-04-28 14:39:13.941007","last_undegraded":"2022-04-28 14:39:13.941007","last_fullsized":"2022-04-28 14:39:13.941007","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967821","last_change":"2022-04-28 14:39:13.960837","last_active":"2022-04-28 14:39:13.967821","last_peered":"2022-04-28 14:39:13.967821","last_clean":"2022-04-28 14:39:13.967821","last_became_active":"2022-04-28 14:39:13.960511","last_became_peered":"2022-04-28 14:39:13.960511","last_unstale":"2022-04-28 14:39:13.967821","last_undegraded":"2022-04-28 14:39:13.967821","last_fullsized":"2022-04-28 14:39:13.967821","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:14.933198","last_change":"2022-04-28 14:39:13.600840","last_active":"2022-04-28 14:39:14.933198","last_peered":"2022-04-28 14:39:14.933198","last_clean":"2022-04-28 14:39:14.933198","last_became_active":"2022-04-28 14:39:13.600508","last_became_peered":"2022-04-28 14:39:13.600508","last_unstale":"2022-04-28 14:39:14.933198","last_undegraded":"2022-04-28 14:39:14.933198","last_fullsized":"2022-04-28 14:39:14.933198","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.969866","last_change":"2022-04-28 14:39:13.968364","last_active":"2022-04-28 14:39:13.969866","last_peered":"2022-04-28 14:39:13.969866","last_clean":"2022-04-28 14:39:13.969866","last_became_active":"2022-04-28 14:39:13.968054","last_became_peered":"2022-04-28 14:39:13.968054","last_unstale":"2022-04-28 14:39:13.969866","last_undegraded":"2022-04-28 14:39:13.969866","last_fullsized":"2022-04-28 14:39:13.969866","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:15.552206","last_change":"2022-04-28 14:39:13.623080","last_active":"2022-04-28 14:39:15.552206","last_peered":"2022-04-28 14:39:15.552206","last_clean":"2022-04-28 14:39:15.552206","last_became_active":"2022-04-28 14:39:13.622568","last_became_peered":"2022-04-28 14:39:13.622568","last_unstale":"2022-04-28 14:39:15.552206","last_undegraded":"2022-04-28 14:39:15.552206","last_fullsized":"2022-04-28 14:39:15.552206","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.973674","last_change":"2022-04-28 14:39:13.972567","last_active":"2022-04-28 14:39:13.973674","last_peered":"2022-04-28 14:39:13.973674","last_clean":"2022-04-28 14:39:13.973674","last_became_active":"2022-04-28 14:39:13.972179","last_became_peered":"2022-04-28 14:39:13.972179","last_unstale":"2022-04-28 14:39:13.973674","last_undegraded":"2022-04-28 14:39:13.973674","last_fullsized":"2022-04-28 14:39:13.973674","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"16'2","reported_seq":"12","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:16.603003","last_change":"2022-04-28 14:39:13.622222","last_active":"2022-04-28 14:39:16.603003","last_peered":"2022-04-28 14:39:16.603003","last_clean":"2022-04-28 14:39:16.603003","last_became_active":"2022-04-28 14:39:13.621872","last_became_peered":"2022-04-28 14:39:13.621872","last_unstale":"2022-04-28 14:39:16.603003","last_undegraded":"2022-04-28 14:39:16.603003","last_fullsized":"2022-04-28 14:39:16.603003","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967571","last_change":"2022-04-28 14:39:13.958395","last_active":"2022-04-28 14:39:13.967571","last_peered":"2022-04-28 14:39:13.967571","last_clean":"2022-04-28 14:39:13.967571","last_became_active":"2022-04-28 14:39:13.957976","last_became_peered":"2022-04-28 14:39:13.957976","last_unstale":"2022-04-28 14:39:13.967571","last_undegraded":"2022-04-28 14:39:13.967571","last_fullsized":"2022-04-28 14:39:13.967571","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"16'2","reported_seq":"12","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:16.601346","last_change":"2022-04-28 14:39:13.622467","last_active":"2022-04-28 14:39:16.601346","last_peered":"2022-04-28 14:39:16.601346","last_clean":"2022-04-28 14:39:16.601346","last_became_active":"2022-04-28 14:39:13.621838","last_became_peered":"2022-04-28 14:39:13.621838","last_unstale":"2022-04-28 14:39:16.601346","last_undegraded":"2022-04-28 14:39:16.601346","last_fullsized":"2022-04-28 14:39:16.601346","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967649","last_change":"2022-04-28 14:39:13.958646","last_active":"2022-04-28 14:39:13.967649","last_peered":"2022-04-28 14:39:13.967649","last_clean":"2022-04-28 14:39:13.967649","last_became_active":"2022-04-28 14:39:13.957994","last_became_peered":"2022-04-28 14:39:13.957994","last_unstale":"2022-04-28 14:39:13.967649","last_undegraded":"2022-04-28 14:39:13.967649","last_fullsized":"2022-04-28 14:39:13.967649","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.942257","last_change":"2022-04-28 14:39:13.614008","last_active":"2022-04-28 14:39:13.942257","last_peered":"2022-04-28 14:39:13.942257","last_clean":"2022-04-28 14:39:13.942257","last_became_active":"2022-04-28 14:39:13.613702","last_became_peered":"2022-04-28 14:39:13.613702","last_unstale":"2022-04-28 14:39:13.942257","last_undegraded":"2022-04-28 14:39:13.942257","last_fullsized":"2022-04-28 14:39:13.942257","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.956962","last_change":"2022-04-28 14:39:13.950979","last_active":"2022-04-28 14:39:13.956962","last_peered":"2022-04-28 14:39:13.956962","last_clean":"2022-04-28 14:39:13.956962","last_became_active":"2022-04-28 14:39:13.950168","last_became_peered":"2022-04-28 14:39:13.950168","last_unstale":"2022-04-28 14:39:13.956962","last_undegraded":"2022-04-28 14:39:13.956962","last_fullsized":"2022-04-28 14:39:13.956962","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:14.935068","last_change":"2022-04-28 14:39:13.617031","last_active":"2022-04-28 14:39:14.935068","last_peered":"2022-04-28 14:39:14.935068","last_clean":"2022-04-28 14:39:14.935068","last_became_active":"2022-04-28 14:39:13.615420","last_became_peered":"2022-04-28 14:39:13.615420","last_unstale":"2022-04-28 14:39:14.935068","last_undegraded":"2022-04-28 14:39:14.935068","last_fullsized":"2022-04-28 14:39:14.935068","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.963546","last_change":"2022-04-28 14:39:13.954485","last_active":"2022-04-28 14:39:13.963546","last_peered":"2022-04-28 14:39:13.963546","last_clean":"2022-04-28 14:39:13.963546","last_became_active":"2022-04-28 14:39:13.954179","last_became_peered":"2022-04-28 14:39:13.954179","last_unstale":"2022-04-28 14:39:13.963546","last_undegraded":"2022-04-28 14:39:13.963546","last_fullsized":"2022-04-28 14:39:13.963546","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"16'3","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:16.605336","last_change":"2022-04-28 14:39:13.608868","last_active":"2022-04-28 14:39:16.605336","last_peered":"2022-04-28 14:39:16.605336","last_clean":"2022-04-28 14:39:16.605336","last_became_active":"2022-04-28 14:39:13.608590","last_became_peered":"2022-04-28 14:39:13.608590","last_unstale":"2022-04-28 14:39:16.605336","last_undegraded":"2022-04-28 14:39:16.605336","last_fullsized":"2022-04-28 14:39:16.605336","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.969788","last_change":"2022-04-28 14:39:13.966189","last_active":"2022-04-28 14:39:13.969788","last_peered":"2022-04-28 14:39:13.969788","last_clean":"2022-04-28 14:39:13.969788","last_became_active":"2022-04-28 14:39:13.965877","last_became_peered":"2022-04-28 14:39:13.965877","last_unstale":"2022-04-28 14:39:13.969788","last_undegraded":"2022-04-28 14:39:13.969788","last_fullsized":"2022-04-28 14:39:13.969788","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943233","last_change":"2022-04-28 14:39:13.601488","last_active":"2022-04-28 14:39:13.943233","last_peered":"2022-04-28 14:39:13.943233","last_clean":"2022-04-28 14:39:13.943233","last_became_active":"2022-04-28 14:39:13.601122","last_became_peered":"2022-04-28 14:39:13.601122","last_unstale":"2022-04-28 14:39:13.943233","last_undegraded":"2022-04-28 14:39:13.943233","last_fullsized":"2022-04-28 14:39:13.943233","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.956513","last_change":"2022-04-28 14:39:13.951897","last_active":"2022-04-28 14:39:13.956513","last_peered":"2022-04-28 14:39:13.956513","last_clean":"2022-04-28 14:39:13.956513","last_became_active":"2022-04-28 14:39:13.951314","last_became_peered":"2022-04-28 14:39:13.951314","last_unstale":"2022-04-28 14:39:13.956513","last_undegraded":"2022-04-28 14:39:13.956513","last_fullsized":"2022-04-28 14:39:13.956513","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.974243","last_change":"2022-04-28 14:39:13.615041","last_active":"2022-04-28 14:39:13.974243","last_peered":"2022-04-28 14:39:13.974243","last_clean":"2022-04-28 14:39:13.974243","last_became_active":"2022-04-28 14:39:13.614710","last_became_peered":"2022-04-28 14:39:13.614710","last_unstale":"2022-04-28 14:39:13.974243","last_undegraded":"2022-04-28 14:39:13.974243","last_fullsized":"2022-04-28 14:39:13.974243","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.975312","last_change":"2022-04-28 14:39:13.971986","last_active":"2022-04-28 14:39:13.975312","last_peered":"2022-04-28 14:39:13.975312","last_clean":"2022-04-28 14:39:13.975312","last_became_active":"2022-04-28 14:39:13.971243","last_became_peered":"2022-04-28 14:39:13.971243","last_unstale":"2022-04-28 14:39:13.975312","last_undegraded":"2022-04-28 14:39:13.975312","last_fullsized":"2022-04-28 14:39:13.975312","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.941578","last_change":"2022-04-28 14:39:13.613362","last_active":"2022-04-28 14:39:13.941578","last_peered":"2022-04-28 14:39:13.941578","last_clean":"2022-04-28 14:39:13.941578","last_became_active":"2022-04-28 14:39:13.612969","last_became_peered":"2022-04-28 14:39:13.612969","last_unstale":"2022-04-28 14:39:13.941578","last_undegraded":"2022-04-28 14:39:13.941578","last_fullsized":"2022-04-28 14:39:13.941578","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.973650","last_change":"2022-04-28 14:39:13.972552","last_active":"2022-04-28 14:39:13.973650","last_peered":"2022-04-28 14:39:13.973650","last_clean":"2022-04-28 14:39:13.973650","last_became_active":"2022-04-28 14:39:13.970887","last_became_peered":"2022-04-28 14:39:13.970887","last_unstale":"2022-04-28 14:39:13.973650","last_undegraded":"2022-04-28 14:39:13.973650","last_fullsized":"2022-04-28 14:39:13.973650","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.955661","last_change":"2022-04-28 14:39:13.628138","last_active":"2022-04-28 14:39:13.955661","last_peered":"2022-04-28 14:39:13.955661","last_clean":"2022-04-28 14:39:13.955661","last_became_active":"2022-04-28 14:39:13.627785","last_became_peered":"2022-04-28 14:39:13.627785","last_unstale":"2022-04-28 14:39:13.955661","last_undegraded":"2022-04-28 14:39:13.955661","last_fullsized":"2022-04-28 14:39:13.955661","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.962842","last_change":"2022-04-28 14:39:13.955799","last_active":"2022-04-28 14:39:13.962842","last_peered":"2022-04-28 14:39:13.962842","last_clean":"2022-04-28 14:39:13.962842","last_became_active":"2022-04-28 14:39:13.955495","last_became_peered":"2022-04-28 14:39:13.955495","last_unstale":"2022-04-28 14:39:13.962842","last_undegraded":"2022-04-28 14:39:13.962842","last_fullsized":"2022-04-28 14:39:13.962842","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"16'6","reported_seq":"16","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:16.602953","last_change":"2022-04-28 14:39:13.621432","last_active":"2022-04-28 14:39:16.602953","last_peered":"2022-04-28 14:39:16.602953","last_clean":"2022-04-28 14:39:16.602953","last_became_active":"2022-04-28 14:39:13.621080","last_became_peered":"2022-04-28 14:39:13.621080","last_unstale":"2022-04-28 14:39:16.602953","last_undegraded":"2022-04-28 14:39:16.602953","last_fullsized":"2022-04-28 14:39:16.602953","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.957517","last_change":"2022-04-28 14:39:13.956112","last_active":"2022-04-28 14:39:13.957517","last_peered":"2022-04-28 14:39:13.957517","last_clean":"2022-04-28 14:39:13.957517","last_became_active":"2022-04-28 14:39:13.955792","last_became_peered":"2022-04-28 14:39:13.955792","last_unstale":"2022-04-28 14:39:13.957517","last_undegraded":"2022-04-28 14:39:13.957517","last_fullsized":"2022-04-28 14:39:13.957517","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943395","last_change":"2022-04-28 14:39:13.622128","last_active":"2022-04-28 14:39:13.943395","last_peered":"2022-04-28 14:39:13.943395","last_clean":"2022-04-28 14:39:13.943395","last_became_active":"2022-04-28 14:39:13.621790","last_became_peered":"2022-04-28 14:39:13.621790","last_unstale":"2022-04-28 14:39:13.943395","last_undegraded":"2022-04-28 14:39:13.943395","last_fullsized":"2022-04-28 14:39:13.943395","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.969380","last_change":"2022-04-28 14:39:13.967323","last_active":"2022-04-28 14:39:13.969380","last_peered":"2022-04-28 14:39:13.969380","last_clean":"2022-04-28 14:39:13.969380","last_became_active":"2022-04-28 14:39:13.961173","last_became_peered":"2022-04-28 14:39:13.961173","last_unstale":"2022-04-28 14:39:13.969380","last_undegraded":"2022-04-28 14:39:13.969380","last_fullsized":"2022-04-28 14:39:13.969380","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.937877","last_change":"2022-04-28 14:39:13.609625","last_active":"2022-04-28 14:39:13.937877","last_peered":"2022-04-28 14:39:13.937877","last_clean":"2022-04-28 14:39:13.937877","last_became_active":"2022-04-28 14:39:13.609062","last_became_peered":"2022-04-28 14:39:13.609062","last_unstale":"2022-04-28 14:39:13.937877","last_undegraded":"2022-04-28 14:39:13.937877","last_fullsized":"2022-04-28 14:39:13.937877","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.966595","last_change":"2022-04-28 14:39:13.963123","last_active":"2022-04-28 14:39:13.966595","last_peered":"2022-04-28 14:39:13.966595","last_clean":"2022-04-28 14:39:13.966595","last_became_active":"2022-04-28 14:39:13.962825","last_became_peered":"2022-04-28 14:39:13.962825","last_unstale":"2022-04-28 14:39:13.966595","last_undegraded":"2022-04-28 14:39:13.966595","last_fullsized":"2022-04-28 14:39:13.966595","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.959564","last_change":"2022-04-28 14:39:13.603083","last_active":"2022-04-28 14:39:13.959564","last_peered":"2022-04-28 14:39:13.959564","last_clean":"2022-04-28 14:39:13.959564","last_became_active":"2022-04-28 14:39:13.602776","last_became_peered":"2022-04-28 14:39:13.602776","last_unstale":"2022-04-28 14:39:13.959564","last_undegraded":"2022-04-28 14:39:13.959564","last_fullsized":"2022-04-28 14:39:13.959564","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.974419","last_change":"2022-04-28 14:39:13.971833","last_active":"2022-04-28 14:39:13.974419","last_peered":"2022-04-28 14:39:13.974419","last_clean":"2022-04-28 14:39:13.974419","last_became_active":"2022-04-28 14:39:13.971513","last_became_peered":"2022-04-28 14:39:13.971513","last_unstale":"2022-04-28 14:39:13.974419","last_undegraded":"2022-04-28 14:39:13.974419","last_fullsized":"2022-04-28 14:39:13.974419","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"16'6","reported_seq":"16","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:16.602166","last_change":"2022-04-28 14:39:13.619098","last_active":"2022-04-28 14:39:16.602166","last_peered":"2022-04-28 14:39:16.602166","last_clean":"2022-04-28 14:39:16.602166","last_became_active":"2022-04-28 14:39:13.618737","last_became_peered":"2022-04-28 14:39:13.618737","last_unstale":"2022-04-28 14:39:16.602166","last_undegraded":"2022-04-28 14:39:16.602166","last_fullsized":"2022-04-28 14:39:16.602166","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.956440","last_change":"2022-04-28 14:39:13.951611","last_active":"2022-04-28 14:39:13.956440","last_peered":"2022-04-28 14:39:13.956440","last_clean":"2022-04-28 14:39:13.956440","last_became_active":"2022-04-28 14:39:13.951102","last_became_peered":"2022-04-28 14:39:13.951102","last_unstale":"2022-04-28 14:39:13.956440","last_undegraded":"2022-04-28 14:39:13.956440","last_fullsized":"2022-04-28 14:39:13.956440","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.941816","last_change":"2022-04-28 14:39:13.618476","last_active":"2022-04-28 14:39:13.941816","last_peered":"2022-04-28 14:39:13.941816","last_clean":"2022-04-28 14:39:13.941816","last_became_active":"2022-04-28 14:39:13.617950","last_became_peered":"2022-04-28 14:39:13.617950","last_unstale":"2022-04-28 14:39:13.941816","last_undegraded":"2022-04-28 14:39:13.941816","last_fullsized":"2022-04-28 14:39:13.941816","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.973798","last_change":"2022-04-28 14:39:13.969503","last_active":"2022-04-28 14:39:13.973798","last_peered":"2022-04-28 14:39:13.973798","last_clean":"2022-04-28 14:39:13.973798","last_became_active":"2022-04-28 14:39:13.969200","last_became_peered":"2022-04-28 14:39:13.969200","last_unstale":"2022-04-28 14:39:13.973798","last_undegraded":"2022-04-28 14:39:13.973798","last_fullsized":"2022-04-28 14:39:13.973798","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"16'2","reported_seq":"12","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:16.602031","last_change":"2022-04-28 14:39:13.613426","last_active":"2022-04-28 14:39:16.602031","last_peered":"2022-04-28 14:39:16.602031","last_clean":"2022-04-28 14:39:16.602031","last_became_active":"2022-04-28 14:39:13.613077","last_became_peered":"2022-04-28 14:39:13.613077","last_unstale":"2022-04-28 14:39:16.602031","last_undegraded":"2022-04-28 14:39:16.602031","last_fullsized":"2022-04-28 14:39:16.602031","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.962551","last_change":"2022-04-28 14:39:13.953772","last_active":"2022-04-28 14:39:13.962551","last_peered":"2022-04-28 14:39:13.962551","last_clean":"2022-04-28 14:39:13.962551","last_became_active":"2022-04-28 14:39:13.953478","last_became_peered":"2022-04-28 14:39:13.953478","last_unstale":"2022-04-28 14:39:13.962551","last_undegraded":"2022-04-28 14:39:13.962551","last_fullsized":"2022-04-28 14:39:13.962551","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.950662","last_change":"2022-04-28 14:39:13.606445","last_active":"2022-04-28 14:39:13.950662","last_peered":"2022-04-28 14:39:13.950662","last_clean":"2022-04-28 14:39:13.950662","last_became_active":"2022-04-28 14:39:13.606028","last_became_peered":"2022-04-28 14:39:13.606028","last_unstale":"2022-04-28 14:39:13.950662","last_undegraded":"2022-04-28 14:39:13.950662","last_fullsized":"2022-04-28 14:39:13.950662","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.956487","last_change":"2022-04-28 14:39:13.951780","last_active":"2022-04-28 14:39:13.956487","last_peered":"2022-04-28 14:39:13.956487","last_clean":"2022-04-28 14:39:13.956487","last_became_active":"2022-04-28 14:39:13.951236","last_became_peered":"2022-04-28 14:39:13.951236","last_unstale":"2022-04-28 14:39:13.956487","last_undegraded":"2022-04-28 14:39:13.956487","last_fullsized":"2022-04-28 14:39:13.956487","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:15.551243","last_change":"2022-04-28 14:39:13.621466","last_active":"2022-04-28 14:39:15.551243","last_peered":"2022-04-28 14:39:15.551243","last_clean":"2022-04-28 14:39:15.551243","last_became_active":"2022-04-28 14:39:13.621146","last_became_peered":"2022-04-28 14:39:13.621146","last_unstale":"2022-04-28 14:39:15.551243","last_undegraded":"2022-04-28 14:39:15.551243","last_fullsized":"2022-04-28 14:39:15.551243","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967697","last_change":"2022-04-28 14:39:13.960230","last_active":"2022-04-28 14:39:13.967697","last_peered":"2022-04-28 14:39:13.967697","last_clean":"2022-04-28 14:39:13.967697","last_became_active":"2022-04-28 14:39:13.958741","last_became_peered":"2022-04-28 14:39:13.958741","last_unstale":"2022-04-28 14:39:13.967697","last_undegraded":"2022-04-28 14:39:13.967697","last_fullsized":"2022-04-28 14:39:13.967697","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.937051","last_change":"2022-04-28 14:39:13.603448","last_active":"2022-04-28 14:39:13.937051","last_peered":"2022-04-28 14:39:13.937051","last_clean":"2022-04-28 14:39:13.937051","last_became_active":"2022-04-28 14:39:13.603117","last_became_peered":"2022-04-28 14:39:13.603117","last_unstale":"2022-04-28 14:39:13.937051","last_undegraded":"2022-04-28 14:39:13.937051","last_fullsized":"2022-04-28 14:39:13.937051","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.956983","last_change":"2022-04-28 14:39:13.951179","last_active":"2022-04-28 14:39:13.956983","last_peered":"2022-04-28 14:39:13.956983","last_clean":"2022-04-28 14:39:13.956983","last_became_active":"2022-04-28 14:39:13.950413","last_became_peered":"2022-04-28 14:39:13.950413","last_unstale":"2022-04-28 14:39:13.956983","last_undegraded":"2022-04-28 14:39:13.956983","last_fullsized":"2022-04-28 14:39:13.956983","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.972495","last_change":"2022-04-28 14:39:13.609803","last_active":"2022-04-28 14:39:13.972495","last_peered":"2022-04-28 14:39:13.972495","last_clean":"2022-04-28 14:39:13.972495","last_became_active":"2022-04-28 14:39:13.609320","last_became_peered":"2022-04-28 14:39:13.609320","last_unstale":"2022-04-28 14:39:13.972495","last_undegraded":"2022-04-28 14:39:13.972495","last_fullsized":"2022-04-28 14:39:13.972495","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.957157","last_change":"2022-04-28 14:39:13.953322","last_active":"2022-04-28 14:39:13.957157","last_peered":"2022-04-28 14:39:13.957157","last_clean":"2022-04-28 14:39:13.957157","last_became_active":"2022-04-28 14:39:13.952997","last_became_peered":"2022-04-28 14:39:13.952997","last_unstale":"2022-04-28 14:39:13.957157","last_undegraded":"2022-04-28 14:39:13.957157","last_fullsized":"2022-04-28 14:39:13.957157","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.964743","last_change":"2022-04-28 14:39:13.624451","last_active":"2022-04-28 14:39:13.964743","last_peered":"2022-04-28 14:39:13.964743","last_clean":"2022-04-28 14:39:13.964743","last_became_active":"2022-04-28 14:39:13.624118","last_became_peered":"2022-04-28 14:39:13.624118","last_unstale":"2022-04-28 14:39:13.964743","last_undegraded":"2022-04-28 14:39:13.964743","last_fullsized":"2022-04-28 14:39:13.964743","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.962340","last_change":"2022-04-28 14:39:13.956657","last_active":"2022-04-28 14:39:13.962340","last_peered":"2022-04-28 14:39:13.962340","last_clean":"2022-04-28 14:39:13.962340","last_became_active":"2022-04-28 14:39:13.956291","last_became_peered":"2022-04-28 14:39:13.956291","last_unstale":"2022-04-28 14:39:13.962340","last_undegraded":"2022-04-28 14:39:13.962340","last_fullsized":"2022-04-28 14:39:13.962340","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.964761","last_change":"2022-04-28 14:39:13.621131","last_active":"2022-04-28 14:39:13.964761","last_peered":"2022-04-28 14:39:13.964761","last_clean":"2022-04-28 14:39:13.964761","last_became_active":"2022-04-28 14:39:13.620764","last_became_peered":"2022-04-28 14:39:13.620764","last_unstale":"2022-04-28 14:39:13.964761","last_undegraded":"2022-04-28 14:39:13.964761","last_fullsized":"2022-04-28 14:39:13.964761","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.973522","last_change":"2022-04-28 14:39:13.971712","last_active":"2022-04-28 14:39:13.973522","last_peered":"2022-04-28 14:39:13.973522","last_clean":"2022-04-28 14:39:13.973522","last_became_active":"2022-04-28 14:39:13.970627","last_became_peered":"2022-04-28 14:39:13.970627","last_unstale":"2022-04-28 14:39:13.973522","last_undegraded":"2022-04-28 14:39:13.973522","last_fullsized":"2022-04-28 14:39:13.973522","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.941716","last_change":"2022-04-28 14:39:13.618500","last_active":"2022-04-28 14:39:13.941716","last_peered":"2022-04-28 14:39:13.941716","last_clean":"2022-04-28 14:39:13.941716","last_became_active":"2022-04-28 14:39:13.618171","last_became_peered":"2022-04-28 14:39:13.618171","last_unstale":"2022-04-28 14:39:13.941716","last_undegraded":"2022-04-28 14:39:13.941716","last_fullsized":"2022-04-28 14:39:13.941716","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967485","last_change":"2022-04-28 14:39:13.966833","last_active":"2022-04-28 14:39:13.967485","last_peered":"2022-04-28 14:39:13.967485","last_clean":"2022-04-28 14:39:13.967485","last_became_active":"2022-04-28 14:39:13.963563","last_became_peered":"2022-04-28 14:39:13.963563","last_unstale":"2022-04-28 14:39:13.967485","last_undegraded":"2022-04-28 14:39:13.967485","last_fullsized":"2022-04-28 14:39:13.967485","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.950038","last_change":"2022-04-28 14:39:13.622884","last_active":"2022-04-28 14:39:13.950038","last_peered":"2022-04-28 14:39:13.950038","last_clean":"2022-04-28 14:39:13.950038","last_became_active":"2022-04-28 14:39:13.617005","last_became_peered":"2022-04-28 14:39:13.617005","last_unstale":"2022-04-28 14:39:13.950038","last_undegraded":"2022-04-28 14:39:13.950038","last_fullsized":"2022-04-28 14:39:13.950038","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.959924","last_change":"2022-04-28 14:39:13.951972","last_active":"2022-04-28 14:39:13.959924","last_peered":"2022-04-28 14:39:13.959924","last_clean":"2022-04-28 14:39:13.959924","last_became_active":"2022-04-28 14:39:13.951647","last_became_peered":"2022-04-28 14:39:13.951647","last_unstale":"2022-04-28 14:39:13.959924","last_undegraded":"2022-04-28 14:39:13.959924","last_fullsized":"2022-04-28 14:39:13.959924","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.963369","last_change":"2022-04-28 14:39:13.619298","last_active":"2022-04-28 14:39:13.963369","last_peered":"2022-04-28 14:39:13.963369","last_clean":"2022-04-28 14:39:13.963369","last_became_active":"2022-04-28 14:39:13.618948","last_became_peered":"2022-04-28 14:39:13.618948","last_unstale":"2022-04-28 14:39:13.963369","last_undegraded":"2022-04-28 14:39:13.963369","last_fullsized":"2022-04-28 14:39:13.963369","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":3606,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":42919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.221}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048740,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323100,"statfs":{"total":96636764160,"available":95562854400,"internally_reserved":1073741824,"allocated":159744,"data_stored":40897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048752,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323088,"statfs":{"total":96636764160,"available":95562842112,"internally_reserved":1073741824,"allocated":172032,"data_stored":42259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.216}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048744,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323096,"statfs":{"total":96636764160,"available":95562850304,"internally_reserved":1073741824,"allocated":163840,"data_stored":41461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]}]}]}} 2022-04-28T14:39:23.103 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-04-28T14:39:23.248 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.241 7f909f5cc700 1 Processor -- start 2022-04-28T14:39:23.248 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.241 7f909f5cc700 1 -- start start 2022-04-28T14:39:23.248 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.242 7f909f5cc700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f90980f6250 0x7f90980f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:23.248 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.242 7f909f5cc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f90981b2500 0x7f90981b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:23.249 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.242 7f909f5cc700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f90981b2f80 0x7f90980f1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:23.249 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.242 7f909f5cc700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9098111c50 con 0x7f90981b2500 2022-04-28T14:39:23.249 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.242 7f909f5cc700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90981115e0 con 0x7f90981b2f80 2022-04-28T14:39:23.249 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.242 7f909f5cc700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f909810d500 con 0x7f90980f6250 2022-04-28T14:39:23.249 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.242 7f9097fff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f90980f6250 0x7f90980f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:23.249 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.242 7f909cbcc700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f90981b2f80 0x7f90980f1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:23.249 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.242 7f90977fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f90981b2500 0x7f90981b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:23.249 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.242 7f909cbcc700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f90981b2f80 0x7f90980f1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46600/0 (socket says 172.21.15.22:46600) 2022-04-28T14:39:23.249 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.242 7f9097fff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f90980f6250 0x7f90980f66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46380/0 (socket says 172.21.15.22:46380) 2022-04-28T14:39:23.250 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.242 7f909cbcc700 1 -- 172.21.15.22:0/4066321622 learned_addr learned my addr 172.21.15.22:0/4066321622 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:23.250 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.242 7f9097fff700 1 -- 172.21.15.22:0/4066321622 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f90981b2f80 msgr2=0x7f90980f1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:23.250 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.242 7f9097fff700 1 --2- 172.21.15.22:0/4066321622 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f90981b2f80 0x7f90980f1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.250 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.242 7f9097fff700 1 -- 172.21.15.22:0/4066321622 >> v2:172.21.15.22:3300/0 conn(0x7f90981b2500 msgr2=0x7f90981b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:23.250 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.242 7f9097fff700 1 --2- 172.21.15.22:0/4066321622 >> v2:172.21.15.22:3300/0 conn(0x7f90981b2500 0x7f90981b2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.250 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.242 7f9097fff700 1 -- 172.21.15.22:0/4066321622 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909810cbc0 con 0x7f90980f6250 2022-04-28T14:39:23.250 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.242 7f909cbcc700 1 --2- 172.21.15.22:0/4066321622 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f90981b2f80 0x7f90980f1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:23.250 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.242 7f9097fff700 1 --2- 172.21.15.22:0/4066321622 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f90980f6250 0x7f90980f66a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f908c002f70 tx=0x7f908c00dd30).ready entity=mon.2 client_cookie=9250e2912f54128a server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:23.250 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.242 7f9096ffd700 1 -- 172.21.15.22:0/4066321622 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f909810cbc0 con 0x7f90980f6250 2022-04-28T14:39:23.251 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.242 7f9096ffd700 1 -- 172.21.15.22:0/4066321622 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908c00f7d0 con 0x7f90980f6250 2022-04-28T14:39:23.251 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.242 7f9096ffd700 1 -- 172.21.15.22:0/4066321622 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f908c013070 con 0x7f90980f6250 2022-04-28T14:39:23.251 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.242 7f909f5cc700 1 -- 172.21.15.22:0/4066321622 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f90980f6250 msgr2=0x7f90980f66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:23.251 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.242 7f909f5cc700 1 --2- 172.21.15.22:0/4066321622 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f90980f6250 0x7f90980f66a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f908c002f70 tx=0x7f908c00dd30).stop 2022-04-28T14:39:23.251 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.243 7f909f5cc700 1 -- 172.21.15.22:0/4066321622 shutdown_connections 2022-04-28T14:39:23.251 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.243 7f909f5cc700 1 --2- 172.21.15.22:0/4066321622 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f90981b2f80 0x7f90980f1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.251 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.243 7f909f5cc700 1 --2- 172.21.15.22:0/4066321622 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f90980f6250 0x7f90980f66a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.251 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.243 7f909f5cc700 1 --2- 172.21.15.22:0/4066321622 >> v2:172.21.15.22:3300/0 conn(0x7f90981b2500 0x7f90981b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.251 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.243 7f909f5cc700 1 -- 172.21.15.22:0/4066321622 >> 172.21.15.22:0/4066321622 conn(0x7f9098117120 msgr2=0x7f90980f2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:23.251 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.243 7f909f5cc700 1 -- 172.21.15.22:0/4066321622 shutdown_connections 2022-04-28T14:39:23.252 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.243 7f909f5cc700 1 -- 172.21.15.22:0/4066321622 wait complete. 2022-04-28T14:39:23.274 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.267 7f909f5cc700 1 Processor -- start 2022-04-28T14:39:23.274 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.267 7f909f5cc700 1 -- start start 2022-04-28T14:39:23.274 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.268 7f909f5cc700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f90980b8c00 0x7f90980cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:23.274 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.268 7f909f5cc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90980ccf10 0x7f90981c0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:23.274 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.268 7f909f5cc700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f90980b9050 0x7f90981c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:23.274 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.268 7f909f5cc700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90980f6ad0 con 0x7f90980ccf10 2022-04-28T14:39:23.274 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.268 7f909f5cc700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90980cb220 con 0x7f90980b9050 2022-04-28T14:39:23.274 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.268 7f909f5cc700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90980dec80 con 0x7f90980b8c00 2022-04-28T14:39:23.275 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.268 7f9097fff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f90980b8c00 0x7f90980cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:23.275 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.268 7f909cbcc700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f90980b9050 0x7f90981c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:23.275 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.268 7f90977fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90980ccf10 0x7f90981c0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:23.275 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.268 7f9097fff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f90980b8c00 0x7f90980cc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46386/0 (socket says 172.21.15.22:46386) 2022-04-28T14:39:23.275 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.268 7f9097fff700 1 -- 172.21.15.22:0/2733051438 learned_addr learned my addr 172.21.15.22:0/2733051438 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:23.275 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.268 7f909cbcc700 1 -- 172.21.15.22:0/2733051438 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f90980b8c00 msgr2=0x7f90980cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:23.275 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.268 7f909cbcc700 1 --2- 172.21.15.22:0/2733051438 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f90980b8c00 0x7f90980cc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.275 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.268 7f909cbcc700 1 -- 172.21.15.22:0/2733051438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90980ccf10 msgr2=0x7f90981c0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:23.275 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.268 7f909cbcc700 1 --2- 172.21.15.22:0/2733051438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90980ccf10 0x7f90981c0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.276 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.268 7f909cbcc700 1 -- 172.21.15.22:0/2733051438 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90980de4b0 con 0x7f90980b9050 2022-04-28T14:39:23.276 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.268 7f90977fe700 1 --2- 172.21.15.22:0/2733051438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90980ccf10 0x7f90981c0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:23.276 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.268 7f909cbcc700 1 --2- 172.21.15.22:0/2733051438 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f90980b9050 0x7f90981c15d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f90980cb5b0 tx=0x7f909000edb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:23.276 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.268 7f90957fa700 1 -- 172.21.15.22:0/2733051438 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f90980de4b0 con 0x7f90980b9050 2022-04-28T14:39:23.276 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.268 7f90957fa700 1 -- 172.21.15.22:0/2733051438 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909000c7b0 con 0x7f90980b9050 2022-04-28T14:39:23.276 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.268 7f90957fa700 1 -- 172.21.15.22:0/2733051438 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f909000f040 con 0x7f90980b9050 2022-04-28T14:39:23.276 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.268 7f909f5cc700 1 -- 172.21.15.22:0/2733051438 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90981c1c00 con 0x7f90980b9050 2022-04-28T14:39:23.276 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.269 7f909f5cc700 1 -- 172.21.15.22:0/2733051438 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90981c8480 con 0x7f90980b9050 2022-04-28T14:39:23.276 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.269 7f90957fa700 1 -- 172.21.15.22:0/2733051438 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f9090011070 con 0x7f90980b9050 2022-04-28T14:39:23.276 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.269 7f90957fa700 1 -- 172.21.15.22:0/2733051438 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f9090010040 con 0x7f90980b9050 2022-04-28T14:39:23.277 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.269 7f909f5cc700 1 -- 172.21.15.22:0/2733051438 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90980f02c0 con 0x7f90980b9050 2022-04-28T14:39:23.277 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.272 7f90957fa700 1 -- 172.21.15.22:0/2733051438 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f909000c5a0 con 0x7f90980b9050 2022-04-28T14:39:23.371 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.366 7f909f5cc700 1 -- 172.21.15.22:0/2733051438 --> v1:172.21.15.22:6808/86956 -- command(tid 0: {"prefix": "pg dump", "target": ["mgr", ""], "format": "json"}) v1 -- 0x7f909811dec0 con 0x7f907801c1b0 2022-04-28T14:39:23.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.374 7f90957fa700 1 -- 172.21.15.22:0/2733051438 <== mgr.4104 v1:172.21.15.22:6808/86956 1 ==== command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306065 (unknown 2965378022 0 2196085566) 0x7f909811dec0 con 0x7f907801c1b0 2022-04-28T14:39:23.382 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:23.385 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.376 7f909f5cc700 1 -- 172.21.15.22:0/2733051438 >> v1:172.21.15.22:6808/86956 conn(0x7f907801c1b0 legacy=0x7f907801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:23.385 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.376 7f909f5cc700 1 -- 172.21.15.22:0/2733051438 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f90980b9050 msgr2=0x7f90981c15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:23.385 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.376 7f909f5cc700 1 --2- 172.21.15.22:0/2733051438 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f90980b9050 0x7f90981c15d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f90980cb5b0 tx=0x7f909000edb0).stop 2022-04-28T14:39:23.385 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.376 7f909f5cc700 1 -- 172.21.15.22:0/2733051438 shutdown_connections 2022-04-28T14:39:23.385 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.376 7f909f5cc700 1 --2- 172.21.15.22:0/2733051438 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f90980b9050 0x7f90981c15d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.385 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.376 7f909f5cc700 1 --2- 172.21.15.22:0/2733051438 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f90980b8c00 0x7f90980cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.385 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.376 7f909f5cc700 1 --2- 172.21.15.22:0/2733051438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90980ccf10 0x7f90981c0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.386 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.376 7f909f5cc700 1 -- 172.21.15.22:0/2733051438 >> 172.21.15.22:0/2733051438 conn(0x7f90980e0810 msgr2=0x7f90980ab3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:23.386 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.377 7f909f5cc700 1 -- 172.21.15.22:0/2733051438 shutdown_connections 2022-04-28T14:39:23.386 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.377 7f909f5cc700 1 -- 172.21.15.22:0/2733051438 wait complete. 2022-04-28T14:39:23.386 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2022-04-28T14:39:23.392 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2022-04-28 14:39:22.263563","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3606,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":272,"acting":272,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":272,"num_osds":4,"num_per_pool_osds":4,"kb":377487360,"kb_used":4194992,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292368,"statfs":{"total":386547056640,"available":382251384832,"internally_reserved":4294967296,"allocated":671744,"data_stored":167536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1320,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000965"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.952742","last_change":"2022-04-28 14:39:13.943418","last_active":"2022-04-28 14:39:13.952742","last_peered":"2022-04-28 14:39:13.952742","last_clean":"2022-04-28 14:39:13.952742","last_became_active":"2022-04-28 14:39:13.943111","last_became_peered":"2022-04-28 14:39:13.943111","last_unstale":"2022-04-28 14:39:13.952742","last_undegraded":"2022-04-28 14:39:13.952742","last_fullsized":"2022-04-28 14:39:13.952742","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"16'4","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:16.607461","last_change":"2022-04-28 14:39:13.619263","last_active":"2022-04-28 14:39:16.607461","last_peered":"2022-04-28 14:39:16.607461","last_clean":"2022-04-28 14:39:16.607461","last_became_active":"2022-04-28 14:39:13.618911","last_became_peered":"2022-04-28 14:39:13.618911","last_unstale":"2022-04-28 14:39:16.607461","last_undegraded":"2022-04-28 14:39:16.607461","last_fullsized":"2022-04-28 14:39:16.607461","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967103","last_change":"2022-04-28 14:39:13.964730","last_active":"2022-04-28 14:39:13.967103","last_peered":"2022-04-28 14:39:13.967103","last_clean":"2022-04-28 14:39:13.967103","last_became_active":"2022-04-28 14:39:13.964405","last_became_peered":"2022-04-28 14:39:13.964405","last_unstale":"2022-04-28 14:39:13.967103","last_undegraded":"2022-04-28 14:39:13.967103","last_fullsized":"2022-04-28 14:39:13.967103","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.939780","last_change":"2022-04-28 14:39:13.611678","last_active":"2022-04-28 14:39:13.939780","last_peered":"2022-04-28 14:39:13.939780","last_clean":"2022-04-28 14:39:13.939780","last_became_active":"2022-04-28 14:39:13.611166","last_became_peered":"2022-04-28 14:39:13.611166","last_unstale":"2022-04-28 14:39:13.939780","last_undegraded":"2022-04-28 14:39:13.939780","last_fullsized":"2022-04-28 14:39:13.939780","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967673","last_change":"2022-04-28 14:39:13.960149","last_active":"2022-04-28 14:39:13.967673","last_peered":"2022-04-28 14:39:13.967673","last_clean":"2022-04-28 14:39:13.967673","last_became_active":"2022-04-28 14:39:13.959509","last_became_peered":"2022-04-28 14:39:13.959509","last_unstale":"2022-04-28 14:39:13.967673","last_undegraded":"2022-04-28 14:39:13.967673","last_fullsized":"2022-04-28 14:39:13.967673","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.937531","last_change":"2022-04-28 14:39:13.610970","last_active":"2022-04-28 14:39:13.937531","last_peered":"2022-04-28 14:39:13.937531","last_clean":"2022-04-28 14:39:13.937531","last_became_active":"2022-04-28 14:39:13.610661","last_became_peered":"2022-04-28 14:39:13.610661","last_unstale":"2022-04-28 14:39:13.937531","last_undegraded":"2022-04-28 14:39:13.937531","last_fullsized":"2022-04-28 14:39:13.937531","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.964032","last_change":"2022-04-28 14:39:13.963240","last_active":"2022-04-28 14:39:13.964032","last_peered":"2022-04-28 14:39:13.964032","last_clean":"2022-04-28 14:39:13.964032","last_became_active":"2022-04-28 14:39:13.961860","last_became_peered":"2022-04-28 14:39:13.961860","last_unstale":"2022-04-28 14:39:13.964032","last_undegraded":"2022-04-28 14:39:13.964032","last_fullsized":"2022-04-28 14:39:13.964032","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.936595","last_change":"2022-04-28 14:39:13.607628","last_active":"2022-04-28 14:39:13.936595","last_peered":"2022-04-28 14:39:13.936595","last_clean":"2022-04-28 14:39:13.936595","last_became_active":"2022-04-28 14:39:13.607234","last_became_peered":"2022-04-28 14:39:13.607234","last_unstale":"2022-04-28 14:39:13.936595","last_undegraded":"2022-04-28 14:39:13.936595","last_fullsized":"2022-04-28 14:39:13.936595","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.974109","last_change":"2022-04-28 14:39:13.972780","last_active":"2022-04-28 14:39:13.974109","last_peered":"2022-04-28 14:39:13.974109","last_clean":"2022-04-28 14:39:13.974109","last_became_active":"2022-04-28 14:39:13.972189","last_became_peered":"2022-04-28 14:39:13.972189","last_unstale":"2022-04-28 14:39:13.974109","last_undegraded":"2022-04-28 14:39:13.974109","last_fullsized":"2022-04-28 14:39:13.974109","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"16'3","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:16.602876","last_change":"2022-04-28 14:39:13.615060","last_active":"2022-04-28 14:39:16.602876","last_peered":"2022-04-28 14:39:16.602876","last_clean":"2022-04-28 14:39:16.602876","last_became_active":"2022-04-28 14:39:13.614686","last_became_peered":"2022-04-28 14:39:13.614686","last_unstale":"2022-04-28 14:39:16.602876","last_undegraded":"2022-04-28 14:39:16.602876","last_fullsized":"2022-04-28 14:39:16.602876","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967350","last_change":"2022-04-28 14:39:13.963855","last_active":"2022-04-28 14:39:13.967350","last_peered":"2022-04-28 14:39:13.967350","last_clean":"2022-04-28 14:39:13.967350","last_became_active":"2022-04-28 14:39:13.963518","last_became_peered":"2022-04-28 14:39:13.963518","last_unstale":"2022-04-28 14:39:13.967350","last_undegraded":"2022-04-28 14:39:13.967350","last_fullsized":"2022-04-28 14:39:13.967350","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.949698","last_change":"2022-04-28 14:39:13.623926","last_active":"2022-04-28 14:39:13.949698","last_peered":"2022-04-28 14:39:13.949698","last_clean":"2022-04-28 14:39:13.949698","last_became_active":"2022-04-28 14:39:13.623608","last_became_peered":"2022-04-28 14:39:13.623608","last_unstale":"2022-04-28 14:39:13.949698","last_undegraded":"2022-04-28 14:39:13.949698","last_fullsized":"2022-04-28 14:39:13.949698","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.969853","last_change":"2022-04-28 14:39:13.968270","last_active":"2022-04-28 14:39:13.969853","last_peered":"2022-04-28 14:39:13.969853","last_clean":"2022-04-28 14:39:13.969853","last_became_active":"2022-04-28 14:39:13.967894","last_became_peered":"2022-04-28 14:39:13.967894","last_unstale":"2022-04-28 14:39:13.969853","last_undegraded":"2022-04-28 14:39:13.969853","last_fullsized":"2022-04-28 14:39:13.969853","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"16'4","reported_seq":"14","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:14.934685","last_change":"2022-04-28 14:39:13.613942","last_active":"2022-04-28 14:39:14.934685","last_peered":"2022-04-28 14:39:14.934685","last_clean":"2022-04-28 14:39:14.934685","last_became_active":"2022-04-28 14:39:13.613151","last_became_peered":"2022-04-28 14:39:13.613151","last_unstale":"2022-04-28 14:39:14.934685","last_undegraded":"2022-04-28 14:39:14.934685","last_fullsized":"2022-04-28 14:39:14.934685","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.974442","last_change":"2022-04-28 14:39:13.972010","last_active":"2022-04-28 14:39:13.974442","last_peered":"2022-04-28 14:39:13.974442","last_clean":"2022-04-28 14:39:13.974442","last_became_active":"2022-04-28 14:39:13.971680","last_became_peered":"2022-04-28 14:39:13.971680","last_unstale":"2022-04-28 14:39:13.974442","last_undegraded":"2022-04-28 14:39:13.974442","last_fullsized":"2022-04-28 14:39:13.974442","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.970613","last_change":"2022-04-28 14:39:13.608578","last_active":"2022-04-28 14:39:13.970613","last_peered":"2022-04-28 14:39:13.970613","last_clean":"2022-04-28 14:39:13.970613","last_became_active":"2022-04-28 14:39:13.608208","last_became_peered":"2022-04-28 14:39:13.608208","last_unstale":"2022-04-28 14:39:13.970613","last_undegraded":"2022-04-28 14:39:13.970613","last_fullsized":"2022-04-28 14:39:13.970613","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.964577","last_change":"2022-04-28 14:39:13.959741","last_active":"2022-04-28 14:39:13.964577","last_peered":"2022-04-28 14:39:13.964577","last_clean":"2022-04-28 14:39:13.964577","last_became_active":"2022-04-28 14:39:13.959445","last_became_peered":"2022-04-28 14:39:13.959445","last_unstale":"2022-04-28 14:39:13.964577","last_undegraded":"2022-04-28 14:39:13.964577","last_fullsized":"2022-04-28 14:39:13.964577","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'3","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:16.604048","last_change":"2022-04-28 14:39:13.615947","last_active":"2022-04-28 14:39:16.604048","last_peered":"2022-04-28 14:39:16.604048","last_clean":"2022-04-28 14:39:16.604048","last_became_active":"2022-04-28 14:39:13.615589","last_became_peered":"2022-04-28 14:39:13.615589","last_unstale":"2022-04-28 14:39:16.604048","last_undegraded":"2022-04-28 14:39:16.604048","last_fullsized":"2022-04-28 14:39:16.604048","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.969361","last_change":"2022-04-28 14:39:13.966950","last_active":"2022-04-28 14:39:13.969361","last_peered":"2022-04-28 14:39:13.969361","last_clean":"2022-04-28 14:39:13.969361","last_became_active":"2022-04-28 14:39:13.961621","last_became_peered":"2022-04-28 14:39:13.961621","last_unstale":"2022-04-28 14:39:13.969361","last_undegraded":"2022-04-28 14:39:13.969361","last_fullsized":"2022-04-28 14:39:13.969361","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"16'3","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:16.605478","last_change":"2022-04-28 14:39:13.614233","last_active":"2022-04-28 14:39:16.605478","last_peered":"2022-04-28 14:39:16.605478","last_clean":"2022-04-28 14:39:16.605478","last_became_active":"2022-04-28 14:39:13.613890","last_became_peered":"2022-04-28 14:39:13.613890","last_unstale":"2022-04-28 14:39:16.605478","last_undegraded":"2022-04-28 14:39:16.605478","last_fullsized":"2022-04-28 14:39:16.605478","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.963364","last_change":"2022-04-28 14:39:13.953204","last_active":"2022-04-28 14:39:13.963364","last_peered":"2022-04-28 14:39:13.963364","last_clean":"2022-04-28 14:39:13.963364","last_became_active":"2022-04-28 14:39:13.952884","last_became_peered":"2022-04-28 14:39:13.952884","last_unstale":"2022-04-28 14:39:13.963364","last_undegraded":"2022-04-28 14:39:13.963364","last_fullsized":"2022-04-28 14:39:13.963364","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943168","last_change":"2022-04-28 14:39:13.616607","last_active":"2022-04-28 14:39:13.943168","last_peered":"2022-04-28 14:39:13.943168","last_clean":"2022-04-28 14:39:13.943168","last_became_active":"2022-04-28 14:39:13.616264","last_became_peered":"2022-04-28 14:39:13.616264","last_unstale":"2022-04-28 14:39:13.943168","last_undegraded":"2022-04-28 14:39:13.943168","last_fullsized":"2022-04-28 14:39:13.943168","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967596","last_change":"2022-04-28 14:39:13.958559","last_active":"2022-04-28 14:39:13.967596","last_peered":"2022-04-28 14:39:13.967596","last_clean":"2022-04-28 14:39:13.967596","last_became_active":"2022-04-28 14:39:13.958048","last_became_peered":"2022-04-28 14:39:13.958048","last_unstale":"2022-04-28 14:39:13.967596","last_undegraded":"2022-04-28 14:39:13.967596","last_fullsized":"2022-04-28 14:39:13.967596","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":"14","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.963748","last_change":"2022-04-28 14:39:13.599319","last_active":"2022-04-28 14:39:13.963748","last_peered":"2022-04-28 14:39:13.963748","last_clean":"2022-04-28 14:39:13.963748","last_became_active":"2022-04-28 14:39:13.598926","last_became_peered":"2022-04-28 14:39:13.598926","last_unstale":"2022-04-28 14:39:13.963748","last_undegraded":"2022-04-28 14:39:13.963748","last_fullsized":"2022-04-28 14:39:13.963748","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.957215","last_change":"2022-04-28 14:39:13.953566","last_active":"2022-04-28 14:39:13.957215","last_peered":"2022-04-28 14:39:13.957215","last_clean":"2022-04-28 14:39:13.957215","last_became_active":"2022-04-28 14:39:13.953248","last_became_peered":"2022-04-28 14:39:13.953248","last_unstale":"2022-04-28 14:39:13.957215","last_undegraded":"2022-04-28 14:39:13.957215","last_fullsized":"2022-04-28 14:39:13.957215","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967268","last_change":"2022-04-28 14:39:13.621471","last_active":"2022-04-28 14:39:13.967268","last_peered":"2022-04-28 14:39:13.967268","last_clean":"2022-04-28 14:39:13.967268","last_became_active":"2022-04-28 14:39:13.621155","last_became_peered":"2022-04-28 14:39:13.621155","last_unstale":"2022-04-28 14:39:13.967268","last_undegraded":"2022-04-28 14:39:13.967268","last_fullsized":"2022-04-28 14:39:13.967268","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967331","last_change":"2022-04-28 14:39:13.961895","last_active":"2022-04-28 14:39:13.967331","last_peered":"2022-04-28 14:39:13.967331","last_clean":"2022-04-28 14:39:13.967331","last_became_active":"2022-04-28 14:39:13.961160","last_became_peered":"2022-04-28 14:39:13.961160","last_unstale":"2022-04-28 14:39:13.967331","last_undegraded":"2022-04-28 14:39:13.967331","last_fullsized":"2022-04-28 14:39:13.967331","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.972847","last_change":"2022-04-28 14:39:13.608696","last_active":"2022-04-28 14:39:13.972847","last_peered":"2022-04-28 14:39:13.972847","last_clean":"2022-04-28 14:39:13.972847","last_became_active":"2022-04-28 14:39:13.608335","last_became_peered":"2022-04-28 14:39:13.608335","last_unstale":"2022-04-28 14:39:13.972847","last_undegraded":"2022-04-28 14:39:13.972847","last_fullsized":"2022-04-28 14:39:13.972847","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.964505","last_change":"2022-04-28 14:39:13.959179","last_active":"2022-04-28 14:39:13.964505","last_peered":"2022-04-28 14:39:13.964505","last_clean":"2022-04-28 14:39:13.964505","last_became_active":"2022-04-28 14:39:13.958838","last_became_peered":"2022-04-28 14:39:13.958838","last_unstale":"2022-04-28 14:39:13.964505","last_undegraded":"2022-04-28 14:39:13.964505","last_fullsized":"2022-04-28 14:39:13.964505","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.940753","last_change":"2022-04-28 14:39:13.618291","last_active":"2022-04-28 14:39:13.940753","last_peered":"2022-04-28 14:39:13.940753","last_clean":"2022-04-28 14:39:13.940753","last_became_active":"2022-04-28 14:39:13.617912","last_became_peered":"2022-04-28 14:39:13.617912","last_unstale":"2022-04-28 14:39:13.940753","last_undegraded":"2022-04-28 14:39:13.940753","last_fullsized":"2022-04-28 14:39:13.940753","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.969809","last_change":"2022-04-28 14:39:13.966352","last_active":"2022-04-28 14:39:13.969809","last_peered":"2022-04-28 14:39:13.969809","last_clean":"2022-04-28 14:39:13.969809","last_became_active":"2022-04-28 14:39:13.966039","last_became_peered":"2022-04-28 14:39:13.966039","last_unstale":"2022-04-28 14:39:13.969809","last_undegraded":"2022-04-28 14:39:13.969809","last_fullsized":"2022-04-28 14:39:13.969809","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943346","last_change":"2022-04-28 14:39:13.601416","last_active":"2022-04-28 14:39:13.943346","last_peered":"2022-04-28 14:39:13.943346","last_clean":"2022-04-28 14:39:13.943346","last_became_active":"2022-04-28 14:39:13.601028","last_became_peered":"2022-04-28 14:39:13.601028","last_unstale":"2022-04-28 14:39:13.943346","last_undegraded":"2022-04-28 14:39:13.943346","last_fullsized":"2022-04-28 14:39:13.943346","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.970241","last_change":"2022-04-28 14:39:13.958313","last_active":"2022-04-28 14:39:13.970241","last_peered":"2022-04-28 14:39:13.970241","last_clean":"2022-04-28 14:39:13.970241","last_became_active":"2022-04-28 14:39:13.956853","last_became_peered":"2022-04-28 14:39:13.956853","last_unstale":"2022-04-28 14:39:13.970241","last_undegraded":"2022-04-28 14:39:13.970241","last_fullsized":"2022-04-28 14:39:13.970241","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.960773","last_change":"2022-04-28 14:39:13.613340","last_active":"2022-04-28 14:39:13.960773","last_peered":"2022-04-28 14:39:13.960773","last_clean":"2022-04-28 14:39:13.960773","last_became_active":"2022-04-28 14:39:13.612902","last_became_peered":"2022-04-28 14:39:13.612902","last_unstale":"2022-04-28 14:39:13.960773","last_undegraded":"2022-04-28 14:39:13.960773","last_fullsized":"2022-04-28 14:39:13.960773","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.969340","last_change":"2022-04-28 14:39:13.966772","last_active":"2022-04-28 14:39:13.969340","last_peered":"2022-04-28 14:39:13.969340","last_clean":"2022-04-28 14:39:13.969340","last_became_active":"2022-04-28 14:39:13.961393","last_became_peered":"2022-04-28 14:39:13.961393","last_unstale":"2022-04-28 14:39:13.969340","last_undegraded":"2022-04-28 14:39:13.969340","last_fullsized":"2022-04-28 14:39:13.969340","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.942112","last_change":"2022-04-28 14:39:13.619825","last_active":"2022-04-28 14:39:13.942112","last_peered":"2022-04-28 14:39:13.942112","last_clean":"2022-04-28 14:39:13.942112","last_became_active":"2022-04-28 14:39:13.619514","last_became_peered":"2022-04-28 14:39:13.619514","last_unstale":"2022-04-28 14:39:13.942112","last_undegraded":"2022-04-28 14:39:13.942112","last_fullsized":"2022-04-28 14:39:13.942112","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.957541","last_change":"2022-04-28 14:39:13.956243","last_active":"2022-04-28 14:39:13.957541","last_peered":"2022-04-28 14:39:13.957541","last_clean":"2022-04-28 14:39:13.957541","last_became_active":"2022-04-28 14:39:13.955924","last_became_peered":"2022-04-28 14:39:13.955924","last_unstale":"2022-04-28 14:39:13.957541","last_undegraded":"2022-04-28 14:39:13.957541","last_fullsized":"2022-04-28 14:39:13.957541","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"16'3","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:16.603217","last_change":"2022-04-28 14:39:13.607250","last_active":"2022-04-28 14:39:16.603217","last_peered":"2022-04-28 14:39:16.603217","last_clean":"2022-04-28 14:39:16.603217","last_became_active":"2022-04-28 14:39:13.606892","last_became_peered":"2022-04-28 14:39:13.606892","last_unstale":"2022-04-28 14:39:16.603217","last_undegraded":"2022-04-28 14:39:16.603217","last_fullsized":"2022-04-28 14:39:16.603217","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967619","last_change":"2022-04-28 14:39:13.958594","last_active":"2022-04-28 14:39:13.967619","last_peered":"2022-04-28 14:39:13.967619","last_clean":"2022-04-28 14:39:13.967619","last_became_active":"2022-04-28 14:39:13.958234","last_became_peered":"2022-04-28 14:39:13.958234","last_unstale":"2022-04-28 14:39:13.967619","last_undegraded":"2022-04-28 14:39:13.967619","last_fullsized":"2022-04-28 14:39:13.967619","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943967","last_change":"2022-04-28 14:39:13.610919","last_active":"2022-04-28 14:39:13.943967","last_peered":"2022-04-28 14:39:13.943967","last_clean":"2022-04-28 14:39:13.943967","last_became_active":"2022-04-28 14:39:13.610535","last_became_peered":"2022-04-28 14:39:13.610535","last_unstale":"2022-04-28 14:39:13.943967","last_undegraded":"2022-04-28 14:39:13.943967","last_fullsized":"2022-04-28 14:39:13.943967","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.970041","last_change":"2022-04-28 14:39:13.968427","last_active":"2022-04-28 14:39:13.970041","last_peered":"2022-04-28 14:39:13.970041","last_clean":"2022-04-28 14:39:13.970041","last_became_active":"2022-04-28 14:39:13.968116","last_became_peered":"2022-04-28 14:39:13.968116","last_unstale":"2022-04-28 14:39:13.970041","last_undegraded":"2022-04-28 14:39:13.970041","last_fullsized":"2022-04-28 14:39:13.970041","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943521","last_change":"2022-04-28 14:39:05.390479","last_active":"2022-04-28 14:39:13.943521","last_peered":"2022-04-28 14:39:13.943521","last_clean":"2022-04-28 14:39:13.943521","last_became_active":"2022-04-28 14:39:05.390111","last_became_peered":"2022-04-28 14:39:05.390111","last_unstale":"2022-04-28 14:39:13.943521","last_undegraded":"2022-04-28 14:39:13.943521","last_fullsized":"2022-04-28 14:39:13.943521","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.941477","last_change":"2022-04-28 14:39:13.610156","last_active":"2022-04-28 14:39:13.941477","last_peered":"2022-04-28 14:39:13.941477","last_clean":"2022-04-28 14:39:13.941477","last_became_active":"2022-04-28 14:39:13.609823","last_became_peered":"2022-04-28 14:39:13.609823","last_unstale":"2022-04-28 14:39:13.941477","last_undegraded":"2022-04-28 14:39:13.941477","last_fullsized":"2022-04-28 14:39:13.941477","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.962538","last_change":"2022-04-28 14:39:13.952310","last_active":"2022-04-28 14:39:13.962538","last_peered":"2022-04-28 14:39:13.962538","last_clean":"2022-04-28 14:39:13.962538","last_became_active":"2022-04-28 14:39:13.951984","last_became_peered":"2022-04-28 14:39:13.951984","last_unstale":"2022-04-28 14:39:13.962538","last_undegraded":"2022-04-28 14:39:13.962538","last_fullsized":"2022-04-28 14:39:13.962538","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.945719","last_change":"2022-04-28 14:39:05.388548","last_active":"2022-04-28 14:39:13.945719","last_peered":"2022-04-28 14:39:13.945719","last_clean":"2022-04-28 14:39:13.945719","last_became_active":"2022-04-28 14:39:05.388215","last_became_peered":"2022-04-28 14:39:05.388215","last_unstale":"2022-04-28 14:39:13.945719","last_undegraded":"2022-04-28 14:39:13.945719","last_fullsized":"2022-04-28 14:39:13.945719","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.971324","last_change":"2022-04-28 14:39:13.627277","last_active":"2022-04-28 14:39:13.971324","last_peered":"2022-04-28 14:39:13.971324","last_clean":"2022-04-28 14:39:13.971324","last_became_active":"2022-04-28 14:39:13.626883","last_became_peered":"2022-04-28 14:39:13.626883","last_unstale":"2022-04-28 14:39:13.971324","last_undegraded":"2022-04-28 14:39:13.971324","last_fullsized":"2022-04-28 14:39:13.971324","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.940615","last_change":"2022-04-28 14:39:05.388784","last_active":"2022-04-28 14:39:13.940615","last_peered":"2022-04-28 14:39:13.940615","last_clean":"2022-04-28 14:39:13.940615","last_became_active":"2022-04-28 14:39:05.388043","last_became_peered":"2022-04-28 14:39:05.388043","last_unstale":"2022-04-28 14:39:13.940615","last_undegraded":"2022-04-28 14:39:13.940615","last_fullsized":"2022-04-28 14:39:13.940615","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:15.554630","last_change":"2022-04-28 14:39:13.622411","last_active":"2022-04-28 14:39:15.554630","last_peered":"2022-04-28 14:39:15.554630","last_clean":"2022-04-28 14:39:15.554630","last_became_active":"2022-04-28 14:39:13.621590","last_became_peered":"2022-04-28 14:39:13.621590","last_unstale":"2022-04-28 14:39:15.554630","last_undegraded":"2022-04-28 14:39:15.554630","last_fullsized":"2022-04-28 14:39:15.554630","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.963743","last_change":"2022-04-28 14:39:13.955187","last_active":"2022-04-28 14:39:13.963743","last_peered":"2022-04-28 14:39:13.963743","last_clean":"2022-04-28 14:39:13.963743","last_became_active":"2022-04-28 14:39:13.954831","last_became_peered":"2022-04-28 14:39:13.954831","last_unstale":"2022-04-28 14:39:13.963743","last_undegraded":"2022-04-28 14:39:13.963743","last_fullsized":"2022-04-28 14:39:13.963743","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943544","last_change":"2022-04-28 14:39:05.390881","last_active":"2022-04-28 14:39:13.943544","last_peered":"2022-04-28 14:39:13.943544","last_clean":"2022-04-28 14:39:13.943544","last_became_active":"2022-04-28 14:39:05.390559","last_became_peered":"2022-04-28 14:39:05.390559","last_unstale":"2022-04-28 14:39:13.943544","last_undegraded":"2022-04-28 14:39:13.943544","last_fullsized":"2022-04-28 14:39:13.943544","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:14.932410","last_change":"2022-04-28 14:39:13.608628","last_active":"2022-04-28 14:39:14.932410","last_peered":"2022-04-28 14:39:14.932410","last_clean":"2022-04-28 14:39:14.932410","last_became_active":"2022-04-28 14:39:13.608261","last_became_peered":"2022-04-28 14:39:13.608261","last_unstale":"2022-04-28 14:39:14.932410","last_undegraded":"2022-04-28 14:39:14.932410","last_fullsized":"2022-04-28 14:39:14.932410","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.952043","last_change":"2022-04-28 14:39:13.944110","last_active":"2022-04-28 14:39:13.952043","last_peered":"2022-04-28 14:39:13.952043","last_clean":"2022-04-28 14:39:13.952043","last_became_active":"2022-04-28 14:39:13.943780","last_became_peered":"2022-04-28 14:39:13.943780","last_unstale":"2022-04-28 14:39:13.952043","last_undegraded":"2022-04-28 14:39:13.952043","last_fullsized":"2022-04-28 14:39:13.952043","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.935718","last_change":"2022-04-28 14:39:05.390962","last_active":"2022-04-28 14:39:13.935718","last_peered":"2022-04-28 14:39:13.935718","last_clean":"2022-04-28 14:39:13.935718","last_became_active":"2022-04-28 14:39:05.390602","last_became_peered":"2022-04-28 14:39:05.390602","last_unstale":"2022-04-28 14:39:13.935718","last_undegraded":"2022-04-28 14:39:13.935718","last_fullsized":"2022-04-28 14:39:13.935718","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'2","reported_seq":"12","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:16.603623","last_change":"2022-04-28 14:39:13.614524","last_active":"2022-04-28 14:39:16.603623","last_peered":"2022-04-28 14:39:16.603623","last_clean":"2022-04-28 14:39:16.603623","last_became_active":"2022-04-28 14:39:13.614177","last_became_peered":"2022-04-28 14:39:13.614177","last_unstale":"2022-04-28 14:39:16.603623","last_undegraded":"2022-04-28 14:39:16.603623","last_fullsized":"2022-04-28 14:39:16.603623","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.970262","last_change":"2022-04-28 14:39:13.960464","last_active":"2022-04-28 14:39:13.970262","last_peered":"2022-04-28 14:39:13.970262","last_clean":"2022-04-28 14:39:13.970262","last_became_active":"2022-04-28 14:39:13.958817","last_became_peered":"2022-04-28 14:39:13.958817","last_unstale":"2022-04-28 14:39:13.970262","last_undegraded":"2022-04-28 14:39:13.970262","last_fullsized":"2022-04-28 14:39:13.970262","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.937426","last_change":"2022-04-28 14:39:05.389329","last_active":"2022-04-28 14:39:13.937426","last_peered":"2022-04-28 14:39:13.937426","last_clean":"2022-04-28 14:39:13.937426","last_became_active":"2022-04-28 14:39:05.389030","last_became_peered":"2022-04-28 14:39:05.389030","last_unstale":"2022-04-28 14:39:13.937426","last_undegraded":"2022-04-28 14:39:13.937426","last_fullsized":"2022-04-28 14:39:13.937426","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.939667","last_change":"2022-04-28 14:39:13.624225","last_active":"2022-04-28 14:39:13.939667","last_peered":"2022-04-28 14:39:13.939667","last_clean":"2022-04-28 14:39:13.939667","last_became_active":"2022-04-28 14:39:13.623631","last_became_peered":"2022-04-28 14:39:13.623631","last_unstale":"2022-04-28 14:39:13.939667","last_undegraded":"2022-04-28 14:39:13.939667","last_fullsized":"2022-04-28 14:39:13.939667","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.957004","last_change":"2022-04-28 14:39:13.951379","last_active":"2022-04-28 14:39:13.957004","last_peered":"2022-04-28 14:39:13.957004","last_clean":"2022-04-28 14:39:13.957004","last_became_active":"2022-04-28 14:39:13.950657","last_became_peered":"2022-04-28 14:39:13.950657","last_unstale":"2022-04-28 14:39:13.957004","last_undegraded":"2022-04-28 14:39:13.957004","last_fullsized":"2022-04-28 14:39:13.957004","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.947902","last_change":"2022-04-28 14:39:05.388553","last_active":"2022-04-28 14:39:13.947902","last_peered":"2022-04-28 14:39:13.947902","last_clean":"2022-04-28 14:39:13.947902","last_became_active":"2022-04-28 14:39:05.388170","last_became_peered":"2022-04-28 14:39:05.388170","last_unstale":"2022-04-28 14:39:13.947902","last_undegraded":"2022-04-28 14:39:13.947902","last_fullsized":"2022-04-28 14:39:13.947902","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.953366","last_change":"2022-04-28 14:39:13.627446","last_active":"2022-04-28 14:39:13.953366","last_peered":"2022-04-28 14:39:13.953366","last_clean":"2022-04-28 14:39:13.953366","last_became_active":"2022-04-28 14:39:13.627067","last_became_peered":"2022-04-28 14:39:13.627067","last_unstale":"2022-04-28 14:39:13.953366","last_undegraded":"2022-04-28 14:39:13.953366","last_fullsized":"2022-04-28 14:39:13.953366","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.961324","last_change":"2022-04-28 14:39:13.951391","last_active":"2022-04-28 14:39:13.961324","last_peered":"2022-04-28 14:39:13.961324","last_clean":"2022-04-28 14:39:13.961324","last_became_active":"2022-04-28 14:39:13.951063","last_became_peered":"2022-04-28 14:39:13.951063","last_unstale":"2022-04-28 14:39:13.961324","last_undegraded":"2022-04-28 14:39:13.961324","last_fullsized":"2022-04-28 14:39:13.961324","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.941494","last_change":"2022-04-28 14:39:05.388412","last_active":"2022-04-28 14:39:13.941494","last_peered":"2022-04-28 14:39:13.941494","last_clean":"2022-04-28 14:39:13.941494","last_became_active":"2022-04-28 14:39:05.388067","last_became_peered":"2022-04-28 14:39:05.388067","last_unstale":"2022-04-28 14:39:13.941494","last_undegraded":"2022-04-28 14:39:13.941494","last_fullsized":"2022-04-28 14:39:13.941494","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:04.377361","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:04.377361","last_clean_scrub_stamp":"2022-04-28 14:39:04.377361","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.940916","last_change":"2022-04-28 14:39:13.609546","last_active":"2022-04-28 14:39:13.940916","last_peered":"2022-04-28 14:39:13.940916","last_clean":"2022-04-28 14:39:13.940916","last_became_active":"2022-04-28 14:39:13.609231","last_became_peered":"2022-04-28 14:39:13.609231","last_unstale":"2022-04-28 14:39:13.940916","last_undegraded":"2022-04-28 14:39:13.940916","last_fullsized":"2022-04-28 14:39:13.940916","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.973586","last_change":"2022-04-28 14:39:13.971977","last_active":"2022-04-28 14:39:13.973586","last_peered":"2022-04-28 14:39:13.973586","last_clean":"2022-04-28 14:39:13.973586","last_became_active":"2022-04-28 14:39:13.971343","last_became_peered":"2022-04-28 14:39:13.971343","last_unstale":"2022-04-28 14:39:13.973586","last_undegraded":"2022-04-28 14:39:13.973586","last_fullsized":"2022-04-28 14:39:13.973586","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.974303","last_change":"2022-04-28 14:39:13.970909","last_active":"2022-04-28 14:39:13.974303","last_peered":"2022-04-28 14:39:13.974303","last_clean":"2022-04-28 14:39:13.974303","last_became_active":"2022-04-28 14:39:13.970599","last_became_peered":"2022-04-28 14:39:13.970599","last_unstale":"2022-04-28 14:39:13.974303","last_undegraded":"2022-04-28 14:39:13.974303","last_fullsized":"2022-04-28 14:39:13.974303","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.948934","last_change":"2022-04-28 14:39:13.622383","last_active":"2022-04-28 14:39:13.948934","last_peered":"2022-04-28 14:39:13.948934","last_clean":"2022-04-28 14:39:13.948934","last_became_active":"2022-04-28 14:39:13.620810","last_became_peered":"2022-04-28 14:39:13.620810","last_unstale":"2022-04-28 14:39:13.948934","last_undegraded":"2022-04-28 14:39:13.948934","last_fullsized":"2022-04-28 14:39:13.948934","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.961345","last_change":"2022-04-28 14:39:13.951426","last_active":"2022-04-28 14:39:13.961345","last_peered":"2022-04-28 14:39:13.961345","last_clean":"2022-04-28 14:39:13.961345","last_became_active":"2022-04-28 14:39:13.951111","last_became_peered":"2022-04-28 14:39:13.951111","last_unstale":"2022-04-28 14:39:13.961345","last_undegraded":"2022-04-28 14:39:13.961345","last_fullsized":"2022-04-28 14:39:13.961345","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.964946","last_change":"2022-04-28 14:39:13.622151","last_active":"2022-04-28 14:39:13.964946","last_peered":"2022-04-28 14:39:13.964946","last_clean":"2022-04-28 14:39:13.964946","last_became_active":"2022-04-28 14:39:13.621812","last_became_peered":"2022-04-28 14:39:13.621812","last_unstale":"2022-04-28 14:39:13.964946","last_undegraded":"2022-04-28 14:39:13.964946","last_fullsized":"2022-04-28 14:39:13.964946","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967311","last_change":"2022-04-28 14:39:13.961409","last_active":"2022-04-28 14:39:13.967311","last_peered":"2022-04-28 14:39:13.967311","last_clean":"2022-04-28 14:39:13.967311","last_became_active":"2022-04-28 14:39:13.961034","last_became_peered":"2022-04-28 14:39:13.961034","last_unstale":"2022-04-28 14:39:13.967311","last_undegraded":"2022-04-28 14:39:13.967311","last_fullsized":"2022-04-28 14:39:13.967311","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.970906","last_change":"2022-04-28 14:39:13.627961","last_active":"2022-04-28 14:39:13.970906","last_peered":"2022-04-28 14:39:13.970906","last_clean":"2022-04-28 14:39:13.970906","last_became_active":"2022-04-28 14:39:13.627595","last_became_peered":"2022-04-28 14:39:13.627595","last_unstale":"2022-04-28 14:39:13.970906","last_undegraded":"2022-04-28 14:39:13.970906","last_fullsized":"2022-04-28 14:39:13.970906","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.975440","last_change":"2022-04-28 14:39:13.973251","last_active":"2022-04-28 14:39:13.975440","last_peered":"2022-04-28 14:39:13.975440","last_clean":"2022-04-28 14:39:13.975440","last_became_active":"2022-04-28 14:39:13.973008","last_became_peered":"2022-04-28 14:39:13.973008","last_unstale":"2022-04-28 14:39:13.975440","last_undegraded":"2022-04-28 14:39:13.975440","last_fullsized":"2022-04-28 14:39:13.975440","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.971384","last_change":"2022-04-28 14:39:13.619997","last_active":"2022-04-28 14:39:13.971384","last_peered":"2022-04-28 14:39:13.971384","last_clean":"2022-04-28 14:39:13.971384","last_became_active":"2022-04-28 14:39:13.619739","last_became_peered":"2022-04-28 14:39:13.619739","last_unstale":"2022-04-28 14:39:13.971384","last_undegraded":"2022-04-28 14:39:13.971384","last_fullsized":"2022-04-28 14:39:13.971384","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.949245","last_change":"2022-04-28 14:39:13.944278","last_active":"2022-04-28 14:39:13.949245","last_peered":"2022-04-28 14:39:13.949245","last_clean":"2022-04-28 14:39:13.949245","last_became_active":"2022-04-28 14:39:13.943973","last_became_peered":"2022-04-28 14:39:13.943973","last_unstale":"2022-04-28 14:39:13.949245","last_undegraded":"2022-04-28 14:39:13.949245","last_fullsized":"2022-04-28 14:39:13.949245","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.936304","last_change":"2022-04-28 14:39:13.622598","last_active":"2022-04-28 14:39:13.936304","last_peered":"2022-04-28 14:39:13.936304","last_clean":"2022-04-28 14:39:13.936304","last_became_active":"2022-04-28 14:39:13.622080","last_became_peered":"2022-04-28 14:39:13.622080","last_unstale":"2022-04-28 14:39:13.936304","last_undegraded":"2022-04-28 14:39:13.936304","last_fullsized":"2022-04-28 14:39:13.936304","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.955715","last_change":"2022-04-28 14:39:13.952416","last_active":"2022-04-28 14:39:13.955715","last_peered":"2022-04-28 14:39:13.955715","last_clean":"2022-04-28 14:39:13.955715","last_became_active":"2022-04-28 14:39:13.952100","last_became_peered":"2022-04-28 14:39:13.952100","last_unstale":"2022-04-28 14:39:13.955715","last_undegraded":"2022-04-28 14:39:13.955715","last_fullsized":"2022-04-28 14:39:13.955715","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.935394","last_change":"2022-04-28 14:39:13.602486","last_active":"2022-04-28 14:39:13.935394","last_peered":"2022-04-28 14:39:13.935394","last_clean":"2022-04-28 14:39:13.935394","last_became_active":"2022-04-28 14:39:13.602105","last_became_peered":"2022-04-28 14:39:13.602105","last_unstale":"2022-04-28 14:39:13.935394","last_undegraded":"2022-04-28 14:39:13.935394","last_fullsized":"2022-04-28 14:39:13.935394","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967037","last_change":"2022-04-28 14:39:13.964624","last_active":"2022-04-28 14:39:13.967037","last_peered":"2022-04-28 14:39:13.967037","last_clean":"2022-04-28 14:39:13.967037","last_became_active":"2022-04-28 14:39:13.964305","last_became_peered":"2022-04-28 14:39:13.964305","last_unstale":"2022-04-28 14:39:13.967037","last_undegraded":"2022-04-28 14:39:13.967037","last_fullsized":"2022-04-28 14:39:13.967037","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.939875","last_change":"2022-04-28 14:39:13.624420","last_active":"2022-04-28 14:39:13.939875","last_peered":"2022-04-28 14:39:13.939875","last_clean":"2022-04-28 14:39:13.939875","last_became_active":"2022-04-28 14:39:13.623884","last_became_peered":"2022-04-28 14:39:13.623884","last_unstale":"2022-04-28 14:39:13.939875","last_undegraded":"2022-04-28 14:39:13.939875","last_fullsized":"2022-04-28 14:39:13.939875","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.970283","last_change":"2022-04-28 14:39:13.960655","last_active":"2022-04-28 14:39:13.970283","last_peered":"2022-04-28 14:39:13.970283","last_clean":"2022-04-28 14:39:13.970283","last_became_active":"2022-04-28 14:39:13.960060","last_became_peered":"2022-04-28 14:39:13.960060","last_unstale":"2022-04-28 14:39:13.970283","last_undegraded":"2022-04-28 14:39:13.970283","last_fullsized":"2022-04-28 14:39:13.970283","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943941","last_change":"2022-04-28 14:39:13.624344","last_active":"2022-04-28 14:39:13.943941","last_peered":"2022-04-28 14:39:13.943941","last_clean":"2022-04-28 14:39:13.943941","last_became_active":"2022-04-28 14:39:13.623843","last_became_peered":"2022-04-28 14:39:13.623843","last_unstale":"2022-04-28 14:39:13.943941","last_undegraded":"2022-04-28 14:39:13.943941","last_fullsized":"2022-04-28 14:39:13.943941","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.973468","last_change":"2022-04-28 14:39:13.969259","last_active":"2022-04-28 14:39:13.973468","last_peered":"2022-04-28 14:39:13.973468","last_clean":"2022-04-28 14:39:13.973468","last_became_active":"2022-04-28 14:39:13.968448","last_became_peered":"2022-04-28 14:39:13.968448","last_unstale":"2022-04-28 14:39:13.973468","last_undegraded":"2022-04-28 14:39:13.973468","last_fullsized":"2022-04-28 14:39:13.973468","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.941007","last_change":"2022-04-28 14:39:13.609457","last_active":"2022-04-28 14:39:13.941007","last_peered":"2022-04-28 14:39:13.941007","last_clean":"2022-04-28 14:39:13.941007","last_became_active":"2022-04-28 14:39:13.609114","last_became_peered":"2022-04-28 14:39:13.609114","last_unstale":"2022-04-28 14:39:13.941007","last_undegraded":"2022-04-28 14:39:13.941007","last_fullsized":"2022-04-28 14:39:13.941007","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967821","last_change":"2022-04-28 14:39:13.960837","last_active":"2022-04-28 14:39:13.967821","last_peered":"2022-04-28 14:39:13.967821","last_clean":"2022-04-28 14:39:13.967821","last_became_active":"2022-04-28 14:39:13.960511","last_became_peered":"2022-04-28 14:39:13.960511","last_unstale":"2022-04-28 14:39:13.967821","last_undegraded":"2022-04-28 14:39:13.967821","last_fullsized":"2022-04-28 14:39:13.967821","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:14.933198","last_change":"2022-04-28 14:39:13.600840","last_active":"2022-04-28 14:39:14.933198","last_peered":"2022-04-28 14:39:14.933198","last_clean":"2022-04-28 14:39:14.933198","last_became_active":"2022-04-28 14:39:13.600508","last_became_peered":"2022-04-28 14:39:13.600508","last_unstale":"2022-04-28 14:39:14.933198","last_undegraded":"2022-04-28 14:39:14.933198","last_fullsized":"2022-04-28 14:39:14.933198","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.969866","last_change":"2022-04-28 14:39:13.968364","last_active":"2022-04-28 14:39:13.969866","last_peered":"2022-04-28 14:39:13.969866","last_clean":"2022-04-28 14:39:13.969866","last_became_active":"2022-04-28 14:39:13.968054","last_became_peered":"2022-04-28 14:39:13.968054","last_unstale":"2022-04-28 14:39:13.969866","last_undegraded":"2022-04-28 14:39:13.969866","last_fullsized":"2022-04-28 14:39:13.969866","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:15.552206","last_change":"2022-04-28 14:39:13.623080","last_active":"2022-04-28 14:39:15.552206","last_peered":"2022-04-28 14:39:15.552206","last_clean":"2022-04-28 14:39:15.552206","last_became_active":"2022-04-28 14:39:13.622568","last_became_peered":"2022-04-28 14:39:13.622568","last_unstale":"2022-04-28 14:39:15.552206","last_undegraded":"2022-04-28 14:39:15.552206","last_fullsized":"2022-04-28 14:39:15.552206","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.973674","last_change":"2022-04-28 14:39:13.972567","last_active":"2022-04-28 14:39:13.973674","last_peered":"2022-04-28 14:39:13.973674","last_clean":"2022-04-28 14:39:13.973674","last_became_active":"2022-04-28 14:39:13.972179","last_became_peered":"2022-04-28 14:39:13.972179","last_unstale":"2022-04-28 14:39:13.973674","last_undegraded":"2022-04-28 14:39:13.973674","last_fullsized":"2022-04-28 14:39:13.973674","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"16'2","reported_seq":"12","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:16.603003","last_change":"2022-04-28 14:39:13.622222","last_active":"2022-04-28 14:39:16.603003","last_peered":"2022-04-28 14:39:16.603003","last_clean":"2022-04-28 14:39:16.603003","last_became_active":"2022-04-28 14:39:13.621872","last_became_peered":"2022-04-28 14:39:13.621872","last_unstale":"2022-04-28 14:39:16.603003","last_undegraded":"2022-04-28 14:39:16.603003","last_fullsized":"2022-04-28 14:39:16.603003","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967571","last_change":"2022-04-28 14:39:13.958395","last_active":"2022-04-28 14:39:13.967571","last_peered":"2022-04-28 14:39:13.967571","last_clean":"2022-04-28 14:39:13.967571","last_became_active":"2022-04-28 14:39:13.957976","last_became_peered":"2022-04-28 14:39:13.957976","last_unstale":"2022-04-28 14:39:13.967571","last_undegraded":"2022-04-28 14:39:13.967571","last_fullsized":"2022-04-28 14:39:13.967571","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"16'2","reported_seq":"12","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:16.601346","last_change":"2022-04-28 14:39:13.622467","last_active":"2022-04-28 14:39:16.601346","last_peered":"2022-04-28 14:39:16.601346","last_clean":"2022-04-28 14:39:16.601346","last_became_active":"2022-04-28 14:39:13.621838","last_became_peered":"2022-04-28 14:39:13.621838","last_unstale":"2022-04-28 14:39:16.601346","last_undegraded":"2022-04-28 14:39:16.601346","last_fullsized":"2022-04-28 14:39:16.601346","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967649","last_change":"2022-04-28 14:39:13.958646","last_active":"2022-04-28 14:39:13.967649","last_peered":"2022-04-28 14:39:13.967649","last_clean":"2022-04-28 14:39:13.967649","last_became_active":"2022-04-28 14:39:13.957994","last_became_peered":"2022-04-28 14:39:13.957994","last_unstale":"2022-04-28 14:39:13.967649","last_undegraded":"2022-04-28 14:39:13.967649","last_fullsized":"2022-04-28 14:39:13.967649","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.942257","last_change":"2022-04-28 14:39:13.614008","last_active":"2022-04-28 14:39:13.942257","last_peered":"2022-04-28 14:39:13.942257","last_clean":"2022-04-28 14:39:13.942257","last_became_active":"2022-04-28 14:39:13.613702","last_became_peered":"2022-04-28 14:39:13.613702","last_unstale":"2022-04-28 14:39:13.942257","last_undegraded":"2022-04-28 14:39:13.942257","last_fullsized":"2022-04-28 14:39:13.942257","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.956962","last_change":"2022-04-28 14:39:13.950979","last_active":"2022-04-28 14:39:13.956962","last_peered":"2022-04-28 14:39:13.956962","last_clean":"2022-04-28 14:39:13.956962","last_became_active":"2022-04-28 14:39:13.950168","last_became_peered":"2022-04-28 14:39:13.950168","last_unstale":"2022-04-28 14:39:13.956962","last_undegraded":"2022-04-28 14:39:13.956962","last_fullsized":"2022-04-28 14:39:13.956962","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:14.935068","last_change":"2022-04-28 14:39:13.617031","last_active":"2022-04-28 14:39:14.935068","last_peered":"2022-04-28 14:39:14.935068","last_clean":"2022-04-28 14:39:14.935068","last_became_active":"2022-04-28 14:39:13.615420","last_became_peered":"2022-04-28 14:39:13.615420","last_unstale":"2022-04-28 14:39:14.935068","last_undegraded":"2022-04-28 14:39:14.935068","last_fullsized":"2022-04-28 14:39:14.935068","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.963546","last_change":"2022-04-28 14:39:13.954485","last_active":"2022-04-28 14:39:13.963546","last_peered":"2022-04-28 14:39:13.963546","last_clean":"2022-04-28 14:39:13.963546","last_became_active":"2022-04-28 14:39:13.954179","last_became_peered":"2022-04-28 14:39:13.954179","last_unstale":"2022-04-28 14:39:13.963546","last_undegraded":"2022-04-28 14:39:13.963546","last_fullsized":"2022-04-28 14:39:13.963546","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"16'3","reported_seq":"13","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:16.605336","last_change":"2022-04-28 14:39:13.608868","last_active":"2022-04-28 14:39:16.605336","last_peered":"2022-04-28 14:39:16.605336","last_clean":"2022-04-28 14:39:16.605336","last_became_active":"2022-04-28 14:39:13.608590","last_became_peered":"2022-04-28 14:39:13.608590","last_unstale":"2022-04-28 14:39:16.605336","last_undegraded":"2022-04-28 14:39:16.605336","last_fullsized":"2022-04-28 14:39:16.605336","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.969788","last_change":"2022-04-28 14:39:13.966189","last_active":"2022-04-28 14:39:13.969788","last_peered":"2022-04-28 14:39:13.969788","last_clean":"2022-04-28 14:39:13.969788","last_became_active":"2022-04-28 14:39:13.965877","last_became_peered":"2022-04-28 14:39:13.965877","last_unstale":"2022-04-28 14:39:13.969788","last_undegraded":"2022-04-28 14:39:13.969788","last_fullsized":"2022-04-28 14:39:13.969788","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943233","last_change":"2022-04-28 14:39:13.601488","last_active":"2022-04-28 14:39:13.943233","last_peered":"2022-04-28 14:39:13.943233","last_clean":"2022-04-28 14:39:13.943233","last_became_active":"2022-04-28 14:39:13.601122","last_became_peered":"2022-04-28 14:39:13.601122","last_unstale":"2022-04-28 14:39:13.943233","last_undegraded":"2022-04-28 14:39:13.943233","last_fullsized":"2022-04-28 14:39:13.943233","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.956513","last_change":"2022-04-28 14:39:13.951897","last_active":"2022-04-28 14:39:13.956513","last_peered":"2022-04-28 14:39:13.956513","last_clean":"2022-04-28 14:39:13.956513","last_became_active":"2022-04-28 14:39:13.951314","last_became_peered":"2022-04-28 14:39:13.951314","last_unstale":"2022-04-28 14:39:13.956513","last_undegraded":"2022-04-28 14:39:13.956513","last_fullsized":"2022-04-28 14:39:13.956513","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.974243","last_change":"2022-04-28 14:39:13.615041","last_active":"2022-04-28 14:39:13.974243","last_peered":"2022-04-28 14:39:13.974243","last_clean":"2022-04-28 14:39:13.974243","last_became_active":"2022-04-28 14:39:13.614710","last_became_peered":"2022-04-28 14:39:13.614710","last_unstale":"2022-04-28 14:39:13.974243","last_undegraded":"2022-04-28 14:39:13.974243","last_fullsized":"2022-04-28 14:39:13.974243","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.975312","last_change":"2022-04-28 14:39:13.971986","last_active":"2022-04-28 14:39:13.975312","last_peered":"2022-04-28 14:39:13.975312","last_clean":"2022-04-28 14:39:13.975312","last_became_active":"2022-04-28 14:39:13.971243","last_became_peered":"2022-04-28 14:39:13.971243","last_unstale":"2022-04-28 14:39:13.975312","last_undegraded":"2022-04-28 14:39:13.975312","last_fullsized":"2022-04-28 14:39:13.975312","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.941578","last_change":"2022-04-28 14:39:13.613362","last_active":"2022-04-28 14:39:13.941578","last_peered":"2022-04-28 14:39:13.941578","last_clean":"2022-04-28 14:39:13.941578","last_became_active":"2022-04-28 14:39:13.612969","last_became_peered":"2022-04-28 14:39:13.612969","last_unstale":"2022-04-28 14:39:13.941578","last_undegraded":"2022-04-28 14:39:13.941578","last_fullsized":"2022-04-28 14:39:13.941578","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.973650","last_change":"2022-04-28 14:39:13.972552","last_active":"2022-04-28 14:39:13.973650","last_peered":"2022-04-28 14:39:13.973650","last_clean":"2022-04-28 14:39:13.973650","last_became_active":"2022-04-28 14:39:13.970887","last_became_peered":"2022-04-28 14:39:13.970887","last_unstale":"2022-04-28 14:39:13.973650","last_undegraded":"2022-04-28 14:39:13.973650","last_fullsized":"2022-04-28 14:39:13.973650","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.955661","last_change":"2022-04-28 14:39:13.628138","last_active":"2022-04-28 14:39:13.955661","last_peered":"2022-04-28 14:39:13.955661","last_clean":"2022-04-28 14:39:13.955661","last_became_active":"2022-04-28 14:39:13.627785","last_became_peered":"2022-04-28 14:39:13.627785","last_unstale":"2022-04-28 14:39:13.955661","last_undegraded":"2022-04-28 14:39:13.955661","last_fullsized":"2022-04-28 14:39:13.955661","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.962842","last_change":"2022-04-28 14:39:13.955799","last_active":"2022-04-28 14:39:13.962842","last_peered":"2022-04-28 14:39:13.962842","last_clean":"2022-04-28 14:39:13.962842","last_became_active":"2022-04-28 14:39:13.955495","last_became_peered":"2022-04-28 14:39:13.955495","last_unstale":"2022-04-28 14:39:13.962842","last_undegraded":"2022-04-28 14:39:13.962842","last_fullsized":"2022-04-28 14:39:13.962842","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"16'6","reported_seq":"16","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:16.602953","last_change":"2022-04-28 14:39:13.621432","last_active":"2022-04-28 14:39:16.602953","last_peered":"2022-04-28 14:39:16.602953","last_clean":"2022-04-28 14:39:16.602953","last_became_active":"2022-04-28 14:39:13.621080","last_became_peered":"2022-04-28 14:39:13.621080","last_unstale":"2022-04-28 14:39:16.602953","last_undegraded":"2022-04-28 14:39:16.602953","last_fullsized":"2022-04-28 14:39:16.602953","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.957517","last_change":"2022-04-28 14:39:13.956112","last_active":"2022-04-28 14:39:13.957517","last_peered":"2022-04-28 14:39:13.957517","last_clean":"2022-04-28 14:39:13.957517","last_became_active":"2022-04-28 14:39:13.955792","last_became_peered":"2022-04-28 14:39:13.955792","last_unstale":"2022-04-28 14:39:13.957517","last_undegraded":"2022-04-28 14:39:13.957517","last_fullsized":"2022-04-28 14:39:13.957517","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.943395","last_change":"2022-04-28 14:39:13.622128","last_active":"2022-04-28 14:39:13.943395","last_peered":"2022-04-28 14:39:13.943395","last_clean":"2022-04-28 14:39:13.943395","last_became_active":"2022-04-28 14:39:13.621790","last_became_peered":"2022-04-28 14:39:13.621790","last_unstale":"2022-04-28 14:39:13.943395","last_undegraded":"2022-04-28 14:39:13.943395","last_fullsized":"2022-04-28 14:39:13.943395","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.969380","last_change":"2022-04-28 14:39:13.967323","last_active":"2022-04-28 14:39:13.969380","last_peered":"2022-04-28 14:39:13.969380","last_clean":"2022-04-28 14:39:13.969380","last_became_active":"2022-04-28 14:39:13.961173","last_became_peered":"2022-04-28 14:39:13.961173","last_unstale":"2022-04-28 14:39:13.969380","last_undegraded":"2022-04-28 14:39:13.969380","last_fullsized":"2022-04-28 14:39:13.969380","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.937877","last_change":"2022-04-28 14:39:13.609625","last_active":"2022-04-28 14:39:13.937877","last_peered":"2022-04-28 14:39:13.937877","last_clean":"2022-04-28 14:39:13.937877","last_became_active":"2022-04-28 14:39:13.609062","last_became_peered":"2022-04-28 14:39:13.609062","last_unstale":"2022-04-28 14:39:13.937877","last_undegraded":"2022-04-28 14:39:13.937877","last_fullsized":"2022-04-28 14:39:13.937877","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.966595","last_change":"2022-04-28 14:39:13.963123","last_active":"2022-04-28 14:39:13.966595","last_peered":"2022-04-28 14:39:13.966595","last_clean":"2022-04-28 14:39:13.966595","last_became_active":"2022-04-28 14:39:13.962825","last_became_peered":"2022-04-28 14:39:13.962825","last_unstale":"2022-04-28 14:39:13.966595","last_undegraded":"2022-04-28 14:39:13.966595","last_fullsized":"2022-04-28 14:39:13.966595","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.959564","last_change":"2022-04-28 14:39:13.603083","last_active":"2022-04-28 14:39:13.959564","last_peered":"2022-04-28 14:39:13.959564","last_clean":"2022-04-28 14:39:13.959564","last_became_active":"2022-04-28 14:39:13.602776","last_became_peered":"2022-04-28 14:39:13.602776","last_unstale":"2022-04-28 14:39:13.959564","last_undegraded":"2022-04-28 14:39:13.959564","last_fullsized":"2022-04-28 14:39:13.959564","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.974419","last_change":"2022-04-28 14:39:13.971833","last_active":"2022-04-28 14:39:13.974419","last_peered":"2022-04-28 14:39:13.974419","last_clean":"2022-04-28 14:39:13.974419","last_became_active":"2022-04-28 14:39:13.971513","last_became_peered":"2022-04-28 14:39:13.971513","last_unstale":"2022-04-28 14:39:13.974419","last_undegraded":"2022-04-28 14:39:13.974419","last_fullsized":"2022-04-28 14:39:13.974419","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"16'6","reported_seq":"16","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:16.602166","last_change":"2022-04-28 14:39:13.619098","last_active":"2022-04-28 14:39:16.602166","last_peered":"2022-04-28 14:39:16.602166","last_clean":"2022-04-28 14:39:16.602166","last_became_active":"2022-04-28 14:39:13.618737","last_became_peered":"2022-04-28 14:39:13.618737","last_unstale":"2022-04-28 14:39:16.602166","last_undegraded":"2022-04-28 14:39:16.602166","last_fullsized":"2022-04-28 14:39:16.602166","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.956440","last_change":"2022-04-28 14:39:13.951611","last_active":"2022-04-28 14:39:13.956440","last_peered":"2022-04-28 14:39:13.956440","last_clean":"2022-04-28 14:39:13.956440","last_became_active":"2022-04-28 14:39:13.951102","last_became_peered":"2022-04-28 14:39:13.951102","last_unstale":"2022-04-28 14:39:13.956440","last_undegraded":"2022-04-28 14:39:13.956440","last_fullsized":"2022-04-28 14:39:13.956440","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.941816","last_change":"2022-04-28 14:39:13.618476","last_active":"2022-04-28 14:39:13.941816","last_peered":"2022-04-28 14:39:13.941816","last_clean":"2022-04-28 14:39:13.941816","last_became_active":"2022-04-28 14:39:13.617950","last_became_peered":"2022-04-28 14:39:13.617950","last_unstale":"2022-04-28 14:39:13.941816","last_undegraded":"2022-04-28 14:39:13.941816","last_fullsized":"2022-04-28 14:39:13.941816","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.973798","last_change":"2022-04-28 14:39:13.969503","last_active":"2022-04-28 14:39:13.973798","last_peered":"2022-04-28 14:39:13.973798","last_clean":"2022-04-28 14:39:13.973798","last_became_active":"2022-04-28 14:39:13.969200","last_became_peered":"2022-04-28 14:39:13.969200","last_unstale":"2022-04-28 14:39:13.973798","last_undegraded":"2022-04-28 14:39:13.973798","last_fullsized":"2022-04-28 14:39:13.973798","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"16'2","reported_seq":"12","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:16.602031","last_change":"2022-04-28 14:39:13.613426","last_active":"2022-04-28 14:39:16.602031","last_peered":"2022-04-28 14:39:16.602031","last_clean":"2022-04-28 14:39:16.602031","last_became_active":"2022-04-28 14:39:13.613077","last_became_peered":"2022-04-28 14:39:13.613077","last_unstale":"2022-04-28 14:39:16.602031","last_undegraded":"2022-04-28 14:39:16.602031","last_fullsized":"2022-04-28 14:39:16.602031","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.962551","last_change":"2022-04-28 14:39:13.953772","last_active":"2022-04-28 14:39:13.962551","last_peered":"2022-04-28 14:39:13.962551","last_clean":"2022-04-28 14:39:13.962551","last_became_active":"2022-04-28 14:39:13.953478","last_became_peered":"2022-04-28 14:39:13.953478","last_unstale":"2022-04-28 14:39:13.962551","last_undegraded":"2022-04-28 14:39:13.962551","last_fullsized":"2022-04-28 14:39:13.962551","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.950662","last_change":"2022-04-28 14:39:13.606445","last_active":"2022-04-28 14:39:13.950662","last_peered":"2022-04-28 14:39:13.950662","last_clean":"2022-04-28 14:39:13.950662","last_became_active":"2022-04-28 14:39:13.606028","last_became_peered":"2022-04-28 14:39:13.606028","last_unstale":"2022-04-28 14:39:13.950662","last_undegraded":"2022-04-28 14:39:13.950662","last_fullsized":"2022-04-28 14:39:13.950662","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.956487","last_change":"2022-04-28 14:39:13.951780","last_active":"2022-04-28 14:39:13.956487","last_peered":"2022-04-28 14:39:13.956487","last_clean":"2022-04-28 14:39:13.956487","last_became_active":"2022-04-28 14:39:13.951236","last_became_peered":"2022-04-28 14:39:13.951236","last_unstale":"2022-04-28 14:39:13.956487","last_undegraded":"2022-04-28 14:39:13.956487","last_fullsized":"2022-04-28 14:39:13.956487","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"16'1","reported_seq":"11","reported_epoch":"16","state":"active+clean","last_fresh":"2022-04-28 14:39:15.551243","last_change":"2022-04-28 14:39:13.621466","last_active":"2022-04-28 14:39:15.551243","last_peered":"2022-04-28 14:39:15.551243","last_clean":"2022-04-28 14:39:15.551243","last_became_active":"2022-04-28 14:39:13.621146","last_became_peered":"2022-04-28 14:39:13.621146","last_unstale":"2022-04-28 14:39:15.551243","last_undegraded":"2022-04-28 14:39:15.551243","last_fullsized":"2022-04-28 14:39:15.551243","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967697","last_change":"2022-04-28 14:39:13.960230","last_active":"2022-04-28 14:39:13.967697","last_peered":"2022-04-28 14:39:13.967697","last_clean":"2022-04-28 14:39:13.967697","last_became_active":"2022-04-28 14:39:13.958741","last_became_peered":"2022-04-28 14:39:13.958741","last_unstale":"2022-04-28 14:39:13.967697","last_undegraded":"2022-04-28 14:39:13.967697","last_fullsized":"2022-04-28 14:39:13.967697","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.937051","last_change":"2022-04-28 14:39:13.603448","last_active":"2022-04-28 14:39:13.937051","last_peered":"2022-04-28 14:39:13.937051","last_clean":"2022-04-28 14:39:13.937051","last_became_active":"2022-04-28 14:39:13.603117","last_became_peered":"2022-04-28 14:39:13.603117","last_unstale":"2022-04-28 14:39:13.937051","last_undegraded":"2022-04-28 14:39:13.937051","last_fullsized":"2022-04-28 14:39:13.937051","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.956983","last_change":"2022-04-28 14:39:13.951179","last_active":"2022-04-28 14:39:13.956983","last_peered":"2022-04-28 14:39:13.956983","last_clean":"2022-04-28 14:39:13.956983","last_became_active":"2022-04-28 14:39:13.950413","last_became_peered":"2022-04-28 14:39:13.950413","last_unstale":"2022-04-28 14:39:13.956983","last_undegraded":"2022-04-28 14:39:13.956983","last_fullsized":"2022-04-28 14:39:13.956983","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.972495","last_change":"2022-04-28 14:39:13.609803","last_active":"2022-04-28 14:39:13.972495","last_peered":"2022-04-28 14:39:13.972495","last_clean":"2022-04-28 14:39:13.972495","last_became_active":"2022-04-28 14:39:13.609320","last_became_peered":"2022-04-28 14:39:13.609320","last_unstale":"2022-04-28 14:39:13.972495","last_undegraded":"2022-04-28 14:39:13.972495","last_fullsized":"2022-04-28 14:39:13.972495","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.957157","last_change":"2022-04-28 14:39:13.953322","last_active":"2022-04-28 14:39:13.957157","last_peered":"2022-04-28 14:39:13.957157","last_clean":"2022-04-28 14:39:13.957157","last_became_active":"2022-04-28 14:39:13.952997","last_became_peered":"2022-04-28 14:39:13.952997","last_unstale":"2022-04-28 14:39:13.957157","last_undegraded":"2022-04-28 14:39:13.957157","last_fullsized":"2022-04-28 14:39:13.957157","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":"11","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.964743","last_change":"2022-04-28 14:39:13.624451","last_active":"2022-04-28 14:39:13.964743","last_peered":"2022-04-28 14:39:13.964743","last_clean":"2022-04-28 14:39:13.964743","last_became_active":"2022-04-28 14:39:13.624118","last_became_peered":"2022-04-28 14:39:13.624118","last_unstale":"2022-04-28 14:39:13.964743","last_undegraded":"2022-04-28 14:39:13.964743","last_fullsized":"2022-04-28 14:39:13.964743","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.962340","last_change":"2022-04-28 14:39:13.956657","last_active":"2022-04-28 14:39:13.962340","last_peered":"2022-04-28 14:39:13.962340","last_clean":"2022-04-28 14:39:13.962340","last_became_active":"2022-04-28 14:39:13.956291","last_became_peered":"2022-04-28 14:39:13.956291","last_unstale":"2022-04-28 14:39:13.962340","last_undegraded":"2022-04-28 14:39:13.962340","last_fullsized":"2022-04-28 14:39:13.962340","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":"12","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.964761","last_change":"2022-04-28 14:39:13.621131","last_active":"2022-04-28 14:39:13.964761","last_peered":"2022-04-28 14:39:13.964761","last_clean":"2022-04-28 14:39:13.964761","last_became_active":"2022-04-28 14:39:13.620764","last_became_peered":"2022-04-28 14:39:13.620764","last_unstale":"2022-04-28 14:39:13.964761","last_undegraded":"2022-04-28 14:39:13.964761","last_fullsized":"2022-04-28 14:39:13.964761","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.973522","last_change":"2022-04-28 14:39:13.971712","last_active":"2022-04-28 14:39:13.973522","last_peered":"2022-04-28 14:39:13.973522","last_clean":"2022-04-28 14:39:13.973522","last_became_active":"2022-04-28 14:39:13.970627","last_became_peered":"2022-04-28 14:39:13.970627","last_unstale":"2022-04-28 14:39:13.973522","last_undegraded":"2022-04-28 14:39:13.973522","last_fullsized":"2022-04-28 14:39:13.973522","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.941716","last_change":"2022-04-28 14:39:13.618500","last_active":"2022-04-28 14:39:13.941716","last_peered":"2022-04-28 14:39:13.941716","last_clean":"2022-04-28 14:39:13.941716","last_became_active":"2022-04-28 14:39:13.618171","last_became_peered":"2022-04-28 14:39:13.618171","last_unstale":"2022-04-28 14:39:13.941716","last_undegraded":"2022-04-28 14:39:13.941716","last_fullsized":"2022-04-28 14:39:13.941716","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.967485","last_change":"2022-04-28 14:39:13.966833","last_active":"2022-04-28 14:39:13.967485","last_peered":"2022-04-28 14:39:13.967485","last_clean":"2022-04-28 14:39:13.967485","last_became_active":"2022-04-28 14:39:13.963563","last_became_peered":"2022-04-28 14:39:13.963563","last_unstale":"2022-04-28 14:39:13.967485","last_undegraded":"2022-04-28 14:39:13.967485","last_fullsized":"2022-04-28 14:39:13.967485","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":"10","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.950038","last_change":"2022-04-28 14:39:13.622884","last_active":"2022-04-28 14:39:13.950038","last_peered":"2022-04-28 14:39:13.950038","last_clean":"2022-04-28 14:39:13.950038","last_became_active":"2022-04-28 14:39:13.617005","last_became_peered":"2022-04-28 14:39:13.617005","last_unstale":"2022-04-28 14:39:13.950038","last_undegraded":"2022-04-28 14:39:13.950038","last_fullsized":"2022-04-28 14:39:13.950038","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":"9","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.959924","last_change":"2022-04-28 14:39:13.951972","last_active":"2022-04-28 14:39:13.959924","last_peered":"2022-04-28 14:39:13.959924","last_clean":"2022-04-28 14:39:13.959924","last_became_active":"2022-04-28 14:39:13.951647","last_became_peered":"2022-04-28 14:39:13.951647","last_unstale":"2022-04-28 14:39:13.959924","last_undegraded":"2022-04-28 14:39:13.959924","last_fullsized":"2022-04-28 14:39:13.959924","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:13.574505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:13.574505","last_clean_scrub_stamp":"2022-04-28 14:39:13.574505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":"13","reported_epoch":"15","state":"active+clean","last_fresh":"2022-04-28 14:39:13.963369","last_change":"2022-04-28 14:39:13.619298","last_active":"2022-04-28 14:39:13.963369","last_peered":"2022-04-28 14:39:13.963369","last_clean":"2022-04-28 14:39:13.963369","last_became_active":"2022-04-28 14:39:13.618948","last_became_peered":"2022-04-28 14:39:13.618948","last_unstale":"2022-04-28 14:39:13.963369","last_undegraded":"2022-04-28 14:39:13.963369","last_fullsized":"2022-04-28 14:39:13.963369","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28 14:39:12.570501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28 14:39:12.570501","last_clean_scrub_stamp":"2022-04-28 14:39:12.570501","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":3606,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705671,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":42919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.221}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048740,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323100,"statfs":{"total":96636764160,"available":95562854400,"internally_reserved":1073741824,"allocated":159744,"data_stored":40897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048752,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323088,"statfs":{"total":96636764160,"available":95562842112,"internally_reserved":1073741824,"allocated":172032,"data_stored":42259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.216}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1048744,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323096,"statfs":{"total":96636764160,"available":95562850304,"internally_reserved":1073741824,"allocated":163840,"data_stored":41461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]}]}]}} 2022-04-28T14:39:23.435 INFO:tasks.ceph.ceph_manager.ceph:clean! 2022-04-28T14:39:23.435 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2022-04-28T14:39:23.435 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2022-04-28T14:39:23.435 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2022-04-28T14:39:23.565 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.559 7f73f6c7d700 1 Processor -- start 2022-04-28T14:39:23.566 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.559 7f73f6c7d700 1 -- start start 2022-04-28T14:39:23.566 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.559 7f73f6c7d700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f73f00f6390 0x7f73f00fe970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:23.566 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.559 7f73f6c7d700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f73f00fefa0 0x7f73f01b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:23.566 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.559 7f73f6c7d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f00ab0b0 con 0x7f73f00ff3f0 2022-04-28T14:39:23.566 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.559 7f73f6c7d700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f01b2290 con 0x7f73f00fefa0 2022-04-28T14:39:23.566 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.559 7f73f6c7d700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73f0115dd0 con 0x7f73f00f6390 2022-04-28T14:39:23.566 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.559 7f73ef7fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f73f00f6390 0x7f73f00fe970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:23.566 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.559 7f73eeffd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f73f00fefa0 0x7f73f01b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:23.566 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.560 7f73ef7fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f73f00f6390 0x7f73f00fe970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46394/0 (socket says 172.21.15.22:46394) 2022-04-28T14:39:23.567 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.559 7f73effff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f73f00ff3f0 0x7f73f01b1a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38442/0 (socket says 172.21.15.22:38442) 2022-04-28T14:39:23.567 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.560 7f73eeffd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f73f00fefa0 0x7f73f01b1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46612/0 (socket says 172.21.15.22:46612) 2022-04-28T14:39:23.567 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.560 7f73ef7fe700 1 -- 172.21.15.22:0/4007277241 learned_addr learned my addr 172.21.15.22:0/4007277241 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:23.567 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.560 7f73ef7fe700 1 -- 172.21.15.22:0/4007277241 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f73f00fefa0 msgr2=0x7f73f01b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:23.567 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.560 7f73ee7fc700 1 -- 172.21.15.22:0/4007277241 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651561563 0 0) 0x7f73e8001490 con 0x7f73f00ff3f0 2022-04-28T14:39:23.567 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.560 7f73ef7fe700 1 --2- 172.21.15.22:0/4007277241 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f73f00fefa0 0x7f73f01b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.567 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.560 7f73ef7fe700 1 -- 172.21.15.22:0/4007277241 >> v1:172.21.15.22:6789/0 conn(0x7f73f00ff3f0 legacy=0x7f73f01b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:23.568 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.560 7f73ef7fe700 1 -- 172.21.15.22:0/4007277241 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f010b7d0 con 0x7f73f00f6390 2022-04-28T14:39:23.568 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.560 7f73ef7fe700 1 --2- 172.21.15.22:0/4007277241 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f73f00f6390 0x7f73f00fe970 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f73e4002f70 tx=0x7f73e4009a00).ready entity=mon.2 client_cookie=552b22bbb13f9c4e server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:23.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.560 7f73ee7fc700 1 -- 172.21.15.22:0/4007277241 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f73f010b7d0 con 0x7f73f00f6390 2022-04-28T14:39:23.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.560 7f73ee7fc700 1 -- 172.21.15.22:0/4007277241 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e400f510 con 0x7f73f00f6390 2022-04-28T14:39:23.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.560 7f73ee7fc700 1 -- 172.21.15.22:0/4007277241 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f73e400f6f0 con 0x7f73f00f6390 2022-04-28T14:39:23.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.560 7f73f6c7d700 1 -- 172.21.15.22:0/4007277241 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f73f00f6390 msgr2=0x7f73f00fe970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:23.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.560 7f73f6c7d700 1 --2- 172.21.15.22:0/4007277241 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f73f00f6390 0x7f73f00fe970 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f73e4002f70 tx=0x7f73e4009a00).stop 2022-04-28T14:39:23.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.561 7f73f6c7d700 1 -- 172.21.15.22:0/4007277241 shutdown_connections 2022-04-28T14:39:23.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.561 7f73f6c7d700 1 --2- 172.21.15.22:0/4007277241 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f73f00f6390 0x7f73f00fe970 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.561 7f73f6c7d700 1 --2- 172.21.15.22:0/4007277241 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f73f00fefa0 0x7f73f01b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.561 7f73f6c7d700 1 -- 172.21.15.22:0/4007277241 >> 172.21.15.22:0/4007277241 conn(0x7f73f0117120 msgr2=0x7f73f00f2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:23.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.561 7f73f6c7d700 1 -- 172.21.15.22:0/4007277241 shutdown_connections 2022-04-28T14:39:23.570 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.561 7f73f6c7d700 1 -- 172.21.15.22:0/4007277241 wait complete. 2022-04-28T14:39:23.589 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.584 7f73f6c7d700 1 Processor -- start 2022-04-28T14:39:23.589 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.585 7f73f6c7d700 1 -- start start 2022-04-28T14:39:23.592 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.585 7f73f6c7d700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f73f00da500 0x7f73f00b9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:23.592 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.585 7f73f6c7d700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f73f00b9f90 0x7f73f00ba3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:23.592 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.585 7f73f6c7d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73f01c7a80 0x7f73f01c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:23.593 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.585 7f73f6c7d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f00a2ee0 con 0x7f73f01c7a80 2022-04-28T14:39:23.593 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.585 7f73f6c7d700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f00bd790 con 0x7f73f00b9f90 2022-04-28T14:39:23.593 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.585 7f73f6c7d700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73f00ceab0 con 0x7f73f00da500 2022-04-28T14:39:23.593 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.585 7f73eeffd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f73f00b9f90 0x7f73f00ba3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:23.593 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.585 7f73eeffd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f73f00b9f90 0x7f73f00ba3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46618/0 (socket says 172.21.15.22:46618) 2022-04-28T14:39:23.593 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.585 7f73effff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73f01c7a80 0x7f73f01c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:23.593 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.585 7f73eeffd700 1 -- 172.21.15.22:0/1119679853 learned_addr learned my addr 172.21.15.22:0/1119679853 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:23.593 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.585 7f73ef7fe700 1 --2- 172.21.15.22:0/1119679853 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f73f00da500 0x7f73f00b9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:23.593 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.586 7f73eeffd700 1 -- 172.21.15.22:0/1119679853 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f73f00da500 msgr2=0x7f73f00b9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:23.593 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.586 7f73eeffd700 1 --2- 172.21.15.22:0/1119679853 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f73f00da500 0x7f73f00b9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.594 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.586 7f73eeffd700 1 -- 172.21.15.22:0/1119679853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73f01c7a80 msgr2=0x7f73f01c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:23.594 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.586 7f73eeffd700 1 --2- 172.21.15.22:0/1119679853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73f01c7a80 0x7f73f01c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.594 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.586 7f73eeffd700 1 -- 172.21.15.22:0/1119679853 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f00ced40 con 0x7f73f00b9f90 2022-04-28T14:39:23.594 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.586 7f73effff700 1 --2- 172.21.15.22:0/1119679853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73f01c7a80 0x7f73f01c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:23.594 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.586 7f73eeffd700 1 --2- 172.21.15.22:0/1119679853 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f73f00b9f90 0x7f73f00ba3e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f73f00d81e0 tx=0x7f73e000ec50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:23.594 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.586 7f73ecff9700 1 -- 172.21.15.22:0/1119679853 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f73e000f040 con 0x7f73f00b9f90 2022-04-28T14:39:23.594 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.586 7f73ecff9700 1 -- 172.21.15.22:0/1119679853 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e000c9a0 con 0x7f73f00b9f90 2022-04-28T14:39:23.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.586 7f73f6c7d700 1 -- 172.21.15.22:0/1119679853 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f00da950 con 0x7f73f00b9f90 2022-04-28T14:39:23.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.586 7f73ecff9700 1 -- 172.21.15.22:0/1119679853 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f73e000cd70 con 0x7f73f00b9f90 2022-04-28T14:39:23.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.586 7f73f6c7d700 1 -- 172.21.15.22:0/1119679853 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f01ca510 con 0x7f73f00b9f90 2022-04-28T14:39:23.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.586 7f73ecff9700 1 -- 172.21.15.22:0/1119679853 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f73e0011070 con 0x7f73f00b9f90 2022-04-28T14:39:23.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.587 7f73ecff9700 1 -- 172.21.15.22:0/1119679853 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f73e0010040 con 0x7f73f00b9f90 2022-04-28T14:39:23.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.587 7f73f6c7d700 1 -- 172.21.15.22:0/1119679853 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f00f02c0 con 0x7f73f00b9f90 2022-04-28T14:39:23.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.590 7f73ecff9700 1 -- 172.21.15.22:0/1119679853 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f73e000c5a0 con 0x7f73f00b9f90 2022-04-28T14:39:23.718 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.713 7f73f6c7d700 1 -- 172.21.15.22:0/1119679853 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f73f00a5b80 con 0x7f73f00b9f90 2022-04-28T14:39:23.719 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.714 7f73ecff9700 1 -- 172.21.15.22:0/1119679853 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+34 (secure 0 0 0) 0x7f73e0000c30 con 0x7f73f00b9f90 2022-04-28T14:39:23.719 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:23.720 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.715 7f73f6c7d700 1 -- 172.21.15.22:0/1119679853 >> v1:172.21.15.22:6808/86956 conn(0x7f73d001c1b0 legacy=0x7f73d001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:23.721 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.715 7f73f6c7d700 1 -- 172.21.15.22:0/1119679853 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f73f00b9f90 msgr2=0x7f73f00ba3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:23.721 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.715 7f73f6c7d700 1 --2- 172.21.15.22:0/1119679853 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f73f00b9f90 0x7f73f00ba3e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f73f00d81e0 tx=0x7f73e000ec50).stop 2022-04-28T14:39:23.721 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.715 7f73f6c7d700 1 -- 172.21.15.22:0/1119679853 shutdown_connections 2022-04-28T14:39:23.721 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.715 7f73f6c7d700 1 --2- 172.21.15.22:0/1119679853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73f01c7a80 0x7f73f01c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.721 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.715 7f73f6c7d700 1 --2- 172.21.15.22:0/1119679853 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f73f00da500 0x7f73f00b9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.721 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.715 7f73f6c7d700 1 --2- 172.21.15.22:0/1119679853 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f73f00b9f90 0x7f73f00ba3e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.722 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.715 7f73f6c7d700 1 -- 172.21.15.22:0/1119679853 >> 172.21.15.22:0/1119679853 conn(0x7f73f011a8b0 msgr2=0x7f73f01b96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:23.722 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.715 7f73f6c7d700 1 -- 172.21.15.22:0/1119679853 shutdown_connections 2022-04-28T14:39:23.722 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.715 7f73f6c7d700 1 -- 172.21.15.22:0/1119679853 wait complete. 2022-04-28T14:39:23.730 INFO:teuthology.orchestra.run.smithi022.stdout:{"checks":{},"status":"HEALTH_OK"} 2022-04-28T14:39:23.730 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2022-04-28T14:39:23.731 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-28T14:39:23.863 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.856 7f0e3c24f700 1 Processor -- start 2022-04-28T14:39:23.863 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.856 7f0e3c24f700 1 -- start start 2022-04-28T14:39:23.863 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.856 7f0e3c24f700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0e340f6390 0x7f0e340fe970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:23.863 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.856 7f0e3c24f700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0e340fefa0 0x7f0e341b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:23.863 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.856 7f0e3c24f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e340ab0b0 con 0x7f0e340ff3f0 2022-04-28T14:39:23.863 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.856 7f0e3c24f700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e341b2290 con 0x7f0e340fefa0 2022-04-28T14:39:23.863 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.856 7f0e3c24f700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e34115dd0 con 0x7f0e340f6390 2022-04-28T14:39:23.864 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.856 7f0e3884d700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0e340fefa0 0x7f0e341b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:23.864 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.856 7f0e3904e700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0e340f6390 0x7f0e340fe970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:23.864 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.856 7f0e3984f700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0e340ff3f0 0x7f0e341b1a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38452/0 (socket says 172.21.15.22:38452) 2022-04-28T14:39:23.864 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.856 7f0e3984f700 1 -- 172.21.15.22:0/419290137 learned_addr learned my addr 172.21.15.22:0/419290137 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:39:23.864 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.857 7f0e27fff700 1 -- 172.21.15.22:0/419290137 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1595115003 0 0) 0x7f0e2c001490 con 0x7f0e340ff3f0 2022-04-28T14:39:23.864 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.857 7f0e3884d700 1 -- 172.21.15.22:0/419290137 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0e340f6390 msgr2=0x7f0e340fe970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:23.864 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.857 7f0e3884d700 1 --2- 172.21.15.22:0/419290137 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0e340f6390 0x7f0e340fe970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.864 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.857 7f0e3884d700 1 -- 172.21.15.22:0/419290137 >> v1:172.21.15.22:6789/0 conn(0x7f0e340ff3f0 legacy=0x7f0e341b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:23.865 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.857 7f0e3884d700 1 -- 172.21.15.22:0/419290137 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3410b7d0 con 0x7f0e340fefa0 2022-04-28T14:39:23.865 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.857 7f0e3904e700 1 --2- 172.21.15.22:0/419290137 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0e340f6390 0x7f0e340fe970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:23.865 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.857 7f0e3884d700 1 --2- 172.21.15.22:0/419290137 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0e340fefa0 0x7f0e341b1460 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f0e30002f70 tx=0x7f0e3000ba20).ready entity=mon.1 client_cookie=e40a7a6f47b1ed22 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:23.865 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.857 7f0e27fff700 1 -- 172.21.15.22:0/419290137 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0e3410b7d0 con 0x7f0e340fefa0 2022-04-28T14:39:23.865 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.857 7f0e27fff700 1 -- 172.21.15.22:0/419290137 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3000d570 con 0x7f0e340fefa0 2022-04-28T14:39:23.865 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.857 7f0e27fff700 1 -- 172.21.15.22:0/419290137 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0e3000d940 con 0x7f0e340fefa0 2022-04-28T14:39:23.865 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.857 7f0e3c24f700 1 -- 172.21.15.22:0/419290137 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0e340fefa0 msgr2=0x7f0e341b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:23.865 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.857 7f0e3c24f700 1 --2- 172.21.15.22:0/419290137 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0e340fefa0 0x7f0e341b1460 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f0e30002f70 tx=0x7f0e3000ba20).stop 2022-04-28T14:39:23.865 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.858 7f0e3c24f700 1 -- 172.21.15.22:0/419290137 shutdown_connections 2022-04-28T14:39:23.866 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.858 7f0e3c24f700 1 --2- 172.21.15.22:0/419290137 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0e340f6390 0x7f0e340fe970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.866 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.858 7f0e3c24f700 1 --2- 172.21.15.22:0/419290137 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0e340fefa0 0x7f0e341b1460 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.866 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.858 7f0e3c24f700 1 -- 172.21.15.22:0/419290137 >> 172.21.15.22:0/419290137 conn(0x7f0e34117120 msgr2=0x7f0e340f2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:23.866 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.858 7f0e3c24f700 1 -- 172.21.15.22:0/419290137 shutdown_connections 2022-04-28T14:39:23.866 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.858 7f0e3c24f700 1 -- 172.21.15.22:0/419290137 wait complete. 2022-04-28T14:39:23.888 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.882 7f0e3c24f700 1 Processor -- start 2022-04-28T14:39:23.889 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.882 7f0e3c24f700 1 -- start start 2022-04-28T14:39:23.889 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.882 7f0e3c24f700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0e340cc0c0 0x7f0e341c5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:23.889 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.882 7f0e3c24f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e340cc510 0x7f0e341c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:23.889 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.882 7f0e3c24f700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0e340b2640 0x7f0e340b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:23.889 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.882 7f0e3c24f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e340d5100 con 0x7f0e340cc510 2022-04-28T14:39:23.889 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.882 7f0e3c24f700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e34121bc0 con 0x7f0e340b2640 2022-04-28T14:39:23.889 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.882 7f0e3c24f700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e340d5420 con 0x7f0e340cc0c0 2022-04-28T14:39:23.890 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.882 7f0e3904e700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0e340cc0c0 0x7f0e341c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:23.890 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.882 7f0e3984f700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0e340b2640 0x7f0e340b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:23.890 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.882 7f0e3884d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e340cc510 0x7f0e341c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:23.890 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.882 7f0e3904e700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0e340cc0c0 0x7f0e341c5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46414/0 (socket says 172.21.15.22:46414) 2022-04-28T14:39:23.890 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.882 7f0e3904e700 1 -- 172.21.15.22:0/2803495456 learned_addr learned my addr 172.21.15.22:0/2803495456 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:23.890 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.882 7f0e3904e700 1 -- 172.21.15.22:0/2803495456 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0e340b2640 msgr2=0x7f0e340b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:23.890 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.883 7f0e3904e700 1 --2- 172.21.15.22:0/2803495456 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0e340b2640 0x7f0e340b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.890 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.883 7f0e3904e700 1 -- 172.21.15.22:0/2803495456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e340cc510 msgr2=0x7f0e341c5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:23.890 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.883 7f0e3904e700 1 --2- 172.21.15.22:0/2803495456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e340cc510 0x7f0e341c5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.890 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.883 7f0e3904e700 1 -- 172.21.15.22:0/2803495456 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e341c61a0 con 0x7f0e340cc0c0 2022-04-28T14:39:23.891 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.883 7f0e3884d700 1 --2- 172.21.15.22:0/2803495456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e340cc510 0x7f0e341c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:23.891 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.883 7f0e3904e700 1 --2- 172.21.15.22:0/2803495456 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0e340cc0c0 0x7f0e341c5540 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f0e340ca500 tx=0x7f0e2800bf70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:23.891 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.883 7f0e267fc700 1 -- 172.21.15.22:0/2803495456 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0e341c61a0 con 0x7f0e340cc0c0 2022-04-28T14:39:23.891 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.883 7f0e267fc700 1 -- 172.21.15.22:0/2803495456 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2800ee60 con 0x7f0e340cc0c0 2022-04-28T14:39:23.891 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.883 7f0e3c24f700 1 -- 172.21.15.22:0/2803495456 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e340b30c0 con 0x7f0e340cc0c0 2022-04-28T14:39:23.891 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.883 7f0e267fc700 1 -- 172.21.15.22:0/2803495456 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0e2800f040 con 0x7f0e340cc0c0 2022-04-28T14:39:23.891 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.883 7f0e3c24f700 1 -- 172.21.15.22:0/2803495456 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e341cc8a0 con 0x7f0e340cc0c0 2022-04-28T14:39:23.891 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.883 7f0e267fc700 1 -- 172.21.15.22:0/2803495456 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f0e28011070 con 0x7f0e340cc0c0 2022-04-28T14:39:23.891 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.884 7f0e267fc700 1 -- 172.21.15.22:0/2803495456 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f0e28010040 con 0x7f0e340cc0c0 2022-04-28T14:39:23.892 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.884 7f0e3c24f700 1 -- 172.21.15.22:0/2803495456 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e340f02c0 con 0x7f0e340cc0c0 2022-04-28T14:39:23.892 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.887 7f0e267fc700 1 -- 172.21.15.22:0/2803495456 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f0e2800c620 con 0x7f0e340cc0c0 2022-04-28T14:39:23.989 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.985 7f0e3c24f700 1 -- 172.21.15.22:0/2803495456 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e340d5c20 con 0x7f0e340cc0c0 2022-04-28T14:39:23.990 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.985 7f0e267fc700 1 -- 172.21.15.22:0/2803495456 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8815 (secure 0 0 0) 0x7f0e28000c30 con 0x7f0e340cc0c0 2022-04-28T14:39:23.990 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:23.990 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":16,"fsid":"3047163a-0285-4058-8e05-ce74c6fbb9c5","created":"2022-04-28 14:38:54.232890","modified":"2022-04-28 14:39:14.929380","last_up_change":"2022-04-28 14:39:00.269721","last_in_change":"2022-04-28 14:39:00.269721","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-04-28 14:39:03.639717","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-04-28 14:39:12.000229","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-04-28 14:39:12.915097","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782ee638-1ada-48d9-9454-f9e0ca8a3135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6800","nonce":87556}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":87556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":87556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":87556}]},"public_addr":"172.21.15.22:6800/87556","cluster_addr":"172.21.15.22:6801/87556","heartbeat_back_addr":"172.21.15.22:6803/87556","heartbeat_front_addr":"172.21.15.22:6802/87556","state":["exists","up"]},{"osd":1,"uuid":"61ca6f96-fb4f-4c0f-b68b-edf1e7011f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":87557}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":87557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":87557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":87557}]},"public_addr":"172.21.15.22:6804/87557","cluster_addr":"172.21.15.22:6805/87557","heartbeat_back_addr":"172.21.15.22:6807/87557","heartbeat_front_addr":"172.21.15.22:6806/87557","state":["exists","up"]},{"osd":2,"uuid":"4b3043b9-50df-4b7f-a55a-ac8e6148c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":87558}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":87558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":87558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":87558}]},"public_addr":"172.21.15.22:6813/87558","cluster_addr":"172.21.15.22:6814/87558","heartbeat_back_addr":"172.21.15.22:6816/87558","heartbeat_front_addr":"172.21.15.22:6815/87558","state":["exists","up"]},{"osd":3,"uuid":"7807bcd1-53f8-44b5-9992-57c328e5b299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":87561}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":87561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":87561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":87561}]},"public_addr":"172.21.15.22:6809/87561","cluster_addr":"172.21.15.22:6810/87561","heartbeat_back_addr":"172.21.15.22:6812/87561","heartbeat_front_addr":"172.21.15.22:6811/87561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-04-28T14:39:23.991 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.986 7f0e3c24f700 1 -- 172.21.15.22:0/2803495456 >> v1:172.21.15.22:6808/86956 conn(0x7f0e1401c1b0 legacy=0x7f0e1401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:23.991 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.986 7f0e3c24f700 1 -- 172.21.15.22:0/2803495456 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0e340cc0c0 msgr2=0x7f0e341c5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.986 7f0e3c24f700 1 --2- 172.21.15.22:0/2803495456 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0e340cc0c0 0x7f0e341c5540 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f0e340ca500 tx=0x7f0e2800bf70).stop 2022-04-28T14:39:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.986 7f0e3c24f700 1 -- 172.21.15.22:0/2803495456 shutdown_connections 2022-04-28T14:39:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.986 7f0e3c24f700 1 --2- 172.21.15.22:0/2803495456 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0e340b2640 0x7f0e340b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.986 7f0e3c24f700 1 --2- 172.21.15.22:0/2803495456 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0e340cc0c0 0x7f0e341c5540 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.986 7f0e3c24f700 1 --2- 172.21.15.22:0/2803495456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e340cc510 0x7f0e341c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.986 7f0e3c24f700 1 -- 172.21.15.22:0/2803495456 >> 172.21.15.22:0/2803495456 conn(0x7f0e340e08e0 msgr2=0x7f0e341b9530 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.986 7f0e3c24f700 1 -- 172.21.15.22:0/2803495456 shutdown_connections 2022-04-28T14:39:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:23.987 7f0e3c24f700 1 -- 172.21.15.22:0/2803495456 wait complete. 2022-04-28T14:39:24.002 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2022-04-28 14:39:03.639717', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2022-04-28 14:39:12.000229', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2022-04-28 14:39:12.915097', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-04-28T14:39:24.003 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-04-28T14:39:24.138 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.130 7f2c38085700 1 Processor -- start 2022-04-28T14:39:24.138 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.130 7f2c38085700 1 -- start start 2022-04-28T14:39:24.138 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.130 7f2c38085700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2c300f6360 0x7f2c300fe940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:24.138 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.131 7f2c38085700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2c300ff3c0 0x7f2c301b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:24.138 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.131 7f2c38085700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c300ab080 con 0x7f2c300fef70 2022-04-28T14:39:24.138 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.131 7f2c38085700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c301b2260 con 0x7f2c300f6360 2022-04-28T14:39:24.139 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.131 7f2c38085700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c30115da0 con 0x7f2c300ff3c0 2022-04-28T14:39:24.139 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.131 7f2c35685700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2c300ff3c0 0x7f2c301b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:24.139 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.131 7f2c35685700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2c300ff3c0 0x7f2c301b1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46642/0 (socket says 172.21.15.22:46642) 2022-04-28T14:39:24.139 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.131 7f2c34e84700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2c300f6360 0x7f2c300fe940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:24.139 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.131 7f2c2ffff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2c300fef70 0x7f2c301b1430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38468/0 (socket says 172.21.15.22:38468) 2022-04-28T14:39:24.139 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.131 7f2c35685700 1 -- 172.21.15.22:0/2830225503 learned_addr learned my addr 172.21.15.22:0/2830225503 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:24.139 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.131 7f2c34e84700 1 -- 172.21.15.22:0/2830225503 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2c300ff3c0 msgr2=0x7f2c301b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:24.139 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.131 7f2c34e84700 1 --2- 172.21.15.22:0/2830225503 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2c300ff3c0 0x7f2c301b1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.139 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.131 7f2c34e84700 1 -- 172.21.15.22:0/2830225503 >> v1:172.21.15.22:6789/0 conn(0x7f2c300fef70 legacy=0x7f2c301b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.131 7f2c34e84700 1 -- 172.21.15.22:0/2830225503 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3010b7a0 con 0x7f2c300f6360 2022-04-28T14:39:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.131 7f2c2f7fe700 1 -- 172.21.15.22:0/2830225503 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1396473739 0 0) 0x7f2c18001110 con 0x7f2c300fef70 2022-04-28T14:39:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.131 7f2c35685700 1 --2- 172.21.15.22:0/2830225503 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2c300ff3c0 0x7f2c301b1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.131 7f2c34e84700 1 --2- 172.21.15.22:0/2830225503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c300f6360 0x7f2c300fe940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f2c20002f70 tx=0x7f2c2000b9f0).ready entity=mon.0 client_cookie=a794c5b2922e362f server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.131 7f2c2f7fe700 1 -- 172.21.15.22:0/2830225503 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2c3010b7a0 con 0x7f2c300f6360 2022-04-28T14:39:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.131 7f2c2f7fe700 1 -- 172.21.15.22:0/2830225503 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2000d5c0 con 0x7f2c300f6360 2022-04-28T14:39:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.131 7f2c2f7fe700 1 -- 172.21.15.22:0/2830225503 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2c2000d990 con 0x7f2c300f6360 2022-04-28T14:39:24.140 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.131 7f2c38085700 1 -- 172.21.15.22:0/2830225503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c300f6360 msgr2=0x7f2c300fe940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:24.141 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.131 7f2c38085700 1 --2- 172.21.15.22:0/2830225503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c300f6360 0x7f2c300fe940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f2c20002f70 tx=0x7f2c2000b9f0).stop 2022-04-28T14:39:24.141 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.132 7f2c38085700 1 -- 172.21.15.22:0/2830225503 shutdown_connections 2022-04-28T14:39:24.141 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.132 7f2c38085700 1 --2- 172.21.15.22:0/2830225503 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2c300ff3c0 0x7f2c301b1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.141 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.132 7f2c38085700 1 --2- 172.21.15.22:0/2830225503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c300f6360 0x7f2c300fe940 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.141 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.132 7f2c38085700 1 -- 172.21.15.22:0/2830225503 >> 172.21.15.22:0/2830225503 conn(0x7f2c301170f0 msgr2=0x7f2c300f2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:24.141 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.132 7f2c38085700 1 -- 172.21.15.22:0/2830225503 shutdown_connections 2022-04-28T14:39:24.141 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.132 7f2c38085700 1 -- 172.21.15.22:0/2830225503 wait complete. 2022-04-28T14:39:24.160 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.156 7f2c38085700 1 Processor -- start 2022-04-28T14:39:24.161 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.156 7f2c38085700 1 -- start start 2022-04-28T14:39:24.163 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.157 7f2c38085700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2c300b6810 0x7f2c301c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:24.164 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.157 7f2c38085700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2c301c6460 0x7f2c300b76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:24.164 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.157 7f2c38085700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c300b7d20 0x7f2c300b8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:24.164 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.157 7f2c38085700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c300bd970 con 0x7f2c300b7d20 2022-04-28T14:39:24.164 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.157 7f2c38085700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c300b6620 con 0x7f2c300b6810 2022-04-28T14:39:24.164 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.157 7f2c38085700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c300b63b0 con 0x7f2c301c6460 2022-04-28T14:39:24.164 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.157 7f2c34e84700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2c300b6810 0x7f2c301c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:24.164 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.157 7f2c35685700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c300b7d20 0x7f2c300b8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:24.164 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.157 7f2c34e84700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2c300b6810 0x7f2c301c5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46644/0 (socket says 172.21.15.22:46644) 2022-04-28T14:39:24.165 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.157 7f2c2ffff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2c301c6460 0x7f2c300b76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:24.165 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.157 7f2c34e84700 1 -- 172.21.15.22:0/3795154298 learned_addr learned my addr 172.21.15.22:0/3795154298 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:24.165 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.157 7f2c34e84700 1 -- 172.21.15.22:0/3795154298 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2c301c6460 msgr2=0x7f2c300b76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:24.165 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.157 7f2c34e84700 1 --2- 172.21.15.22:0/3795154298 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2c301c6460 0x7f2c300b76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.165 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.157 7f2c34e84700 1 -- 172.21.15.22:0/3795154298 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c300b7d20 msgr2=0x7f2c300b8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:24.165 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.157 7f2c34e84700 1 --2- 172.21.15.22:0/3795154298 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c300b7d20 0x7f2c300b8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.165 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.157 7f2c34e84700 1 -- 172.21.15.22:0/3795154298 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c300cb890 con 0x7f2c300b6810 2022-04-28T14:39:24.165 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.157 7f2c35685700 1 --2- 172.21.15.22:0/3795154298 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c300b7d20 0x7f2c300b8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:24.165 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.157 7f2c34e84700 1 --2- 172.21.15.22:0/3795154298 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2c300b6810 0x7f2c301c5e30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f2c20002f70 tx=0x7f2c200068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:24.166 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.157 7f2c2dffb700 1 -- 172.21.15.22:0/3795154298 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2c300cb890 con 0x7f2c300b6810 2022-04-28T14:39:24.166 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.157 7f2c2dffb700 1 -- 172.21.15.22:0/3795154298 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c20006a90 con 0x7f2c300b6810 2022-04-28T14:39:24.166 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.157 7f2c2dffb700 1 -- 172.21.15.22:0/3795154298 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2c20017040 con 0x7f2c300b6810 2022-04-28T14:39:24.166 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.157 7f2c38085700 1 -- 172.21.15.22:0/3795154298 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c300b87a0 con 0x7f2c300b6810 2022-04-28T14:39:24.166 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.158 7f2c38085700 1 -- 172.21.15.22:0/3795154298 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c300b6e40 con 0x7f2c300b6810 2022-04-28T14:39:24.166 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.158 7f2c2dffb700 1 -- 172.21.15.22:0/3795154298 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f2c20011bb0 con 0x7f2c300b6810 2022-04-28T14:39:24.166 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.158 7f2c2dffb700 1 -- 172.21.15.22:0/3795154298 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f2c20018070 con 0x7f2c300b6810 2022-04-28T14:39:24.166 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.159 7f2c38085700 1 -- 172.21.15.22:0/3795154298 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c300f0290 con 0x7f2c300b6810 2022-04-28T14:39:24.167 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.161 7f2c2dffb700 1 -- 172.21.15.22:0/3795154298 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f2c200117b0 con 0x7f2c300b6810 2022-04-28T14:39:24.263 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.258 7f2c38085700 1 -- 172.21.15.22:0/3795154298 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2c301c6930 con 0x7f2c300b6810 2022-04-28T14:39:24.263 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.259 7f2c2dffb700 1 -- 172.21.15.22:0/3795154298 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2c20000c30 con 0x7f2c300b6810 2022-04-28T14:39:24.264 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2022-04-28T14:39:24.265 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.260 7f2c38085700 1 -- 172.21.15.22:0/3795154298 >> v1:172.21.15.22:6808/86956 conn(0x7f2c1401c1b0 legacy=0x7f2c1401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:24.265 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.260 7f2c38085700 1 -- 172.21.15.22:0/3795154298 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2c300b6810 msgr2=0x7f2c301c5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:24.265 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.260 7f2c38085700 1 --2- 172.21.15.22:0/3795154298 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2c300b6810 0x7f2c301c5e30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f2c20002f70 tx=0x7f2c200068c0).stop 2022-04-28T14:39:24.265 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.260 7f2c38085700 1 -- 172.21.15.22:0/3795154298 shutdown_connections 2022-04-28T14:39:24.265 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.260 7f2c38085700 1 --2- 172.21.15.22:0/3795154298 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2c300b7d20 0x7f2c300b8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.266 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.260 7f2c38085700 1 --2- 172.21.15.22:0/3795154298 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2c300b6810 0x7f2c301c5e30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.266 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.260 7f2c38085700 1 --2- 172.21.15.22:0/3795154298 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2c301c6460 0x7f2c300b76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.266 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.260 7f2c38085700 1 -- 172.21.15.22:0/3795154298 >> 172.21.15.22:0/3795154298 conn(0x7f2c30120760 msgr2=0x7f2c3011f630 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:24.266 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.260 7f2c38085700 1 -- 172.21.15.22:0/3795154298 shutdown_connections 2022-04-28T14:39:24.266 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.260 7f2c38085700 1 -- 172.21.15.22:0/3795154298 wait complete. 2022-04-28T14:39:24.276 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-04-28T14:39:24.410 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.403 7f36b1829700 1 Processor -- start 2022-04-28T14:39:24.410 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.403 7f36b1829700 1 -- start start 2022-04-28T14:39:24.410 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.403 7f36b1829700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36ac0f61e0 0x7f36ac0f1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:24.410 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.403 7f36b1829700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f36ac0f1870 0x7f36ac1b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:24.410 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.403 7f36b1829700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f36ac0f1cc0 0x7f36ac1b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:24.410 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.403 7f36b1829700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36ac10ebb0 con 0x7f36ac0f1870 2022-04-28T14:39:24.410 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.403 7f36b1829700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac116e10 con 0x7f36ac0f61e0 2022-04-28T14:39:24.411 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.403 7f36b1829700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac0f6630 con 0x7f36ac0f1cc0 2022-04-28T14:39:24.411 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.403 7f36aa5c5700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36ac0f61e0 0x7f36ac0f1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:24.411 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.403 7f36aadc6700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f36ac0f1cc0 0x7f36ac1b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:24.411 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.403 7f36a9dc4700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f36ac0f1870 0x7f36ac1b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:24.411 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.403 7f36aadc6700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f36ac0f1cc0 0x7f36ac1b4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46440/0 (socket says 172.21.15.22:46440) 2022-04-28T14:39:24.411 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.403 7f36aa5c5700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36ac0f61e0 0x7f36ac0f1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46652/0 (socket says 172.21.15.22:46652) 2022-04-28T14:39:24.411 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.403 7f36aadc6700 1 -- 172.21.15.22:0/2729437880 learned_addr learned my addr 172.21.15.22:0/2729437880 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:24.411 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.403 7f36a9dc4700 1 --2- 172.21.15.22:0/2729437880 >> v2:172.21.15.22:3300/0 conn(0x7f36ac0f1870 0x7f36ac1b45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49086/0 (socket says 172.21.15.22:49086) 2022-04-28T14:39:24.411 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.404 7f36aadc6700 1 -- 172.21.15.22:0/2729437880 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36ac0f61e0 msgr2=0x7f36ac0f1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:24.411 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.404 7f36aadc6700 1 --2- 172.21.15.22:0/2729437880 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36ac0f61e0 0x7f36ac0f1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.412 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.404 7f36aadc6700 1 -- 172.21.15.22:0/2729437880 >> v2:172.21.15.22:3300/0 conn(0x7f36ac0f1870 msgr2=0x7f36ac1b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:24.412 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.404 7f36aadc6700 1 --2- 172.21.15.22:0/2729437880 >> v2:172.21.15.22:3300/0 conn(0x7f36ac0f1870 0x7f36ac1b45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.412 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.404 7f36aadc6700 1 -- 172.21.15.22:0/2729437880 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac1b5220 con 0x7f36ac0f1cc0 2022-04-28T14:39:24.412 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.404 7f36a9dc4700 1 --2- 172.21.15.22:0/2729437880 >> v2:172.21.15.22:3300/0 conn(0x7f36ac0f1870 0x7f36ac1b45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:24.412 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.404 7f36aadc6700 1 --2- 172.21.15.22:0/2729437880 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f36ac0f1cc0 0x7f36ac1b4bf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f36ac0f3e30 tx=0x7f36a4009d90).ready entity=mon.2 client_cookie=75bdf9893f9d3f44 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:24.412 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.404 7f36a95c3700 1 -- 172.21.15.22:0/2729437880 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f36ac1b5220 con 0x7f36ac0f1cc0 2022-04-28T14:39:24.412 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.404 7f36a95c3700 1 -- 172.21.15.22:0/2729437880 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a400b840 con 0x7f36ac0f1cc0 2022-04-28T14:39:24.412 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.404 7f36a95c3700 1 -- 172.21.15.22:0/2729437880 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f36a400ba20 con 0x7f36ac0f1cc0 2022-04-28T14:39:24.412 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.404 7f36b1829700 1 -- 172.21.15.22:0/2729437880 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f36ac0f1cc0 msgr2=0x7f36ac1b4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:24.413 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.404 7f36b1829700 1 --2- 172.21.15.22:0/2729437880 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f36ac0f1cc0 0x7f36ac1b4bf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f36ac0f3e30 tx=0x7f36a4009d90).stop 2022-04-28T14:39:24.413 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.405 7f36b1829700 1 -- 172.21.15.22:0/2729437880 shutdown_connections 2022-04-28T14:39:24.413 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.405 7f36b1829700 1 --2- 172.21.15.22:0/2729437880 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f36ac0f1cc0 0x7f36ac1b4bf0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.413 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.405 7f36b1829700 1 --2- 172.21.15.22:0/2729437880 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36ac0f61e0 0x7f36ac0f1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.413 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.405 7f36b1829700 1 --2- 172.21.15.22:0/2729437880 >> v2:172.21.15.22:3300/0 conn(0x7f36ac0f1870 0x7f36ac1b45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.413 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.405 7f36b1829700 1 -- 172.21.15.22:0/2729437880 >> 172.21.15.22:0/2729437880 conn(0x7f36ac1170f0 msgr2=0x7f36ac0f2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:24.413 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.405 7f36b1829700 1 -- 172.21.15.22:0/2729437880 shutdown_connections 2022-04-28T14:39:24.413 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.405 7f36b1829700 1 -- 172.21.15.22:0/2729437880 wait complete. 2022-04-28T14:39:24.436 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.429 7f36b1829700 1 Processor -- start 2022-04-28T14:39:24.436 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.429 7f36b1829700 1 -- start start 2022-04-28T14:39:24.436 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.429 7f36b1829700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36ac0b2f20 0x7f36ac0d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:24.436 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.429 7f36b1829700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f36ac0b3370 0x7f36ac0d2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:24.436 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.429 7f36b1829700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36ac1c5250 0x7f36ac1c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:24.436 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.429 7f36b1829700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac0bb010 con 0x7f36ac1c5250 2022-04-28T14:39:24.436 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.429 7f36b1829700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac1b7d50 con 0x7f36ac0b2f20 2022-04-28T14:39:24.437 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.429 7f36b1829700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac1b8570 con 0x7f36ac0b3370 2022-04-28T14:39:24.437 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.429 7f36aa5c5700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36ac0b2f20 0x7f36ac0d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:24.437 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.429 7f36aadc6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36ac1c5250 0x7f36ac1c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:24.437 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.429 7f36aa5c5700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36ac0b2f20 0x7f36ac0d1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46658/0 (socket says 172.21.15.22:46658) 2022-04-28T14:39:24.437 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.429 7f36aadc6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36ac1c5250 0x7f36ac1c56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49092/0 (socket says 172.21.15.22:49092) 2022-04-28T14:39:24.437 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.429 7f36aa5c5700 1 -- 172.21.15.22:0/3484337311 learned_addr learned my addr 172.21.15.22:0/3484337311 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:24.437 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.429 7f36a9dc4700 1 --2- 172.21.15.22:0/3484337311 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f36ac0b3370 0x7f36ac0d2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:24.437 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.430 7f36aa5c5700 1 -- 172.21.15.22:0/3484337311 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f36ac0b3370 msgr2=0x7f36ac0d2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:24.437 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.430 7f36aa5c5700 1 --2- 172.21.15.22:0/3484337311 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f36ac0b3370 0x7f36ac0d2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.437 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.430 7f36aa5c5700 1 -- 172.21.15.22:0/3484337311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36ac1c5250 msgr2=0x7f36ac1c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:24.438 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.430 7f36aa5c5700 1 --2- 172.21.15.22:0/3484337311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36ac1c5250 0x7f36ac1c56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.438 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.430 7f36aa5c5700 1 -- 172.21.15.22:0/3484337311 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac1b81b0 con 0x7f36ac0b2f20 2022-04-28T14:39:24.438 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.430 7f36aadc6700 1 --2- 172.21.15.22:0/3484337311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36ac1c5250 0x7f36ac1c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:24.438 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.430 7f36aa5c5700 1 --2- 172.21.15.22:0/3484337311 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36ac0b2f20 0x7f36ac0d1c40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f369c00c000 tx=0x7f369c00eb90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:24.438 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.430 7f369b7fe700 1 -- 172.21.15.22:0/3484337311 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f36ac1b81b0 con 0x7f36ac0b2f20 2022-04-28T14:39:24.438 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.430 7f369b7fe700 1 -- 172.21.15.22:0/3484337311 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369c00c7f0 con 0x7f36ac0b2f20 2022-04-28T14:39:24.438 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.430 7f369b7fe700 1 -- 172.21.15.22:0/3484337311 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f369c00f040 con 0x7f36ac0b2f20 2022-04-28T14:39:24.438 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.430 7f36b1829700 1 -- 172.21.15.22:0/3484337311 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ac0d28a0 con 0x7f36ac0b2f20 2022-04-28T14:39:24.438 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.430 7f36b1829700 1 -- 172.21.15.22:0/3484337311 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ac1c5eb0 con 0x7f36ac0b2f20 2022-04-28T14:39:24.439 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.431 7f369b7fe700 1 -- 172.21.15.22:0/3484337311 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f369c011070 con 0x7f36ac0b2f20 2022-04-28T14:39:24.439 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.431 7f369b7fe700 1 -- 172.21.15.22:0/3484337311 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f369c010040 con 0x7f36ac0b2f20 2022-04-28T14:39:24.439 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.431 7f36b1829700 1 -- 172.21.15.22:0/3484337311 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ac0f0290 con 0x7f36ac0b2f20 2022-04-28T14:39:24.439 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.434 7f369b7fe700 1 -- 172.21.15.22:0/3484337311 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f369c00c3f0 con 0x7f36ac0b2f20 2022-04-28T14:39:24.535 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.530 7f36b1829700 1 -- 172.21.15.22:0/3484337311 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f36ac0ab080 con 0x7f36ac0b2f20 2022-04-28T14:39:24.535 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.530 7f369b7fe700 1 -- 172.21.15.22:0/3484337311 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v16) v1 ==== 104+0+11 (secure 0 0 0) 0x7f369c000c30 con 0x7f36ac0b2f20 2022-04-28T14:39:24.535 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2022-04-28T14:39:24.536 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.531 7f36b1829700 1 -- 172.21.15.22:0/3484337311 >> v1:172.21.15.22:6808/86956 conn(0x7f368801c1b0 legacy=0x7f368801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:24.536 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.531 7f36b1829700 1 -- 172.21.15.22:0/3484337311 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36ac0b2f20 msgr2=0x7f36ac0d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:24.537 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.531 7f36b1829700 1 --2- 172.21.15.22:0/3484337311 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36ac0b2f20 0x7f36ac0d1c40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f369c00c000 tx=0x7f369c00eb90).stop 2022-04-28T14:39:24.537 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.531 7f36b1829700 1 -- 172.21.15.22:0/3484337311 shutdown_connections 2022-04-28T14:39:24.537 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.531 7f36b1829700 1 --2- 172.21.15.22:0/3484337311 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36ac1c5250 0x7f36ac1c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.537 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.531 7f36b1829700 1 --2- 172.21.15.22:0/3484337311 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36ac0b2f20 0x7f36ac0d1c40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.537 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.531 7f36b1829700 1 --2- 172.21.15.22:0/3484337311 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f36ac0b3370 0x7f36ac0d2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.537 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.531 7f36b1829700 1 -- 172.21.15.22:0/3484337311 >> 172.21.15.22:0/3484337311 conn(0x7f36ac0d5f10 msgr2=0x7f36ac0ad3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:24.537 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.531 7f36b1829700 1 -- 172.21.15.22:0/3484337311 shutdown_connections 2022-04-28T14:39:24.537 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.531 7f36b1829700 1 -- 172.21.15.22:0/3484337311 wait complete. 2022-04-28T14:39:24.547 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-04-28T14:39:24.683 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.676 7f016bc25700 1 Processor -- start 2022-04-28T14:39:24.741 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.676 7f016bc25700 1 -- start start 2022-04-28T14:39:24.742 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.677 7f016bc25700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f01640f62c0 0x7f01640f1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:24.742 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.677 7f016bc25700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f01640f1da0 0x7f01641b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:24.742 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.677 7f016bc25700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01640ab280 con 0x7f01640f1950 2022-04-28T14:39:24.742 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.677 7f016bc25700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f016410ec90 con 0x7f01640f62c0 2022-04-28T14:39:24.742 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.677 7f016bc25700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01641b54d0 con 0x7f01640f1da0 2022-04-28T14:39:24.742 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.677 7f0168a24700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f01640f62c0 0x7f01640f1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:24.742 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.677 7f0169225700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f01640f1da0 0x7f01641b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:24.742 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.677 7f0163fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f01640f1950 0x7f01641b46a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38494/0 (socket says 172.21.15.22:38494) 2022-04-28T14:39:24.742 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.677 7f0163fff700 1 -- 172.21.15.22:0/1090010502 learned_addr learned my addr 172.21.15.22:0/1090010502 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:39:24.743 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.677 7f0168a24700 1 -- 172.21.15.22:0/1090010502 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f01640f1da0 msgr2=0x7f01641b4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:24.743 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.677 7f0168a24700 1 --2- 172.21.15.22:0/1090010502 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f01640f1da0 0x7f01641b4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.743 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.677 7f0168a24700 1 -- 172.21.15.22:0/1090010502 >> v1:172.21.15.22:6789/0 conn(0x7f01640f1950 legacy=0x7f01641b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:24.743 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.677 7f0168a24700 1 -- 172.21.15.22:0/1090010502 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0164116ef0 con 0x7f01640f62c0 2022-04-28T14:39:24.743 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.677 7f01637fe700 1 -- 172.21.15.22:0/1090010502 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3809242782 0 0) 0x7f0150001110 con 0x7f01640f1950 2022-04-28T14:39:24.743 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.677 7f0169225700 1 --2- 172.21.15.22:0/1090010502 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f01640f1da0 0x7f01641b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:24.743 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.677 7f0168a24700 1 --2- 172.21.15.22:0/1090010502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01640f62c0 0x7f01640f1320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f0158002f70 tx=0x7f015800b9f0).ready entity=mon.0 client_cookie=2f6f04bd0584c996 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:24.743 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.677 7f01637fe700 1 -- 172.21.15.22:0/1090010502 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0164116ef0 con 0x7f01640f62c0 2022-04-28T14:39:24.743 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.677 7f01637fe700 1 -- 172.21.15.22:0/1090010502 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015800d5c0 con 0x7f01640f62c0 2022-04-28T14:39:24.744 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.678 7f01637fe700 1 -- 172.21.15.22:0/1090010502 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f015800d990 con 0x7f01640f62c0 2022-04-28T14:39:24.744 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.678 7f016bc25700 1 -- 172.21.15.22:0/1090010502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01640f62c0 msgr2=0x7f01640f1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:24.744 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.678 7f016bc25700 1 --2- 172.21.15.22:0/1090010502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01640f62c0 0x7f01640f1320 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f0158002f70 tx=0x7f015800b9f0).stop 2022-04-28T14:39:24.744 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.678 7f016bc25700 1 -- 172.21.15.22:0/1090010502 shutdown_connections 2022-04-28T14:39:24.744 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.678 7f016bc25700 1 --2- 172.21.15.22:0/1090010502 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f01640f1da0 0x7f01641b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.744 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.678 7f016bc25700 1 --2- 172.21.15.22:0/1090010502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01640f62c0 0x7f01640f1320 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.744 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.678 7f016bc25700 1 -- 172.21.15.22:0/1090010502 >> 172.21.15.22:0/1090010502 conn(0x7f01641171d0 msgr2=0x7f01640f2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:24.744 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.678 7f016bc25700 1 -- 172.21.15.22:0/1090010502 shutdown_connections 2022-04-28T14:39:24.744 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.678 7f016bc25700 1 -- 172.21.15.22:0/1090010502 wait complete. 2022-04-28T14:39:24.748 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.702 7f016bc25700 1 Processor -- start 2022-04-28T14:39:24.748 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.702 7f016bc25700 1 -- start start 2022-04-28T14:39:24.748 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.703 7f016bc25700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f01640b70a0 0x7f01640d1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:24.748 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.703 7f016bc25700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f01640d2390 0x7f01641c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:24.748 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.703 7f016bc25700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01640d27e0 0x7f01641c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:24.748 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.703 7f016bc25700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01640f6490 con 0x7f01640d27e0 2022-04-28T14:39:24.748 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.703 7f016bc25700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01641b7fc0 con 0x7f01640b70a0 2022-04-28T14:39:24.749 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.703 7f016bc25700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01640b68c0 con 0x7f01640d2390 2022-04-28T14:39:24.749 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.703 7f0168a24700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f01640b70a0 0x7f01640d1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:24.749 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.703 7f0163fff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f01640d2390 0x7f01641c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:24.749 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.703 7f0169225700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01640d27e0 0x7f01641c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:24.749 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.703 7f0168a24700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f01640b70a0 0x7f01640d1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46672/0 (socket says 172.21.15.22:46672) 2022-04-28T14:39:24.749 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.703 7f0168a24700 1 -- 172.21.15.22:0/1678587688 learned_addr learned my addr 172.21.15.22:0/1678587688 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:24.749 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.703 7f0163fff700 1 -- 172.21.15.22:0/1678587688 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f01640b70a0 msgr2=0x7f01640d1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:24.749 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.703 7f0163fff700 1 --2- 172.21.15.22:0/1678587688 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f01640b70a0 0x7f01640d1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.749 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.703 7f0163fff700 1 -- 172.21.15.22:0/1678587688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01640d27e0 msgr2=0x7f01641c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:24.750 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.703 7f0163fff700 1 --2- 172.21.15.22:0/1678587688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01640d27e0 0x7f01641c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.750 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.703 7f0163fff700 1 -- 172.21.15.22:0/1678587688 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01641b85a0 con 0x7f01640d2390 2022-04-28T14:39:24.750 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.704 7f0169225700 1 --2- 172.21.15.22:0/1678587688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01640d27e0 0x7f01641c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:24.750 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.704 7f0168a24700 1 --2- 172.21.15.22:0/1678587688 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f01640b70a0 0x7f01640d1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:24.750 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.704 7f0163fff700 1 --2- 172.21.15.22:0/1678587688 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f01640d2390 0x7f01641c51a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f0150000bc0 tx=0x7f015000c750).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:24.750 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.704 7f0161ffb700 1 -- 172.21.15.22:0/1678587688 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f01641b85a0 con 0x7f01640d2390 2022-04-28T14:39:24.750 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.704 7f0161ffb700 1 -- 172.21.15.22:0/1678587688 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01500070d0 con 0x7f01640d2390 2022-04-28T14:39:24.750 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.704 7f016bc25700 1 -- 172.21.15.22:0/1678587688 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01640b7990 con 0x7f01640d2390 2022-04-28T14:39:24.750 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.704 7f0161ffb700 1 -- 172.21.15.22:0/1678587688 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f0150005620 con 0x7f01640d2390 2022-04-28T14:39:24.751 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.704 7f016bc25700 1 -- 172.21.15.22:0/1678587688 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01640b74f0 con 0x7f01640d2390 2022-04-28T14:39:24.751 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.704 7f0161ffb700 1 -- 172.21.15.22:0/1678587688 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f015001b070 con 0x7f01640d2390 2022-04-28T14:39:24.751 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.704 7f0161ffb700 1 -- 172.21.15.22:0/1678587688 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f0150028cc0 con 0x7f01640d2390 2022-04-28T14:39:24.751 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.705 7f016bc25700 1 -- 172.21.15.22:0/1678587688 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01640f0370 con 0x7f01640d2390 2022-04-28T14:39:24.751 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.708 7f0161ffb700 1 -- 172.21.15.22:0/1678587688 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f015000cdc0 con 0x7f01640d2390 2022-04-28T14:39:24.810 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.805 7f016bc25700 1 -- 172.21.15.22:0/1678587688 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f01640efa40 con 0x7f01640d2390 2022-04-28T14:39:24.810 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.806 7f0161ffb700 1 -- 172.21.15.22:0/1678587688 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v16) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0150000c30 con 0x7f01640d2390 2022-04-28T14:39:24.811 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2022-04-28T14:39:24.812 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.807 7f016bc25700 1 -- 172.21.15.22:0/1678587688 >> v1:172.21.15.22:6808/86956 conn(0x7f014c01c1b0 legacy=0x7f014c01e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:24.812 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.807 7f016bc25700 1 -- 172.21.15.22:0/1678587688 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f01640d2390 msgr2=0x7f01641c51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:24.812 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.807 7f016bc25700 1 --2- 172.21.15.22:0/1678587688 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f01640d2390 0x7f01641c51a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f0150000bc0 tx=0x7f015000c750).stop 2022-04-28T14:39:24.812 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.807 7f016bc25700 1 -- 172.21.15.22:0/1678587688 shutdown_connections 2022-04-28T14:39:24.813 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.807 7f016bc25700 1 --2- 172.21.15.22:0/1678587688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01640d27e0 0x7f01641c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.813 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.807 7f016bc25700 1 --2- 172.21.15.22:0/1678587688 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f01640b70a0 0x7f01640d1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.813 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.807 7f016bc25700 1 --2- 172.21.15.22:0/1678587688 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f01640d2390 0x7f01641c51a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.813 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.807 7f016bc25700 1 -- 172.21.15.22:0/1678587688 >> 172.21.15.22:0/1678587688 conn(0x7f01640d60a0 msgr2=0x7f01640ad360 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:24.813 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.807 7f016bc25700 1 -- 172.21.15.22:0/1678587688 shutdown_connections 2022-04-28T14:39:24.813 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.807 7f016bc25700 1 -- 172.21.15.22:0/1678587688 wait complete. 2022-04-28T14:39:24.823 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-04-28T14:39:24.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.947 7fa3f83d5700 1 Processor -- start 2022-04-28T14:39:24.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.947 7fa3f83d5700 1 -- start start 2022-04-28T14:39:24.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.948 7fa3f83d5700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa3f00ff240 0x7fa3f01b6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:24.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.948 7fa3f83d5700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa3f01b6eb0 0x7fa3f01b9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:24.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.948 7fa3f83d5700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f00ab2b0 con 0x7fa3f00f6460 2022-04-28T14:39:24.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.948 7fa3f83d5700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f0115ea0 con 0x7fa3f00ff240 2022-04-28T14:39:24.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.948 7fa3f83d5700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f010b8a0 con 0x7fa3f01b6eb0 2022-04-28T14:39:24.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.948 7fa3f49d3700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa3f00ff240 0x7fa3f01b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:24.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.948 7fa3f51d4700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa3f00f6460 0x7fa3f00fea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38508/0 (socket says 172.21.15.22:38508) 2022-04-28T14:39:24.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.948 7fa3f51d4700 1 -- 172.21.15.22:0/1040439439 learned_addr learned my addr 172.21.15.22:0/1040439439 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:39:24.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.948 7fa3f59d5700 1 --2- 172.21.15.22:0/1040439439 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa3f01b6eb0 0x7fa3f01b9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:24.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.948 7fa3e3fff700 1 -- 172.21.15.22:0/1040439439 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3094362597 0 0) 0x7fa3ec001110 con 0x7fa3f00f6460 2022-04-28T14:39:24.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.948 7fa3e3fff700 1 -- 172.21.15.22:0/1040439439 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3d8003270 con 0x7fa3f00f6460 2022-04-28T14:39:24.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.948 7fa3f49d3700 1 -- 172.21.15.22:0/1040439439 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa3f01b6eb0 msgr2=0x7fa3f01b9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:24.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.948 7fa3f49d3700 1 --2- 172.21.15.22:0/1040439439 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa3f01b6eb0 0x7fa3f01b9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.948 7fa3f49d3700 1 -- 172.21.15.22:0/1040439439 >> v1:172.21.15.22:6789/0 conn(0x7fa3f00f6460 legacy=0x7fa3f00fea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:24.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.948 7fa3f49d3700 1 -- 172.21.15.22:0/1040439439 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f00f68b0 con 0x7fa3f00ff240 2022-04-28T14:39:24.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.948 7fa3f49d3700 1 --2- 172.21.15.22:0/1040439439 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa3f00ff240 0x7fa3f01b6880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fa3e4002f70 tx=0x7fa3e400ba20).ready entity=mon.1 client_cookie=1e326c8e8820eef7 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:24.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.948 7fa3e3fff700 1 -- 172.21.15.22:0/1040439439 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa3f00f68b0 con 0x7fa3f00ff240 2022-04-28T14:39:24.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.948 7fa3e3fff700 1 -- 172.21.15.22:0/1040439439 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e400d570 con 0x7fa3f00ff240 2022-04-28T14:39:24.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.948 7fa3e3fff700 1 -- 172.21.15.22:0/1040439439 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa3e400d940 con 0x7fa3f00ff240 2022-04-28T14:39:24.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.948 7fa3f83d5700 1 -- 172.21.15.22:0/1040439439 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa3f00ff240 msgr2=0x7fa3f01b6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:24.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.948 7fa3f83d5700 1 --2- 172.21.15.22:0/1040439439 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa3f00ff240 0x7fa3f01b6880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fa3e4002f70 tx=0x7fa3e400ba20).stop 2022-04-28T14:39:24.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.949 7fa3f83d5700 1 -- 172.21.15.22:0/1040439439 shutdown_connections 2022-04-28T14:39:24.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.949 7fa3f83d5700 1 --2- 172.21.15.22:0/1040439439 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa3f01b6eb0 0x7fa3f01b9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.949 7fa3f83d5700 1 --2- 172.21.15.22:0/1040439439 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa3f00ff240 0x7fa3f01b6880 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.949 7fa3f83d5700 1 -- 172.21.15.22:0/1040439439 >> 172.21.15.22:0/1040439439 conn(0x7fa3f01171f0 msgr2=0x7fa3f00f2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:24.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.949 7fa3f83d5700 1 -- 172.21.15.22:0/1040439439 shutdown_connections 2022-04-28T14:39:24.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.949 7fa3f83d5700 1 -- 172.21.15.22:0/1040439439 wait complete. 2022-04-28T14:39:24.977 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.973 7fa3f83d5700 1 Processor -- start 2022-04-28T14:39:24.978 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.973 7fa3f83d5700 1 -- start start 2022-04-28T14:39:24.980 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.973 7fa3f83d5700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa3f00cc000 0x7fa3f01c2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:24.980 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.973 7fa3f83d5700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa3f01c27b0 0x7fa3f01c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:24.980 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.973 7fa3f83d5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f01c2c00 0x7fa3f01c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:24.980 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.973 7fa3f83d5700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f00bd150 con 0x7fa3f01c2c00 2022-04-28T14:39:24.980 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.973 7fa3f83d5700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f01b86f0 con 0x7fa3f01c27b0 2022-04-28T14:39:24.980 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.973 7fa3f83d5700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f01b8330 con 0x7fa3f00cc000 2022-04-28T14:39:24.981 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.974 7fa3f51d4700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa3f00cc000 0x7fa3f01c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:24.981 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.974 7fa3f59d5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f01c2c00 0x7fa3f01c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:24.981 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.974 7fa3f51d4700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa3f00cc000 0x7fa3f01c2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46470/0 (socket says 172.21.15.22:46470) 2022-04-28T14:39:24.981 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.974 7fa3f51d4700 1 -- 172.21.15.22:0/1566732610 learned_addr learned my addr 172.21.15.22:0/1566732610 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:24.981 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.974 7fa3f49d3700 1 --2- 172.21.15.22:0/1566732610 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa3f01c27b0 0x7fa3f01c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:24.981 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.974 7fa3f51d4700 1 -- 172.21.15.22:0/1566732610 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa3f01c27b0 msgr2=0x7fa3f01c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:24.981 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.974 7fa3f51d4700 1 --2- 172.21.15.22:0/1566732610 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa3f01c27b0 0x7fa3f01c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.981 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.974 7fa3f51d4700 1 -- 172.21.15.22:0/1566732610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f01c2c00 msgr2=0x7fa3f01c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:24.981 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.974 7fa3f51d4700 1 --2- 172.21.15.22:0/1566732610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f01c2c00 0x7fa3f01c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:24.981 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.974 7fa3f51d4700 1 -- 172.21.15.22:0/1566732610 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f01b7da0 con 0x7fa3f00cc000 2022-04-28T14:39:24.982 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.974 7fa3f49d3700 1 --2- 172.21.15.22:0/1566732610 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa3f01c27b0 0x7fa3f01c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:24.982 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.974 7fa3f51d4700 1 --2- 172.21.15.22:0/1566732610 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa3f00cc000 0x7fa3f01c2180 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fa3ec000ed0 tx=0x7fa3ec00c730).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:24.982 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.974 7fa3e27fc700 1 -- 172.21.15.22:0/1566732610 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa3f01b7da0 con 0x7fa3f00cc000 2022-04-28T14:39:24.982 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.974 7fa3e27fc700 1 -- 172.21.15.22:0/1566732610 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ec0072e0 con 0x7fa3f00cc000 2022-04-28T14:39:24.982 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.974 7fa3f83d5700 1 -- 172.21.15.22:0/1566732610 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f00cc450 con 0x7fa3f00cc000 2022-04-28T14:39:24.982 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.974 7fa3e27fc700 1 -- 172.21.15.22:0/1566732610 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fa3ec005810 con 0x7fa3f00cc000 2022-04-28T14:39:24.982 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.974 7fa3f83d5700 1 -- 172.21.15.22:0/1566732610 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f01c61d0 con 0x7fa3f00cc000 2022-04-28T14:39:24.982 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.975 7fa3e27fc700 1 -- 172.21.15.22:0/1566732610 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fa3ec005a10 con 0x7fa3f00cc000 2022-04-28T14:39:24.982 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.975 7fa3e27fc700 1 -- 172.21.15.22:0/1566732610 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fa3ec0290d0 con 0x7fa3f00cc000 2022-04-28T14:39:24.983 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.975 7fa3f83d5700 1 -- 172.21.15.22:0/1566732610 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f00f0390 con 0x7fa3f00cc000 2022-04-28T14:39:24.983 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:24.978 7fa3e27fc700 1 -- 172.21.15.22:0/1566732610 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fa3ec0070d0 con 0x7fa3f00cc000 2022-04-28T14:39:25.102 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.097 7fa3f83d5700 1 -- 172.21.15.22:0/1566732610 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3f00a5b80 con 0x7fa3f00cc000 2022-04-28T14:39:25.103 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.098 7fa3e27fc700 1 -- 172.21.15.22:0/1566732610 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+2263 (secure 0 0 0) 0x7fa3f01149e0 con 0x7fa3f00cc000 2022-04-28T14:39:25.103 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:25.103 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.22:6818/2291514211","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6818","nonce":2291514211}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-04-28 14:39:13.928436","modified":"2022-04-28 14:39:17.590611","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4184,"mds_1":4198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4184":{"gid":4184,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6819/356491488","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6819","nonce":356491488}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4198":{"gid":4198,"name":"b","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6817/401565232","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6817","nonce":401565232}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-04-28T14:39:25.105 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.099 7fa3f83d5700 1 -- 172.21.15.22:0/1566732610 >> v1:172.21.15.22:6808/86956 conn(0x7fa3d001c1b0 legacy=0x7fa3d001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:25.105 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.099 7fa3f83d5700 1 -- 172.21.15.22:0/1566732610 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa3f00cc000 msgr2=0x7fa3f01c2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:25.105 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.099 7fa3f83d5700 1 --2- 172.21.15.22:0/1566732610 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa3f00cc000 0x7fa3f01c2180 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fa3ec000ed0 tx=0x7fa3ec00c730).stop 2022-04-28T14:39:25.105 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.099 7fa3f83d5700 1 -- 172.21.15.22:0/1566732610 shutdown_connections 2022-04-28T14:39:25.105 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.099 7fa3f83d5700 1 --2- 172.21.15.22:0/1566732610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa3f01c2c00 0x7fa3f01c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.105 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.099 7fa3f83d5700 1 --2- 172.21.15.22:0/1566732610 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa3f00cc000 0x7fa3f01c2180 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.105 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.099 7fa3f83d5700 1 --2- 172.21.15.22:0/1566732610 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa3f01c27b0 0x7fa3f01c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.106 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.099 7fa3f83d5700 1 -- 172.21.15.22:0/1566732610 >> 172.21.15.22:0/1566732610 conn(0x7fa3f00bd9d0 msgr2=0x7fa3f00e0840 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:25.106 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.099 7fa3f83d5700 1 -- 172.21.15.22:0/1566732610 shutdown_connections 2022-04-28T14:39:25.106 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.099 7fa3f83d5700 1 -- 172.21.15.22:0/1566732610 wait complete. 2022-04-28T14:39:25.106 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 9 2022-04-28T14:39:25.417 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-04-28 14:39:13.928436', 'modified': '2022-04-28 14:39:17.590611', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 4184, 'mds_1': 4198}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4184': {'gid': 4184, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6819/356491488', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6819', 'nonce': 356491488}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4198': {'gid': 4198, 'name': 'b', 'rank': 1, 'incarnation': 8, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6817/401565232', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6817', 'nonce': 401565232}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-04-28T14:39:25.417 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2022-04-28T14:39:25.418 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2022-04-28T14:39:25.556 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.547 7f1deac5c700 1 Processor -- start 2022-04-28T14:39:25.556 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.547 7f1deac5c700 1 -- start start 2022-04-28T14:39:25.556 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.547 7f1deac5c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1de40f64d0 0x7f1de40feab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.556 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.547 7f1deac5c700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1de40ff0e0 0x7f1de41b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.557 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.547 7f1deac5c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1de40ff530 0x7f1de41b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.557 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.547 7f1deac5c700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de4115f10 con 0x7f1de40ff530 2022-04-28T14:39:25.557 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.547 7f1deac5c700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de410b910 con 0x7f1de40ff0e0 2022-04-28T14:39:25.558 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.547 7f1deac5c700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1de40f6920 con 0x7f1de40f64d0 2022-04-28T14:39:25.558 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.548 7f1de3fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1de40ff530 0x7f1de41b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.558 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.548 7f1de37fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1de40f64d0 0x7f1de40feab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.558 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.548 7f1de2ffd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1de40ff0e0 0x7f1de41b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.558 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.548 7f1de37fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1de40f64d0 0x7f1de40feab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46478/0 (socket says 172.21.15.22:46478) 2022-04-28T14:39:25.559 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.548 7f1de3fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1de40ff530 0x7f1de41b1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49130/0 (socket says 172.21.15.22:49130) 2022-04-28T14:39:25.559 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.548 7f1de37fe700 1 -- 172.21.15.22:0/3201188436 learned_addr learned my addr 172.21.15.22:0/3201188436 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:25.559 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.548 7f1de37fe700 1 -- 172.21.15.22:0/3201188436 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1de40ff0e0 msgr2=0x7f1de41b15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:25.559 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.548 7f1de37fe700 1 --2- 172.21.15.22:0/3201188436 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1de40ff0e0 0x7f1de41b15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.559 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.548 7f1de37fe700 1 -- 172.21.15.22:0/3201188436 >> v2:172.21.15.22:3300/0 conn(0x7f1de40ff530 msgr2=0x7f1de41b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:25.559 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.548 7f1de37fe700 1 --2- 172.21.15.22:0/3201188436 >> v2:172.21.15.22:3300/0 conn(0x7f1de40ff530 0x7f1de41b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.560 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.548 7f1de37fe700 1 -- 172.21.15.22:0/3201188436 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de41115c0 con 0x7f1de40f64d0 2022-04-28T14:39:25.560 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.548 7f1de2ffd700 1 --2- 172.21.15.22:0/3201188436 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1de40ff0e0 0x7f1de41b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:25.560 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.548 7f1de3fff700 1 --2- 172.21.15.22:0/3201188436 >> v2:172.21.15.22:3300/0 conn(0x7f1de40ff530 0x7f1de41b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:25.560 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.548 7f1de37fe700 1 --2- 172.21.15.22:0/3201188436 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1de40f64d0 0x7f1de40feab0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f1dd4002f70 tx=0x7f1dd40099d0).ready entity=mon.2 client_cookie=e0c786b5139f4806 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:25.560 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.548 7f1de27fc700 1 -- 172.21.15.22:0/3201188436 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1de41115c0 con 0x7f1de40f64d0 2022-04-28T14:39:25.560 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.548 7f1de27fc700 1 -- 172.21.15.22:0/3201188436 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd400f510 con 0x7f1de40f64d0 2022-04-28T14:39:25.560 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.548 7f1de27fc700 1 -- 172.21.15.22:0/3201188436 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1dd400f6f0 con 0x7f1de40f64d0 2022-04-28T14:39:25.560 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.548 7f1deac5c700 1 -- 172.21.15.22:0/3201188436 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1de40f64d0 msgr2=0x7f1de40feab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:25.560 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.548 7f1deac5c700 1 --2- 172.21.15.22:0/3201188436 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1de40f64d0 0x7f1de40feab0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f1dd4002f70 tx=0x7f1dd40099d0).stop 2022-04-28T14:39:25.561 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.549 7f1deac5c700 1 -- 172.21.15.22:0/3201188436 shutdown_connections 2022-04-28T14:39:25.561 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.549 7f1deac5c700 1 --2- 172.21.15.22:0/3201188436 >> v2:172.21.15.22:3300/0 conn(0x7f1de40ff530 0x7f1de41b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.561 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.549 7f1deac5c700 1 --2- 172.21.15.22:0/3201188436 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1de40f64d0 0x7f1de40feab0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.561 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.549 7f1deac5c700 1 --2- 172.21.15.22:0/3201188436 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1de40ff0e0 0x7f1de41b15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.561 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.549 7f1deac5c700 1 -- 172.21.15.22:0/3201188436 >> 172.21.15.22:0/3201188436 conn(0x7f1de4117260 msgr2=0x7f1de40f2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:25.561 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.549 7f1deac5c700 1 -- 172.21.15.22:0/3201188436 shutdown_connections 2022-04-28T14:39:25.562 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.549 7f1deac5c700 1 -- 172.21.15.22:0/3201188436 wait complete. 2022-04-28T14:39:25.580 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.573 7f1deac5c700 1 Processor -- start 2022-04-28T14:39:25.580 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.573 7f1deac5c700 1 -- start start 2022-04-28T14:39:25.580 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.573 7f1deac5c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1de40d6bd0 0x7f1de40bc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.580 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.573 7f1deac5c700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1de40bc8d0 0x7f1de41c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.580 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.573 7f1deac5c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1de41c6050 0x7f1de41c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.580 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.573 7f1deac5c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de40f3270 con 0x7f1de41c6050 2022-04-28T14:39:25.580 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.573 7f1deac5c700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de40e3dd0 con 0x7f1de40bc8d0 2022-04-28T14:39:25.580 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.573 7f1deac5c700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1de40e0680 con 0x7f1de40d6bd0 2022-04-28T14:39:25.581 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.574 7f1de37fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1de40d6bd0 0x7f1de40bc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.581 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.574 7f1de2ffd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1de40bc8d0 0x7f1de41c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.581 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.574 7f1de3fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1de41c6050 0x7f1de41c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.581 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.574 7f1de37fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1de40d6bd0 0x7f1de40bc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46484/0 (socket says 172.21.15.22:46484) 2022-04-28T14:39:25.581 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.574 7f1de37fe700 1 -- 172.21.15.22:0/551290558 learned_addr learned my addr 172.21.15.22:0/551290558 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:25.581 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.574 7f1de2ffd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1de40bc8d0 0x7f1de41c5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46702/0 (socket says 172.21.15.22:46702) 2022-04-28T14:39:25.581 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.574 7f1de3fff700 1 -- 172.21.15.22:0/551290558 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1de40d6bd0 msgr2=0x7f1de40bc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:25.582 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.574 7f1de3fff700 1 --2- 172.21.15.22:0/551290558 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1de40d6bd0 0x7f1de40bc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.582 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.574 7f1de3fff700 1 -- 172.21.15.22:0/551290558 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1de40bc8d0 msgr2=0x7f1de41c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:25.582 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.574 7f1de3fff700 1 --2- 172.21.15.22:0/551290558 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1de40bc8d0 0x7f1de41c5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.582 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.574 7f1de3fff700 1 -- 172.21.15.22:0/551290558 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de41c3640 con 0x7f1de41c6050 2022-04-28T14:39:25.582 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.574 7f1de2ffd700 1 --2- 172.21.15.22:0/551290558 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1de40bc8d0 0x7f1de41c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:25.583 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.574 7f1de3fff700 1 --2- 172.21.15.22:0/551290558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1de41c6050 0x7f1de41c64a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f1de40d52e0 tx=0x7f1ddc00eda0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:25.583 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.574 7f1de0ff9700 1 -- 172.21.15.22:0/551290558 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1de41c3640 con 0x7f1de41c6050 2022-04-28T14:39:25.583 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.574 7f1de0ff9700 1 -- 172.21.15.22:0/551290558 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ddc00c7b0 con 0x7f1de41c6050 2022-04-28T14:39:25.583 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.574 7f1deac5c700 1 -- 172.21.15.22:0/551290558 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de40d7020 con 0x7f1de41c6050 2022-04-28T14:39:25.584 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.574 7f1de0ff9700 1 -- 172.21.15.22:0/551290558 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1ddc00f040 con 0x7f1de41c6050 2022-04-28T14:39:25.584 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.574 7f1deac5c700 1 -- 172.21.15.22:0/551290558 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de41c0050 con 0x7f1de41c6050 2022-04-28T14:39:25.584 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.575 7f1de0ff9700 1 -- 172.21.15.22:0/551290558 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f1ddc022060 con 0x7f1de41c6050 2022-04-28T14:39:25.584 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.575 7f1de0ff9700 1 -- 172.21.15.22:0/551290558 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f1ddc010040 con 0x7f1de41c6050 2022-04-28T14:39:25.593 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.578 7f1dfd4bbb80 1 Processor -- start 2022-04-28T14:39:25.593 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.578 7f1dfd4bbb80 1 -- start start 2022-04-28T14:39:25.593 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.578 7f1dfd4bbb80 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55a7f0e60430 0x55a7f0e83610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.594 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.578 7f1dfd4bbb80 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55a7f0e83c40 0x55a7f0e8fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.594 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.578 7f1dfd4bbb80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a7f0e84090 0x55a7f0e90470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.594 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.578 7f1dfd4bbb80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7f0da0480 con 0x55a7f0e84090 2022-04-28T14:39:25.594 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.578 7f1dfd4bbb80 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a7f0bd51e0 con 0x55a7f0e83c40 2022-04-28T14:39:25.594 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.578 7f1dfd4bbb80 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x55a7f0d8b360 con 0x55a7f0e60430 2022-04-28T14:39:25.594 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.578 7f1de37fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55a7f0e60430 0x55a7f0e83610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.594 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.578 7f1de2ffd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55a7f0e83c40 0x55a7f0e8fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.594 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.578 7f1de37fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55a7f0e60430 0x55a7f0e83610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46492/0 (socket says 172.21.15.22:46492) 2022-04-28T14:39:25.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.578 7f1de37fe700 1 -- 172.21.15.22:0/4247848148 learned_addr learned my addr 172.21.15.22:0/4247848148 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:25.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.578 7f1de3fff700 1 --2- 172.21.15.22:0/4247848148 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a7f0e84090 0x55a7f0e90470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.579 7f1de37fe700 1 -- 172.21.15.22:0/4247848148 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55a7f0e83c40 msgr2=0x55a7f0e8fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:25.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.579 7f1de37fe700 1 --2- 172.21.15.22:0/4247848148 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55a7f0e83c40 0x55a7f0e8fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.579 7f1de37fe700 1 -- 172.21.15.22:0/4247848148 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a7f0e84090 msgr2=0x55a7f0e90470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:25.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.579 7f1de37fe700 1 --2- 172.21.15.22:0/4247848148 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a7f0e84090 0x55a7f0e90470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.579 7f1de37fe700 1 -- 172.21.15.22:0/4247848148 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7f0c97f30 con 0x55a7f0e60430 2022-04-28T14:39:25.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.579 7f1de2ffd700 1 --2- 172.21.15.22:0/4247848148 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55a7f0e83c40 0x55a7f0e8fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:25.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.579 7f1de37fe700 1 --2- 172.21.15.22:0/4247848148 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55a7f0e60430 0x55a7f0e83610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x55a7f0e86690 tx=0x7f1dd4006830).ready entity=mon.2 client_cookie=4b31ca90b70dd2ff server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:25.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.579 7f1deac5c700 1 -- 172.21.15.22:0/4247848148 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x55a7f0c97f30 con 0x55a7f0e60430 2022-04-28T14:39:25.597 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.579 7f1deac5c700 1 -- 172.21.15.22:0/4247848148 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd400f770 con 0x55a7f0e60430 2022-04-28T14:39:25.597 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.579 7f1deac5c700 1 -- 172.21.15.22:0/4247848148 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f1dd400fb40 con 0x55a7f0e60430 2022-04-28T14:39:25.597 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.579 7f1dfd4bbb80 1 -- 172.21.15.22:0/4247848148 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55a7f0e60430 msgr2=0x55a7f0e83610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:25.597 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.579 7f1dfd4bbb80 1 --2- 172.21.15.22:0/4247848148 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55a7f0e60430 0x55a7f0e83610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x55a7f0e86690 tx=0x7f1dd4006830).stop 2022-04-28T14:39:25.598 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.580 7f1dfd4bbb80 1 -- 172.21.15.22:0/4247848148 shutdown_connections 2022-04-28T14:39:25.598 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.580 7f1dfd4bbb80 1 --2- 172.21.15.22:0/4247848148 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a7f0e84090 0x55a7f0e90470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.598 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.580 7f1dfd4bbb80 1 --2- 172.21.15.22:0/4247848148 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55a7f0e60430 0x55a7f0e83610 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.598 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.580 7f1dfd4bbb80 1 --2- 172.21.15.22:0/4247848148 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55a7f0e83c40 0x55a7f0e8fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.599 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.580 7f1dfd4bbb80 1 -- 172.21.15.22:0/4247848148 >> 172.21.15.22:0/4247848148 conn(0x55a7f0e85b20 msgr2=0x55a7f0e613b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:25.599 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.580 7f1dfd4bbb80 1 -- 172.21.15.22:0/4247848148 shutdown_connections 2022-04-28T14:39:25.599 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.580 7f1dfd4bbb80 1 -- 172.21.15.22:0/4247848148 wait complete. 2022-04-28T14:39:25.599 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.580 7f1dfd4bbb80 1 -- start start 2022-04-28T14:39:25.600 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.580 7f1dfd4bbb80 1 Processor -- start 2022-04-28T14:39:25.600 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.581 7f1dfd4bbb80 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55a7f0e73830 0x55a7f0e950c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.600 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.581 7f1dfd4bbb80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a7f0e956f0 0x55a7f0e81c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.600 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.581 7f1dfd4bbb80 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55a7f0e82290 0x55a7f0ea0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.600 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.581 7f1dfd4bbb80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7f0d87f10 con 0x55a7f0e956f0 2022-04-28T14:39:25.600 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.581 7f1dfd4bbb80 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a7f0e795b0 con 0x55a7f0e73830 2022-04-28T14:39:25.600 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.581 7f1dfd4bbb80 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x55a7f0e94cd0 con 0x55a7f0e82290 2022-04-28T14:39:25.600 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.581 7f1dfd4bbb80 10 client.0 ll_register_callbacks cb 0x55a7f0de3d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-04-28T14:39:25.600 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.581 7f1de37fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55a7f0e73830 0x55a7f0e950c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.601 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.581 7f1de37fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55a7f0e73830 0x55a7f0e950c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46714/0 (socket says 172.21.15.22:46714) 2022-04-28T14:39:25.601 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.581 7f1de37fe700 1 -- 172.21.15.22:0/367295635 learned_addr learned my addr 172.21.15.22:0/367295635 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:25.601 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.581 7f1de2ffd700 1 --2- 172.21.15.22:0/367295635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a7f0e956f0 0x55a7f0e81c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.601 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.581 7f1de3fff700 1 --2- 172.21.15.22:0/367295635 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55a7f0e82290 0x55a7f0ea0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.601 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.581 7f1de2ffd700 1 -- 172.21.15.22:0/367295635 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55a7f0e82290 msgr2=0x55a7f0ea0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:25.601 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.581 7f1de2ffd700 1 --2- 172.21.15.22:0/367295635 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55a7f0e82290 0x55a7f0ea0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.601 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.581 7f1de2ffd700 1 -- 172.21.15.22:0/367295635 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55a7f0e73830 msgr2=0x55a7f0e950c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:25.602 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.581 7f1de2ffd700 1 --2- 172.21.15.22:0/367295635 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55a7f0e73830 0x55a7f0e950c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.602 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.581 7f1de2ffd700 1 -- 172.21.15.22:0/367295635 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a7f0e94370 con 0x55a7f0e956f0 2022-04-28T14:39:25.602 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.581 7f1de37fe700 1 --2- 172.21.15.22:0/367295635 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55a7f0e73830 0x55a7f0e950c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:25.602 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.581 7f1de2ffd700 1 --2- 172.21.15.22:0/367295635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a7f0e956f0 0x55a7f0e81c60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x55a7f0e7a2b0 tx=0x7f1dcc014f20).ready entity=mon.0 client_cookie=5c07c4c693f21b86 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:25.602 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.581 7f1dc27fc700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2022-04-28T14:39:25.602 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.581 7f1dc27fc700 1 -- 172.21.15.22:0/367295635 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x55a7f0e94370 con 0x55a7f0e956f0 2022-04-28T14:39:25.602 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.581 7f1dc27fc700 1 -- 172.21.15.22:0/367295635 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f1dcc010040 con 0x55a7f0e956f0 2022-04-28T14:39:25.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.581 7f1dfd4bbb80 1 -- 172.21.15.22:0/367295635 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a7f0db4630 con 0x55a7f0e956f0 2022-04-28T14:39:25.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.582 7f1dc27fc700 1 -- 172.21.15.22:0/367295635 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1dcc012ac0 con 0x55a7f0e956f0 2022-04-28T14:39:25.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.582 7f1dfd4bbb80 10 client.4515 fetch_fsmap learned FSMap version 9 2022-04-28T14:39:25.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.582 7f1dfd4bbb80 1 -- 172.21.15.22:0/367295635 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55a7f0e95cb0 con 0x55a7f0e956f0 2022-04-28T14:39:25.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.582 7f1dc27fc700 1 -- 172.21.15.22:0/367295635 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a7f0db4630 con 0x55a7f0e956f0 2022-04-28T14:39:25.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.582 7f1dc27fc700 1 -- 172.21.15.22:0/367295635 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 9) v1 ==== 1341+0+0 (secure 0 0 0) 0x7f1dcc012c90 con 0x55a7f0e956f0 2022-04-28T14:39:25.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.582 7f1dfd4bbb80 10 client.4515 fetch_fsmap finished waiting for FSMap version 9 2022-04-28T14:39:25.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.582 7f1dfd4bbb80 10 client.4515 resolve_mds: resolved ID 'c' to GID 4184 2022-04-28T14:39:25.604 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.582 7f1dfd4bbb80 20 client.4515 populate_metadata read hostname 'smithi022' 2022-04-28T14:39:25.604 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.582 7f1dfd4bbb80 4 client.4515 mds_command: new command op to 4184 tid=0[{"prefix": "get_command_descriptions"}] 2022-04-28T14:39:25.604 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.582 7f1dfd4bbb80 1 -- 172.21.15.22:0/367295635 --> v1:172.21.15.22:6819/356491488 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a7f0cc0d50 con 0x55a7f0ea7cd0 2022-04-28T14:39:25.604 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.582 7f1dc27fc700 10 client.4515 ms_handle_connect on v1:172.21.15.22:6819/356491488 2022-04-28T14:39:25.604 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.582 7f1dc27fc700 1 -- 172.21.15.22:0/367295635 <== mds.0 v1:172.21.15.22:6819/356491488 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3729 (unknown 0 0 338808096) 0x55a7f0cc0d50 con 0x55a7f0ea7cd0 2022-04-28T14:39:25.604 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.582 7f1dc27fc700 10 client.4515 handle_command_reply: tid=0 2022-04-28T14:39:25.605 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.582 7f1dfd4bbb80 1 client.4515 shutdown 2022-04-28T14:39:25.605 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.583 7f1dfd4bbb80 1 -- 172.21.15.22:0/367295635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a7f0e956f0 msgr2=0x55a7f0e81c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:25.605 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.583 7f1dfd4bbb80 1 --2- 172.21.15.22:0/367295635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a7f0e956f0 0x55a7f0e81c60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x55a7f0e7a2b0 tx=0x7f1dcc014f20).stop 2022-04-28T14:39:25.605 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.583 7f1dfd4bbb80 1 -- 172.21.15.22:0/367295635 shutdown_connections 2022-04-28T14:39:25.605 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.583 7f1dfd4bbb80 1 --2- 172.21.15.22:0/367295635 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55a7f0e82290 0x55a7f0ea0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.605 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.583 7f1dfd4bbb80 1 --2- 172.21.15.22:0/367295635 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55a7f0e73830 0x55a7f0e950c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.605 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.583 7f1dc27fc700 0 client.4515 ms_handle_reset on v1:172.21.15.22:6819/356491488 2022-04-28T14:39:25.605 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.583 7f1dfd4bbb80 1 --2- 172.21.15.22:0/367295635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a7f0e956f0 0x55a7f0e81c60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.605 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.583 7f1dfd4bbb80 1 -- 172.21.15.22:0/367295635 >> 172.21.15.22:0/367295635 conn(0x55a7f0e85c30 msgr2=0x55a7f0e623f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:25.605 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.583 7f1dfd4bbb80 1 -- 172.21.15.22:0/367295635 shutdown_connections 2022-04-28T14:39:25.606 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.583 7f1dfd4bbb80 1 -- 172.21.15.22:0/367295635 wait complete. 2022-04-28T14:39:25.606 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.583 7f1dfd4bbb80 20 client.4515 trim_cache size 0 max 16384 2022-04-28T14:39:25.607 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.592 7f1dd8ff9700 1 -- 172.21.15.22:0/551290558 >> v1:172.21.15.22:6808/86956 conn(0x7f1dc801c1b0 legacy=0x7f1dc801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:25.607 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.592 7f1dd8ff9700 1 -- 172.21.15.22:0/551290558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1de41c6050 msgr2=0x7f1de41c64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:25.607 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.592 7f1dd8ff9700 1 --2- 172.21.15.22:0/551290558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1de41c6050 0x7f1de41c64a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f1de40d52e0 tx=0x7f1ddc00eda0).stop 2022-04-28T14:39:25.607 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.593 7f1dd8ff9700 1 -- 172.21.15.22:0/551290558 shutdown_connections 2022-04-28T14:39:25.607 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.593 7f1dd8ff9700 1 --2- 172.21.15.22:0/551290558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1de41c6050 0x7f1de41c64a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.608 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.593 7f1dd8ff9700 1 --2- 172.21.15.22:0/551290558 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1de40d6bd0 0x7f1de40bc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.608 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.593 7f1dd8ff9700 1 --2- 172.21.15.22:0/551290558 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1de40bc8d0 0x7f1de41c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.608 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.593 7f1dd8ff9700 1 -- 172.21.15.22:0/551290558 >> 172.21.15.22:0/551290558 conn(0x7f1de40cd4e0 msgr2=0x7f1de40f1460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:25.608 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.593 7f1dd8ff9700 1 -- 172.21.15.22:0/551290558 shutdown_connections 2022-04-28T14:39:25.608 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.593 7f1dd8ff9700 1 -- 172.21.15.22:0/551290558 wait complete. 2022-04-28T14:39:25.608 INFO:teuthology.orchestra.run.smithi022.stderr:no valid command found; 10 closest matches: 2022-04-28T14:39:25.608 INFO:teuthology.orchestra.run.smithi022.stderr:injectargs [...] 2022-04-28T14:39:25.608 INFO:teuthology.orchestra.run.smithi022.stderr:config set 2022-04-28T14:39:25.608 INFO:teuthology.orchestra.run.smithi022.stderr:config unset 2022-04-28T14:39:25.608 INFO:teuthology.orchestra.run.smithi022.stderr:exit 2022-04-28T14:39:25.609 INFO:teuthology.orchestra.run.smithi022.stderr:respawn 2022-04-28T14:39:25.609 INFO:teuthology.orchestra.run.smithi022.stderr:session kill 2022-04-28T14:39:25.609 INFO:teuthology.orchestra.run.smithi022.stderr:cpu_profiler status|flush 2022-04-28T14:39:25.609 INFO:teuthology.orchestra.run.smithi022.stderr:session ls { [...]} 2022-04-28T14:39:25.609 INFO:teuthology.orchestra.run.smithi022.stderr:client ls { [...]} 2022-04-28T14:39:25.609 INFO:teuthology.orchestra.run.smithi022.stderr:session evict { [...]} 2022-04-28T14:39:25.609 INFO:teuthology.orchestra.run.smithi022.stderr:Error EINVAL: invalid command 2022-04-28T14:39:25.610 DEBUG:teuthology.orchestra.run:got remote process result: 22 2022-04-28T14:39:25.610 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2022-04-28T14:39:25.743 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.735 7f8d79c44700 1 Processor -- start 2022-04-28T14:39:25.743 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.735 7f8d79c44700 1 -- start start 2022-04-28T14:39:25.743 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.736 7f8d79c44700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8d7410cba0 0x7f8d740f62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.744 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.736 7f8d79c44700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8d741b2650 0x7f8d741b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.744 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.736 7f8d79c44700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d740ab0e0 con 0x7f8d741b30d0 2022-04-28T14:39:25.744 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.736 7f8d79c44700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d74111e20 con 0x7f8d741b2650 2022-04-28T14:39:25.744 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.736 7f8d79c44700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d740f6910 con 0x7f8d7410cba0 2022-04-28T14:39:25.744 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.736 7f8d72861700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8d7410cba0 0x7f8d740f62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.744 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.736 7f8d72060700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8d741b2650 0x7f8d741b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.744 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.736 7f8d72060700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8d741b2650 0x7f8d741b2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49156/0 (socket says 172.21.15.22:49156) 2022-04-28T14:39:25.744 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.736 7f8d72861700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8d7410cba0 0x7f8d740f62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46506/0 (socket says 172.21.15.22:46506) 2022-04-28T14:39:25.745 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.736 7f8d72060700 1 -- 172.21.15.22:0/2019331344 learned_addr learned my addr 172.21.15.22:0/2019331344 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:25.745 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.736 7f8d73062700 1 --1- 172.21.15.22:0/2019331344 >> v1:172.21.15.22:6789/0 conn(0x7f8d741b30d0 0x7f8d740f13c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38554/0 (socket says 172.21.15.22:38554) 2022-04-28T14:39:25.745 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.736 7f8d72861700 1 -- 172.21.15.22:0/2019331344 >> v2:172.21.15.22:3300/0 conn(0x7f8d741b2650 msgr2=0x7f8d741b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:25.745 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.736 7f8d72861700 1 --2- 172.21.15.22:0/2019331344 >> v2:172.21.15.22:3300/0 conn(0x7f8d741b2650 0x7f8d741b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.745 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.736 7f8d72861700 1 -- 172.21.15.22:0/2019331344 >> v1:172.21.15.22:6789/0 conn(0x7f8d741b30d0 legacy=0x7f8d740f13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:25.746 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.736 7f8d7185f700 1 -- 172.21.15.22:0/2019331344 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836894036 0 0) 0x7f8d6c001490 con 0x7f8d741b30d0 2022-04-28T14:39:25.746 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.736 7f8d72861700 1 -- 172.21.15.22:0/2019331344 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d74111730 con 0x7f8d7410cba0 2022-04-28T14:39:25.746 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.736 7f8d72060700 1 --2- 172.21.15.22:0/2019331344 >> v2:172.21.15.22:3300/0 conn(0x7f8d741b2650 0x7f8d741b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:25.746 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.736 7f8d72861700 1 --2- 172.21.15.22:0/2019331344 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8d7410cba0 0x7f8d740f62e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f8d5c002f70 tx=0x7f8d5c00b970).ready entity=mon.2 client_cookie=bf61e586eac33f86 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:25.746 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.737 7f8d7185f700 1 -- 172.21.15.22:0/2019331344 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8d74111730 con 0x7f8d7410cba0 2022-04-28T14:39:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.737 7f8d7185f700 1 -- 172.21.15.22:0/2019331344 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5c00d5c0 con 0x7f8d7410cba0 2022-04-28T14:39:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.737 7f8d7185f700 1 -- 172.21.15.22:0/2019331344 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8d5c00d990 con 0x7f8d7410cba0 2022-04-28T14:39:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.737 7f8d79c44700 1 -- 172.21.15.22:0/2019331344 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8d7410cba0 msgr2=0x7f8d740f62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.737 7f8d79c44700 1 --2- 172.21.15.22:0/2019331344 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8d7410cba0 0x7f8d740f62e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f8d5c002f70 tx=0x7f8d5c00b970).stop 2022-04-28T14:39:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.737 7f8d79c44700 1 -- 172.21.15.22:0/2019331344 shutdown_connections 2022-04-28T14:39:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.737 7f8d79c44700 1 --2- 172.21.15.22:0/2019331344 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8d7410cba0 0x7f8d740f62e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.737 7f8d79c44700 1 --2- 172.21.15.22:0/2019331344 >> v2:172.21.15.22:3300/0 conn(0x7f8d741b2650 0x7f8d741b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.748 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.737 7f8d79c44700 1 -- 172.21.15.22:0/2019331344 >> 172.21.15.22:0/2019331344 conn(0x7f8d74117270 msgr2=0x7f8d740f2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:25.748 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.737 7f8d79c44700 1 -- 172.21.15.22:0/2019331344 shutdown_connections 2022-04-28T14:39:25.748 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.737 7f8d79c44700 1 -- 172.21.15.22:0/2019331344 wait complete. 2022-04-28T14:39:25.768 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.761 7f8d79c44700 1 Processor -- start 2022-04-28T14:39:25.768 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.761 7f8d79c44700 1 -- start start 2022-04-28T14:39:25.768 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.762 7f8d79c44700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d740d2b20 0x7f8d741b3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.768 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.762 7f8d79c44700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8d741b3c90 0x7f8d740ddc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.768 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.762 7f8d79c44700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8d741b40e0 0x7f8d740de280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.762 7f8d79c44700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d740ba820 con 0x7f8d740d2b20 2022-04-28T14:39:25.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.762 7f8d79c44700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d740bd450 con 0x7f8d741b3c90 2022-04-28T14:39:25.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.762 7f8d79c44700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d741bb2e0 con 0x7f8d741b40e0 2022-04-28T14:39:25.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.762 7f8d72861700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d740d2b20 0x7f8d741b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.762 7f8d73062700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8d741b40e0 0x7f8d740de280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.762 7f8d72861700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d740d2b20 0x7f8d741b3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49160/0 (socket says 172.21.15.22:49160) 2022-04-28T14:39:25.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.762 7f8d72861700 1 -- 172.21.15.22:0/527413942 learned_addr learned my addr 172.21.15.22:0/527413942 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:25.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.762 7f8d72060700 1 --2- 172.21.15.22:0/527413942 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8d741b3c90 0x7f8d740ddc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.762 7f8d72861700 1 -- 172.21.15.22:0/527413942 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8d741b40e0 msgr2=0x7f8d740de280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:25.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.762 7f8d72861700 1 --2- 172.21.15.22:0/527413942 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8d741b40e0 0x7f8d740de280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.762 7f8d72861700 1 -- 172.21.15.22:0/527413942 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8d741b3c90 msgr2=0x7f8d740ddc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:25.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.762 7f8d72861700 1 --2- 172.21.15.22:0/527413942 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8d741b3c90 0x7f8d740ddc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.762 7f8d72861700 1 -- 172.21.15.22:0/527413942 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d741be8a0 con 0x7f8d740d2b20 2022-04-28T14:39:25.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.762 7f8d72861700 1 --2- 172.21.15.22:0/527413942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d740d2b20 0x7f8d741b3660 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f8d5c002f70 tx=0x7f8d5c0068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:25.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.762 7f8d6bfff700 1 -- 172.21.15.22:0/527413942 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8d741be8a0 con 0x7f8d740d2b20 2022-04-28T14:39:25.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.762 7f8d6bfff700 1 -- 172.21.15.22:0/527413942 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5c011790 con 0x7f8d740d2b20 2022-04-28T14:39:25.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.762 7f8d79c44700 1 -- 172.21.15.22:0/527413942 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d740d3490 con 0x7f8d740d2b20 2022-04-28T14:39:25.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.762 7f8d6bfff700 1 -- 172.21.15.22:0/527413942 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8d5c017040 con 0x7f8d740d2b20 2022-04-28T14:39:25.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.762 7f8d79c44700 1 -- 172.21.15.22:0/527413942 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d740de8b0 con 0x7f8d740d2b20 2022-04-28T14:39:25.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.763 7f8d6bfff700 1 -- 172.21.15.22:0/527413942 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f8d5c011b60 con 0x7f8d740d2b20 2022-04-28T14:39:25.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.763 7f8d6bfff700 1 -- 172.21.15.22:0/527413942 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f8d5c018070 con 0x7f8d740d2b20 2022-04-28T14:39:25.778 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.766 7f8d8c4a3b80 1 Processor -- start 2022-04-28T14:39:25.778 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.766 7f8d8c4a3b80 1 -- start start 2022-04-28T14:39:25.778 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.766 7f8d8c4a3b80 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55a94fe44430 0x55a94fe67610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.778 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.766 7f8d8c4a3b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a94fe67c40 0x55a94fe73e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.778 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.766 7f8d8c4a3b80 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55a94fe68090 0x55a94fe74470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.778 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.766 7f8d8c4a3b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a94fd84480 con 0x55a94fe67c40 2022-04-28T14:39:25.778 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.766 7f8d8c4a3b80 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a94fbb91e0 con 0x55a94fe44430 2022-04-28T14:39:25.779 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.766 7f8d8c4a3b80 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x55a94fd6f360 con 0x55a94fe68090 2022-04-28T14:39:25.779 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.766 7f8d72861700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55a94fe44430 0x55a94fe67610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.779 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.766 7f8d72861700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55a94fe44430 0x55a94fe67610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46736/0 (socket says 172.21.15.22:46736) 2022-04-28T14:39:25.779 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.766 7f8d72861700 1 -- 172.21.15.22:0/1560932320 learned_addr learned my addr 172.21.15.22:0/1560932320 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:25.779 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.766 7f8d73062700 1 --2- 172.21.15.22:0/1560932320 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55a94fe68090 0x55a94fe74470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.779 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.766 7f8d72060700 1 --2- 172.21.15.22:0/1560932320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a94fe67c40 0x55a94fe73e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.779 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.767 7f8d72861700 1 -- 172.21.15.22:0/1560932320 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55a94fe68090 msgr2=0x55a94fe74470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:25.779 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.767 7f8d72861700 1 --2- 172.21.15.22:0/1560932320 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55a94fe68090 0x55a94fe74470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.780 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.767 7f8d72861700 1 -- 172.21.15.22:0/1560932320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a94fe67c40 msgr2=0x55a94fe73e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:25.780 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.767 7f8d72861700 1 --2- 172.21.15.22:0/1560932320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a94fe67c40 0x55a94fe73e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.780 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.767 7f8d72861700 1 -- 172.21.15.22:0/1560932320 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a94fc7bf30 con 0x55a94fe44430 2022-04-28T14:39:25.780 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.767 7f8d72861700 1 --2- 172.21.15.22:0/1560932320 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55a94fe44430 0x55a94fe67610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x55a94fd99f70 tx=0x7f8d5c00c7b0).ready entity=mon.1 client_cookie=a6b5f91a4f1507b5 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:25.780 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.767 7f8d79c44700 1 -- 172.21.15.22:0/1560932320 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x55a94fc7bf30 con 0x55a94fe44430 2022-04-28T14:39:25.780 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.767 7f8d79c44700 1 -- 172.21.15.22:0/1560932320 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5c02d040 con 0x55a94fe44430 2022-04-28T14:39:25.780 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.767 7f8d79c44700 1 -- 172.21.15.22:0/1560932320 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8d740de8b0 con 0x55a94fe44430 2022-04-28T14:39:25.780 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.767 7f8d8c4a3b80 1 -- 172.21.15.22:0/1560932320 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55a94fe44430 msgr2=0x55a94fe67610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:25.781 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.767 7f8d8c4a3b80 1 --2- 172.21.15.22:0/1560932320 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55a94fe44430 0x55a94fe67610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x55a94fd99f70 tx=0x7f8d5c00c7b0).stop 2022-04-28T14:39:25.781 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.768 7f8d8c4a3b80 1 -- 172.21.15.22:0/1560932320 shutdown_connections 2022-04-28T14:39:25.781 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.768 7f8d8c4a3b80 1 --2- 172.21.15.22:0/1560932320 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55a94fe68090 0x55a94fe74470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.781 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.768 7f8d8c4a3b80 1 --2- 172.21.15.22:0/1560932320 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55a94fe44430 0x55a94fe67610 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.781 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.768 7f8d8c4a3b80 1 --2- 172.21.15.22:0/1560932320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a94fe67c40 0x55a94fe73e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.781 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.768 7f8d8c4a3b80 1 -- 172.21.15.22:0/1560932320 >> 172.21.15.22:0/1560932320 conn(0x55a94fe69b20 msgr2=0x55a94fe453b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:25.781 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.768 7f8d8c4a3b80 1 -- 172.21.15.22:0/1560932320 shutdown_connections 2022-04-28T14:39:25.781 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.768 7f8d8c4a3b80 1 -- 172.21.15.22:0/1560932320 wait complete. 2022-04-28T14:39:25.782 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.768 7f8d8c4a3b80 1 -- start start 2022-04-28T14:39:25.782 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.768 7f8d8c4a3b80 1 Processor -- start 2022-04-28T14:39:25.782 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.769 7f8d8c4a3b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a94fe4ca70 0x55a94fe84850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.782 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.769 7f8d8c4a3b80 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55a94fe84e80 0x55a94fe6a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.782 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.769 7f8d8c4a3b80 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55a94fe852d0 0x55a94fe6a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.782 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.769 7f8d8c4a3b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a94fd6bf10 con 0x55a94fe4ca70 2022-04-28T14:39:25.782 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.769 7f8d8c4a3b80 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a94fe5d530 con 0x55a94fe852d0 2022-04-28T14:39:25.782 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.769 7f8d8c4a3b80 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x55a94fe578e0 con 0x55a94fe84e80 2022-04-28T14:39:25.783 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.769 7f8d8c4a3b80 10 client.0 ll_register_callbacks cb 0x55a94fdc7d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-04-28T14:39:25.783 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.769 7f8d72861700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a94fe4ca70 0x55a94fe84850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.783 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.769 7f8d72861700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a94fe4ca70 0x55a94fe84850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49174/0 (socket says 172.21.15.22:49174) 2022-04-28T14:39:25.783 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.769 7f8d72861700 1 -- 172.21.15.22:0/3817780987 learned_addr learned my addr 172.21.15.22:0/3817780987 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:25.783 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.769 7f8d73062700 1 --2- 172.21.15.22:0/3817780987 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55a94fe852d0 0x55a94fe6a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.783 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.769 7f8d72060700 1 --2- 172.21.15.22:0/3817780987 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55a94fe84e80 0x55a94fe6a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.783 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.769 7f8d72861700 1 -- 172.21.15.22:0/3817780987 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55a94fe84e80 msgr2=0x55a94fe6a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:25.783 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.769 7f8d72861700 1 --2- 172.21.15.22:0/3817780987 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55a94fe84e80 0x55a94fe6a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.783 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.770 7f8d72861700 1 -- 172.21.15.22:0/3817780987 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55a94fe852d0 msgr2=0x55a94fe6a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:25.784 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.770 7f8d72861700 1 --2- 172.21.15.22:0/3817780987 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55a94fe852d0 0x55a94fe6a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.784 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.770 7f8d72861700 1 -- 172.21.15.22:0/3817780987 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a94fe4bf90 con 0x55a94fe4ca70 2022-04-28T14:39:25.784 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.770 7f8d73062700 1 --2- 172.21.15.22:0/3817780987 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55a94fe852d0 0x55a94fe6a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:25.784 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.770 7f8d72861700 1 --2- 172.21.15.22:0/3817780987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a94fe4ca70 0x55a94fe84850 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x55a94fe5db60 tx=0x7f8d5c00a040).ready entity=mon.0 client_cookie=eb51cbb0e0e437ae server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:25.784 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.770 7f8d51ffb700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2022-04-28T14:39:25.784 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.770 7f8d51ffb700 1 -- 172.21.15.22:0/3817780987 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x55a94fe4bf90 con 0x55a94fe4ca70 2022-04-28T14:39:25.784 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.770 7f8d51ffb700 1 -- 172.21.15.22:0/3817780987 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f8d5c039040 con 0x55a94fe4ca70 2022-04-28T14:39:25.784 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.770 7f8d8c4a3b80 1 -- 172.21.15.22:0/3817780987 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a94fd98630 con 0x55a94fe4ca70 2022-04-28T14:39:25.785 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.770 7f8d51ffb700 1 -- 172.21.15.22:0/3817780987 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d5c00b210 con 0x55a94fe4ca70 2022-04-28T14:39:25.785 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.770 7f8d8c4a3b80 10 client.4530 fetch_fsmap learned FSMap version 9 2022-04-28T14:39:25.785 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.770 7f8d8c4a3b80 1 -- 172.21.15.22:0/3817780987 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55a94fe5d170 con 0x55a94fe4ca70 2022-04-28T14:39:25.785 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.770 7f8d51ffb700 1 -- 172.21.15.22:0/3817780987 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a94fd98630 con 0x55a94fe4ca70 2022-04-28T14:39:25.785 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.770 7f8d51ffb700 1 -- 172.21.15.22:0/3817780987 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 9) v1 ==== 1341+0+0 (secure 0 0 0) 0x7f8d5c027020 con 0x55a94fe4ca70 2022-04-28T14:39:25.785 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.770 7f8d8c4a3b80 10 client.4530 fetch_fsmap finished waiting for FSMap version 9 2022-04-28T14:39:25.785 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.770 7f8d8c4a3b80 10 client.4530 resolve_mds: resolved ID 'b' to GID 4198 2022-04-28T14:39:25.785 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.770 7f8d8c4a3b80 20 client.4530 populate_metadata read hostname 'smithi022' 2022-04-28T14:39:25.786 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.770 7f8d8c4a3b80 4 client.4530 mds_command: new command op to 4198 tid=0[{"prefix": "get_command_descriptions"}] 2022-04-28T14:39:25.786 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.770 7f8d8c4a3b80 1 -- 172.21.15.22:0/3817780987 --> v1:172.21.15.22:6817/401565232 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a94fca4d50 con 0x55a94fe8c080 2022-04-28T14:39:25.786 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.771 7f8d51ffb700 10 client.4530 ms_handle_connect on v1:172.21.15.22:6817/401565232 2022-04-28T14:39:25.786 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.771 7f8d51ffb700 1 -- 172.21.15.22:0/3817780987 <== mds.1 v1:172.21.15.22:6817/401565232 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3729 (unknown 0 0 338808096) 0x55a94fca4d50 con 0x55a94fe8c080 2022-04-28T14:39:25.786 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.771 7f8d51ffb700 10 client.4530 handle_command_reply: tid=0 2022-04-28T14:39:25.786 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.771 7f8d8c4a3b80 1 client.4530 shutdown 2022-04-28T14:39:25.786 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.771 7f8d8c4a3b80 1 -- 172.21.15.22:0/3817780987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a94fe4ca70 msgr2=0x55a94fe84850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:25.786 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.771 7f8d8c4a3b80 1 --2- 172.21.15.22:0/3817780987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a94fe4ca70 0x55a94fe84850 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x55a94fe5db60 tx=0x7f8d5c00a040).stop 2022-04-28T14:39:25.787 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.771 7f8d8c4a3b80 1 -- 172.21.15.22:0/3817780987 shutdown_connections 2022-04-28T14:39:25.787 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.771 7f8d8c4a3b80 1 --2- 172.21.15.22:0/3817780987 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55a94fe852d0 0x55a94fe6a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.787 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.771 7f8d51ffb700 0 client.4530 ms_handle_reset on v1:172.21.15.22:6817/401565232 2022-04-28T14:39:25.787 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.771 7f8d8c4a3b80 1 --2- 172.21.15.22:0/3817780987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55a94fe4ca70 0x55a94fe84850 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.787 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.771 7f8d8c4a3b80 1 --2- 172.21.15.22:0/3817780987 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55a94fe84e80 0x55a94fe6a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.787 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.771 7f8d8c4a3b80 1 -- 172.21.15.22:0/3817780987 >> 172.21.15.22:0/3817780987 conn(0x55a94fe45f40 msgr2=0x55a94fe69750 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:25.787 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.771 7f8d8c4a3b80 1 -- 172.21.15.22:0/3817780987 shutdown_connections 2022-04-28T14:39:25.787 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.771 7f8d8c4a3b80 1 -- 172.21.15.22:0/3817780987 wait complete. 2022-04-28T14:39:25.787 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.771 7f8d8c4a3b80 20 client.4530 trim_cache size 0 max 16384 2022-04-28T14:39:25.789 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.781 7f8d53fff700 1 -- 172.21.15.22:0/527413942 >> v1:172.21.15.22:6808/86956 conn(0x7f8d5801c1b0 legacy=0x7f8d5801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:25.789 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.781 7f8d53fff700 1 -- 172.21.15.22:0/527413942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d740d2b20 msgr2=0x7f8d741b3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:25.789 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.781 7f8d53fff700 1 --2- 172.21.15.22:0/527413942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d740d2b20 0x7f8d741b3660 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f8d5c002f70 tx=0x7f8d5c0068c0).stop 2022-04-28T14:39:25.789 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.781 7f8d53fff700 1 -- 172.21.15.22:0/527413942 shutdown_connections 2022-04-28T14:39:25.789 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.781 7f8d53fff700 1 --2- 172.21.15.22:0/527413942 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8d741b40e0 0x7f8d740de280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.789 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.781 7f8d53fff700 1 --2- 172.21.15.22:0/527413942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d740d2b20 0x7f8d741b3660 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.790 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.781 7f8d53fff700 1 --2- 172.21.15.22:0/527413942 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8d741b3c90 0x7f8d740ddc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.790 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.781 7f8d53fff700 1 -- 172.21.15.22:0/527413942 >> 172.21.15.22:0/527413942 conn(0x7f8d740d0eb0 msgr2=0x7f8d740df160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:25.790 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.781 7f8d53fff700 1 -- 172.21.15.22:0/527413942 shutdown_connections 2022-04-28T14:39:25.790 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.781 7f8d53fff700 1 -- 172.21.15.22:0/527413942 wait complete. 2022-04-28T14:39:25.790 INFO:teuthology.orchestra.run.smithi022.stderr:no valid command found; 10 closest matches: 2022-04-28T14:39:25.790 INFO:teuthology.orchestra.run.smithi022.stderr:injectargs [...] 2022-04-28T14:39:25.790 INFO:teuthology.orchestra.run.smithi022.stderr:config set 2022-04-28T14:39:25.790 INFO:teuthology.orchestra.run.smithi022.stderr:config unset 2022-04-28T14:39:25.790 INFO:teuthology.orchestra.run.smithi022.stderr:exit 2022-04-28T14:39:25.791 INFO:teuthology.orchestra.run.smithi022.stderr:respawn 2022-04-28T14:39:25.791 INFO:teuthology.orchestra.run.smithi022.stderr:session kill 2022-04-28T14:39:25.791 INFO:teuthology.orchestra.run.smithi022.stderr:cpu_profiler status|flush 2022-04-28T14:39:25.791 INFO:teuthology.orchestra.run.smithi022.stderr:session ls { [...]} 2022-04-28T14:39:25.791 INFO:teuthology.orchestra.run.smithi022.stderr:client ls { [...]} 2022-04-28T14:39:25.791 INFO:teuthology.orchestra.run.smithi022.stderr:session evict { [...]} 2022-04-28T14:39:25.791 INFO:teuthology.orchestra.run.smithi022.stderr:Error EINVAL: invalid command 2022-04-28T14:39:25.796 DEBUG:teuthology.orchestra.run:got remote process result: 22 2022-04-28T14:39:25.797 INFO:teuthology.run_tasks:Running task exec... 2022-04-28T14:39:25.807 INFO:teuthology.task.exec:Executing custom commands... 2022-04-28T14:39:25.807 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@smithi022.front.sepia.ceph.com 2022-04-28T14:39:25.807 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client nautilus' 2022-04-28T14:39:25.937 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.930 7f26e4d9a700 1 Processor -- start 2022-04-28T14:39:25.937 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.930 7f26e4d9a700 1 -- start start 2022-04-28T14:39:25.937 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.930 7f26e4d9a700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f26e010ea20 0x7f26e00f7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.937 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.930 7f26e4d9a700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f26e00f0b00 0x7f26e00f0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.937 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.930 7f26e4d9a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f26e00f1580 0x7f26e01b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.937 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.930 7f26e4d9a700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e010ef90 con 0x7f26e00f1580 2022-04-28T14:39:25.938 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.930 7f26e4d9a700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e00f1fb0 con 0x7f26e010ea20 2022-04-28T14:39:25.938 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.930 7f26e4d9a700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26e00f8370 con 0x7f26e00f0b00 2022-04-28T14:39:25.938 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.931 7f26dd363700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f26e00f0b00 0x7f26e00f0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.938 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.931 7f26de365700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f26e00f1580 0x7f26e01b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.938 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.931 7f26ddb64700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f26e010ea20 0x7f26e00f7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.938 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.931 7f26dd363700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f26e00f0b00 0x7f26e00f0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46534/0 (socket says 172.21.15.22:46534) 2022-04-28T14:39:25.938 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.931 7f26de365700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f26e00f1580 0x7f26e01b4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49186/0 (socket says 172.21.15.22:49186) 2022-04-28T14:39:25.938 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.931 7f26dd363700 1 -- 172.21.15.22:0/1109685847 learned_addr learned my addr 172.21.15.22:0/1109685847 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:25.938 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.931 7f26ddb64700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f26e010ea20 0x7f26e00f7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46750/0 (socket says 172.21.15.22:46750) 2022-04-28T14:39:25.939 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.931 7f26ddb64700 1 -- 172.21.15.22:0/1109685847 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f26e00f0b00 msgr2=0x7f26e00f0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:25.939 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.931 7f26ddb64700 1 --2- 172.21.15.22:0/1109685847 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f26e00f0b00 0x7f26e00f0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.939 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.931 7f26ddb64700 1 -- 172.21.15.22:0/1109685847 >> v2:172.21.15.22:3300/0 conn(0x7f26e00f1580 msgr2=0x7f26e01b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:25.939 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.931 7f26ddb64700 1 --2- 172.21.15.22:0/1109685847 >> v2:172.21.15.22:3300/0 conn(0x7f26e00f1580 0x7f26e01b4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.939 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.931 7f26ddb64700 1 -- 172.21.15.22:0/1109685847 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e00f3430 con 0x7f26e010ea20 2022-04-28T14:39:25.939 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.931 7f26de365700 1 --2- 172.21.15.22:0/1109685847 >> v2:172.21.15.22:3300/0 conn(0x7f26e00f1580 0x7f26e01b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:25.939 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.931 7f26ddb64700 1 --2- 172.21.15.22:0/1109685847 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f26e010ea20 0x7f26e00f7d40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f26e00f2160 tx=0x7f26d000ba20).ready entity=mon.1 client_cookie=a786e057f1cc9a78 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:25.939 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.931 7f26dcb62700 1 -- 172.21.15.22:0/1109685847 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f26e00f3430 con 0x7f26e010ea20 2022-04-28T14:39:25.939 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.931 7f26dcb62700 1 -- 172.21.15.22:0/1109685847 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d000d570 con 0x7f26e010ea20 2022-04-28T14:39:25.940 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.931 7f26dcb62700 1 -- 172.21.15.22:0/1109685847 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f26d000d940 con 0x7f26e010ea20 2022-04-28T14:39:25.940 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.931 7f26e4d9a700 1 -- 172.21.15.22:0/1109685847 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f26e010ea20 msgr2=0x7f26e00f7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:25.940 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.931 7f26e4d9a700 1 --2- 172.21.15.22:0/1109685847 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f26e010ea20 0x7f26e00f7d40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f26e00f2160 tx=0x7f26d000ba20).stop 2022-04-28T14:39:25.940 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.932 7f26e4d9a700 1 -- 172.21.15.22:0/1109685847 shutdown_connections 2022-04-28T14:39:25.940 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.932 7f26e4d9a700 1 --2- 172.21.15.22:0/1109685847 >> v2:172.21.15.22:3300/0 conn(0x7f26e00f1580 0x7f26e01b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.940 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.932 7f26e4d9a700 1 --2- 172.21.15.22:0/1109685847 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f26e010ea20 0x7f26e00f7d40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.940 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.932 7f26e4d9a700 1 --2- 172.21.15.22:0/1109685847 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f26e00f0b00 0x7f26e00f0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.940 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.932 7f26e4d9a700 1 -- 172.21.15.22:0/1109685847 >> 172.21.15.22:0/1109685847 conn(0x7f26e0125990 msgr2=0x7f26e0125de0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:25.940 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.932 7f26e4d9a700 1 -- 172.21.15.22:0/1109685847 shutdown_connections 2022-04-28T14:39:25.941 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.932 7f26e4d9a700 1 -- 172.21.15.22:0/1109685847 wait complete. 2022-04-28T14:39:25.963 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.956 7f26e4d9a700 1 Processor -- start 2022-04-28T14:39:25.963 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.956 7f26e4d9a700 1 -- start start 2022-04-28T14:39:25.963 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.956 7f26e4d9a700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f26e01b74f0 0x7f26e01c4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.963 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.956 7f26e4d9a700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f26e01c4d40 0x7f26e01c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.964 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.956 7f26e4d9a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26e01c5190 0x7f26e01c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:25.964 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.956 7f26e4d9a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e00be650 con 0x7f26e01c5190 2022-04-28T14:39:25.964 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.956 7f26e4d9a700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e00dd4f0 con 0x7f26e01b74f0 2022-04-28T14:39:25.964 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.956 7f26e4d9a700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26e00e08a0 con 0x7f26e01c4d40 2022-04-28T14:39:25.964 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.956 7f26ddb64700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f26e01b74f0 0x7f26e01c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.964 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.956 7f26dd363700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f26e01c4d40 0x7f26e01c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.964 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.956 7f26de365700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26e01c5190 0x7f26e01c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:25.964 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.956 7f26ddb64700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f26e01b74f0 0x7f26e01c4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46756/0 (socket says 172.21.15.22:46756) 2022-04-28T14:39:25.964 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.956 7f26ddb64700 1 -- 172.21.15.22:0/337703504 learned_addr learned my addr 172.21.15.22:0/337703504 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:25.965 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.957 7f26dd363700 1 -- 172.21.15.22:0/337703504 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f26e01b74f0 msgr2=0x7f26e01c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:25.965 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.957 7f26dd363700 1 --2- 172.21.15.22:0/337703504 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f26e01b74f0 0x7f26e01c4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.965 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.957 7f26dd363700 1 -- 172.21.15.22:0/337703504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26e01c5190 msgr2=0x7f26e01c5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:25.965 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.957 7f26dd363700 1 --2- 172.21.15.22:0/337703504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26e01c5190 0x7f26e01c5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:25.965 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.957 7f26dd363700 1 -- 172.21.15.22:0/337703504 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e0087f00 con 0x7f26e01c4d40 2022-04-28T14:39:25.965 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.957 7f26ddb64700 1 --2- 172.21.15.22:0/337703504 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f26e01b74f0 0x7f26e01c4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:25.965 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.957 7f26dd363700 1 --2- 172.21.15.22:0/337703504 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f26e01c4d40 0x7f26e01c57d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f26e00dd8b0 tx=0x7f26c800ec80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:25.965 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.957 7f26d6ffd700 1 -- 172.21.15.22:0/337703504 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f26e0087f00 con 0x7f26e01c4d40 2022-04-28T14:39:25.965 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.957 7f26d6ffd700 1 -- 172.21.15.22:0/337703504 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c800c620 con 0x7f26e01c4d40 2022-04-28T14:39:25.966 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.957 7f26e4d9a700 1 -- 172.21.15.22:0/337703504 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e01b7940 con 0x7f26e01c4d40 2022-04-28T14:39:25.966 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.957 7f26d6ffd700 1 -- 172.21.15.22:0/337703504 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f26c800f040 con 0x7f26e01c4d40 2022-04-28T14:39:25.966 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.957 7f26e4d9a700 1 -- 172.21.15.22:0/337703504 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e01c6610 con 0x7f26e01c4d40 2022-04-28T14:39:25.966 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.958 7f26d6ffd700 1 -- 172.21.15.22:0/337703504 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f26c8022060 con 0x7f26e01c4d40 2022-04-28T14:39:25.966 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.958 7f26d6ffd700 1 -- 172.21.15.22:0/337703504 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f26c8010040 con 0x7f26e01c4d40 2022-04-28T14:39:25.966 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.958 7f26e4d9a700 1 -- 172.21.15.22:0/337703504 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e00f03e0 con 0x7f26e01c4d40 2022-04-28T14:39:25.967 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:25.961 7f26d6ffd700 1 -- 172.21.15.22:0/337703504 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f26c800edc0 con 0x7f26e01c4d40 2022-04-28T14:39:26.071 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:26.067 7f26e4d9a700 1 -- 172.21.15.22:0/337703504 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "nautilus"} v 0) v1 -- 0x7f26e00bebc0 con 0x7f26e01c4d40 2022-04-28T14:39:26.616 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:26.610 7f26d6ffd700 1 -- 172.21.15.22:0/337703504 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "nautilus"}]=0 set require_min_compat_client to nautilus v17) v1 ==== 145+0+0 (secure 0 0 0) 0x7f26c8000c30 con 0x7f26e01c4d40 2022-04-28T14:39:26.618 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:26.613 7f26e4d9a700 1 -- 172.21.15.22:0/337703504 >> v1:172.21.15.22:6808/86956 conn(0x7f26c401c1b0 legacy=0x7f26c401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:26.618 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:26.613 7f26e4d9a700 1 -- 172.21.15.22:0/337703504 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f26e01c4d40 msgr2=0x7f26e01c57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:26.618 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:26.613 7f26e4d9a700 1 --2- 172.21.15.22:0/337703504 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f26e01c4d40 0x7f26e01c57d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f26e00dd8b0 tx=0x7f26c800ec80).stop 2022-04-28T14:39:26.618 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:26.613 7f26e4d9a700 1 -- 172.21.15.22:0/337703504 shutdown_connections 2022-04-28T14:39:26.618 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:26.613 7f26e4d9a700 1 --2- 172.21.15.22:0/337703504 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26e01c5190 0x7f26e01c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:26.618 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:26.613 7f26e4d9a700 1 --2- 172.21.15.22:0/337703504 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f26e01b74f0 0x7f26e01c4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:26.618 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:26.613 7f26e4d9a700 1 --2- 172.21.15.22:0/337703504 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f26e01c4d40 0x7f26e01c57d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:26.619 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:26.613 7f26e4d9a700 1 -- 172.21.15.22:0/337703504 >> 172.21.15.22:0/337703504 conn(0x7f26e00d1890 msgr2=0x7f26e00b8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:26.619 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:26.613 7f26e4d9a700 1 -- 172.21.15.22:0/337703504 shutdown_connections 2022-04-28T14:39:26.619 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:26.613 7f26e4d9a700 1 -- 172.21.15.22:0/337703504 wait complete. 2022-04-28T14:39:26.619 INFO:teuthology.orchestra.run.smithi022.stderr:set require_min_compat_client to nautilus 2022-04-28T14:39:26.630 INFO:teuthology.run_tasks:Running task print... 2022-04-28T14:39:26.642 INFO:teuthology.task.print:**** done ceph 2022-04-28T14:39:26.642 INFO:teuthology.run_tasks:Running task ceph-fuse... 2022-04-28T14:39:26.705 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2022-04-28T14:39:26.705 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2022-04-28T14:39:26.705 INFO:tasks.ceph_fuse:client.0 config is {} 2022-04-28T14:39:26.706 INFO:tasks.ceph_fuse:client.1 config is {} 2022-04-28T14:39:26.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-28T14:39:26.706 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2022-04-28T14:39:26.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-28T14:39:26.728 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link delete ceph-brx 2022-04-28T14:39:26.804 INFO:teuthology.orchestra.run.smithi039.stderr:Cannot find device "ceph-brx" 2022-04-28T14:39:26.805 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-04-28T14:39:26.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-28T14:39:26.806 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2022-04-28T14:39:26.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-28T14:39:26.828 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2022-04-28T14:39:26.905 INFO:teuthology.orchestra.run.smithi037.stderr:Cannot find device "ceph-brx" 2022-04-28T14:39:26.906 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-04-28T14:39:26.907 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2022-04-28T14:39:26.907 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2022-04-28T14:39:26.908 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2022-04-28T14:39:26.908 INFO:tasks.cephfs.mount:self.client.name = client.0 2022-04-28T14:39:26.908 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2022-04-28T14:39:26.908 INFO:tasks.cephfs.mount:self.cephfs_name = None 2022-04-28T14:39:26.908 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2022-04-28T14:39:26.908 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2022-04-28T14:39:26.908 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2022-04-28T14:39:26.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-28T14:39:26.908 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2022-04-28T14:39:26.967 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2022-04-28T14:39:26.967 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2022-04-28T14:39:26.968 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2022-04-28T14:39:26.968 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2022-04-28T14:39:26.968 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2022-04-28T14:39:26.968 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2022-04-28T14:39:26.968 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-04-28T14:39:26.968 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2022-04-28T14:39:26.968 INFO:teuthology.orchestra.run.smithi037.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2022-04-28T14:39:26.968 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2022-04-28T14:39:26.968 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2022-04-28T14:39:26.969 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42589sec preferred_lft 42589sec 2022-04-28T14:39:26.969 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2022-04-28T14:39:26.969 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2022-04-28T14:39:26.969 INFO:teuthology.orchestra.run.smithi037.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-04-28T14:39:26.969 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2022-04-28T14:39:26.969 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-04-28T14:39:26.969 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2022-04-28T14:39:26.970 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2022-04-28T14:39:26.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-28T14:39:26.970 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2022-04-28T14:39:26.970 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2022-04-28T14:39:26.970 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2022-04-28T14:39:26.970 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2022-04-28T14:39:26.970 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2022-04-28T14:39:26.971 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2022-04-28T14:39:26.971 DEBUG:teuthology.orchestra.run.smithi037:> ') 2022-04-28T14:39:27.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-28T14:39:27.148 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2022-04-28T14:39:27.186 INFO:teuthology.orchestra.run.smithi037.stdout:1 2022-04-28T14:39:27.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-28T14:39:27.188 DEBUG:teuthology.orchestra.run.smithi037:> route 2022-04-28T14:39:27.263 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2022-04-28T14:39:27.263 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2022-04-28T14:39:27.263 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2022-04-28T14:39:27.264 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2022-04-28T14:39:27.264 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2022-04-28T14:39:27.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-28T14:39:27.264 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2022-04-28T14:39:27.265 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2022-04-28T14:39:27.265 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2022-04-28T14:39:27.265 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2022-04-28T14:39:27.265 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2022-04-28T14:39:27.265 DEBUG:teuthology.orchestra.run.smithi037:> ') 2022-04-28T14:39:27.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-28T14:39:27.541 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2022-04-28T14:39:27.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-28T14:39:27.558 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2022-04-28T14:39:27.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-28T14:39:27.615 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2022-04-28T14:39:27.615 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2022-04-28T14:39:27.615 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2022-04-28T14:39:27.616 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2022-04-28T14:39:27.616 DEBUG:teuthology.orchestra.run.smithi037:> ') 2022-04-28T14:39:27.711 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2022-04-28T14:39:27.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-28T14:39:27.712 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2022-04-28T14:39:27.712 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2022-04-28T14:39:27.712 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2022-04-28T14:39:27.712 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2022-04-28T14:39:27.712 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2022-04-28T14:39:27.712 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2022-04-28T14:39:27.712 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2022-04-28T14:39:27.712 DEBUG:teuthology.orchestra.run.smithi037:> ') 2022-04-28T14:39:27.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-28T14:39:27.900 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2022-04-28T14:39:27.900 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2022-04-28T14:39:27.901 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2022-04-28T14:39:27.901 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2022-04-28T14:39:27.901 DEBUG:teuthology.orchestra.run.smithi037:> ') 2022-04-28T14:39:28.000 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2022-04-28T14:39:28.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-04-28T14:39:28.000 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.0 2022-04-28T14:39:28.017 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2022-04-28T14:39:28.017 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2022-04-28T14:39:28.086 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-04-28T14:39:28.086 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-04-28T14:39:28.152 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-04-28T14:39:28.153 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-04-28T14:39:28.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-04-28T14:39:28.154 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2022-04-28T14:39:28.211 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-04-28T14:39:28.211 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 0 /home/ubuntu/cephtest/mnt.0 2022-04-28T14:39:28.253 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2022-04-28T14:39:28.292 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-04-28T14:39:28.292 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-04-28T14:39:28.359 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-04-28T14:39:28.360 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-04-28T14:39:28.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-04-28T14:39:28.361 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2022-04-28T14:39:28.408 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:2022-04-28 14:39:28.404 7f4390cfa200 -1 init, newargv = 0x55a34fda9e50 newargc=9 2022-04-28T14:39:28.408 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[85195]: starting ceph client 2022-04-28T14:39:28.416 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[85195]: starting fuse 2022-04-28T14:39:28.417 INFO:teuthology.orchestra.run.smithi037.stdout:47 2022-04-28T14:39:28.417 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2022-04-28T14:39:28.418 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2022-04-28T14:39:28.418 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2022-04-28T14:39:28.418 DEBUG:teuthology.orchestra.run.smithi037:> import re 2022-04-28T14:39:28.418 DEBUG:teuthology.orchestra.run.smithi037:> import os 2022-04-28T14:39:28.418 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2022-04-28T14:39:28.418 DEBUG:teuthology.orchestra.run.smithi037:> 2022-04-28T14:39:28.418 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2022-04-28T14:39:28.419 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2022-04-28T14:39:28.419 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2022-04-28T14:39:28.419 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2022-04-28T14:39:28.419 DEBUG:teuthology.orchestra.run.smithi037:> 2022-04-28T14:39:28.419 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2022-04-28T14:39:28.419 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2022-04-28T14:39:28.419 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2022-04-28T14:39:28.419 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2022-04-28T14:39:28.420 DEBUG:teuthology.orchestra.run.smithi037:> 2022-04-28T14:39:28.420 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2022-04-28T14:39:28.420 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-04-28T14:39:28.420 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2022-04-28T14:39:28.420 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2022-04-28T14:39:28.420 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2022-04-28T14:39:28.420 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2022-04-28T14:39:28.420 DEBUG:teuthology.orchestra.run.smithi037:> return f 2022-04-28T14:39:28.420 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-04-28T14:39:28.420 DEBUG:teuthology.orchestra.run.smithi037:> 2022-04-28T14:39:28.421 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.0")) 2022-04-28T14:39:28.421 DEBUG:teuthology.orchestra.run.smithi037:> ' 2022-04-28T14:39:28.541 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.0.85195.asok 2022-04-28T14:39:28.724 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.85195.asok 2022-04-28T14:39:28.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-04-28T14:39:28.724 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.85195.asok status 2022-04-28T14:39:28.868 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2022-04-28T14:39:28.868 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2022-04-28T14:39:28.868 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "ca74598065096e6fcbd8433c8779a2be0c889351", 2022-04-28T14:39:28.868 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 14.2.22 (ca74598065096e6fcbd8433c8779a2be0c889351) nautilus (stable)", 2022-04-28T14:39:28.868 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "0", 2022-04-28T14:39:28.868 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2022-04-28T14:39:28.868 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2022-04-28T14:39:28.868 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "85195", 2022-04-28T14:39:28.868 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2022-04-28T14:39:28.869 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2022-04-28T14:39:28.869 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2022-04-28T14:39:28.869 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2022-04-28T14:39:28.869 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4442, 2022-04-28T14:39:28.869 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2022-04-28T14:39:28.869 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2022-04-28T14:39:28.869 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2022-04-28T14:39:28.869 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 4442 2022-04-28T14:39:28.869 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2022-04-28T14:39:28.870 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2022-04-28T14:39:28.870 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2022-04-28T14:39:28.870 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2022-04-28T14:39:28.870 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2217594125 2022-04-28T14:39:28.870 INFO:teuthology.orchestra.run.smithi037.stdout: } 2022-04-28T14:39:28.870 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2022-04-28T14:39:28.870 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2022-04-28T14:39:28.870 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2022-04-28T14:39:28.870 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2022-04-28T14:39:28.870 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2217594125 2022-04-28T14:39:28.871 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2022-04-28T14:39:28.871 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.4442 172.21.15.37:0/2217594125", 2022-04-28T14:39:28.871 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "172.21.15.37:0/2217594125", 2022-04-28T14:39:28.871 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2022-04-28T14:39:28.871 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 9, 2022-04-28T14:39:28.871 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 17, 2022-04-28T14:39:28.871 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2022-04-28T14:39:28.871 INFO:teuthology.orchestra.run.smithi037.stdout: "blacklisted": false, 2022-04-28T14:39:28.871 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2022-04-28T14:39:28.872 INFO:teuthology.orchestra.run.smithi037.stdout:} 2022-04-28T14:39:28.877 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2022-04-28T14:39:28.877 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi039.front.sepia.ceph.com 2022-04-28T14:39:28.877 INFO:tasks.cephfs.mount:self.client.name = client.1 2022-04-28T14:39:28.877 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2022-04-28T14:39:28.877 INFO:tasks.cephfs.mount:self.cephfs_name = None 2022-04-28T14:39:28.877 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2022-04-28T14:39:28.877 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2022-04-28T14:39:28.877 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2022-04-28T14:39:28.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-28T14:39:28.878 DEBUG:teuthology.orchestra.run.smithi039:> ip addr 2022-04-28T14:39:28.899 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2022-04-28T14:39:28.900 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2022-04-28T14:39:28.900 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2022-04-28T14:39:28.900 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2022-04-28T14:39:28.900 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2022-04-28T14:39:28.900 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2022-04-28T14:39:28.900 INFO:teuthology.orchestra.run.smithi039.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-04-28T14:39:28.900 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c6 brd ff:ff:ff:ff:ff:ff 2022-04-28T14:39:28.900 INFO:teuthology.orchestra.run.smithi039.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-04-28T14:39:28.901 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c7 brd ff:ff:ff:ff:ff:ff 2022-04-28T14:39:28.901 INFO:teuthology.orchestra.run.smithi039.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2022-04-28T14:39:28.901 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:70 brd ff:ff:ff:ff:ff:ff 2022-04-28T14:39:28.901 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.21.15.39/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2022-04-28T14:39:28.901 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft 42664sec preferred_lft 42664sec 2022-04-28T14:39:28.901 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::ec4:7aff:febd:1370/64 scope link 2022-04-28T14:39:28.901 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2022-04-28T14:39:28.901 INFO:teuthology.orchestra.run.smithi039.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-04-28T14:39:28.901 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:71 brd ff:ff:ff:ff:ff:ff 2022-04-28T14:39:28.902 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2022-04-28T14:39:28.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-28T14:39:28.902 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2022-04-28T14:39:28.902 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2022-04-28T14:39:28.902 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add name ceph-brx type bridge 2022-04-28T14:39:28.902 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip addr flush dev ceph-brx 2022-04-28T14:39:28.902 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set ceph-brx up 2022-04-28T14:39:28.902 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2022-04-28T14:39:28.903 DEBUG:teuthology.orchestra.run.smithi039:> ') 2022-04-28T14:39:29.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-28T14:39:29.089 DEBUG:teuthology.orchestra.run.smithi039:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2022-04-28T14:39:29.130 INFO:teuthology.orchestra.run.smithi039.stdout:1 2022-04-28T14:39:29.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-28T14:39:29.132 DEBUG:teuthology.orchestra.run.smithi039:> route 2022-04-28T14:39:29.214 INFO:teuthology.orchestra.run.smithi039.stdout:Kernel IP routing table 2022-04-28T14:39:29.214 INFO:teuthology.orchestra.run.smithi039.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2022-04-28T14:39:29.214 INFO:teuthology.orchestra.run.smithi039.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2022-04-28T14:39:29.214 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2022-04-28T14:39:29.214 INFO:teuthology.orchestra.run.smithi039.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2022-04-28T14:39:29.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-28T14:39:29.215 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2022-04-28T14:39:29.215 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2022-04-28T14:39:29.215 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2022-04-28T14:39:29.215 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2022-04-28T14:39:29.215 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2022-04-28T14:39:29.215 DEBUG:teuthology.orchestra.run.smithi039:> ') 2022-04-28T14:39:29.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-28T14:39:29.479 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2022-04-28T14:39:29.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-28T14:39:29.496 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list-id 2022-04-28T14:39:29.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-28T14:39:29.553 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2022-04-28T14:39:29.554 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2022-04-28T14:39:29.554 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2022-04-28T14:39:29.554 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2022-04-28T14:39:29.554 DEBUG:teuthology.orchestra.run.smithi039:> ') 2022-04-28T14:39:29.649 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2022-04-28T14:39:29.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-28T14:39:29.649 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2022-04-28T14:39:29.650 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2022-04-28T14:39:29.650 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2022-04-28T14:39:29.650 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2022-04-28T14:39:29.650 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2022-04-28T14:39:29.650 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2022-04-28T14:39:29.650 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2022-04-28T14:39:29.650 DEBUG:teuthology.orchestra.run.smithi039:> ') 2022-04-28T14:39:29.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-04-28T14:39:29.867 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec bash -c ' 2022-04-28T14:39:29.867 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2022-04-28T14:39:29.867 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set brx.0 up 2022-04-28T14:39:29.867 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set dev brx.0 master ceph-brx 2022-04-28T14:39:29.867 DEBUG:teuthology.orchestra.run.smithi039:> ') 2022-04-28T14:39:29.965 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2022-04-28T14:39:29.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-04-28T14:39:29.966 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -m 0000 -p -v /home/ubuntu/cephtest/mnt.1 2022-04-28T14:39:29.982 INFO:teuthology.orchestra.run.smithi039.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2022-04-28T14:39:29.983 DEBUG:teuthology.orchestra.run.smithi039:> sudo modprobe fuse 2022-04-28T14:39:30.050 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-04-28T14:39:30.051 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-04-28T14:39:30.117 INFO:teuthology.orchestra.run.smithi039.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-04-28T14:39:30.118 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-04-28T14:39:30.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-04-28T14:39:30.119 DEBUG:teuthology.orchestra.run.smithi039:> ls /sys/fs/fuse/connections 2022-04-28T14:39:30.175 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-04-28T14:39:30.176 DEBUG:teuthology.orchestra.run.smithi039:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' --id 1 /home/ubuntu/cephtest/mnt.1 2022-04-28T14:39:30.218 DEBUG:teuthology.orchestra.run.smithi039:> sudo modprobe fuse 2022-04-28T14:39:30.245 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-04-28T14:39:30.245 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-04-28T14:39:30.311 INFO:teuthology.orchestra.run.smithi039.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-04-28T14:39:30.312 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-04-28T14:39:30.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-04-28T14:39:30.313 DEBUG:teuthology.orchestra.run.smithi039:> ls /sys/fs/fuse/connections 2022-04-28T14:39:30.359 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi039.stderr:2022-04-28 14:39:30.354 7f05d3809200 -1 init, newargv = 0x55be93570d80 newargc=9 2022-04-28T14:39:30.359 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi039.stderr:ceph-fuse[85154]: starting ceph client 2022-04-28T14:39:30.367 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi039.stderr:ceph-fuse[85154]: starting fuse 2022-04-28T14:39:30.370 INFO:teuthology.orchestra.run.smithi039.stdout:46 2022-04-28T14:39:30.370 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2022-04-28T14:39:30.370 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2022-04-28T14:39:30.371 DEBUG:teuthology.orchestra.run.smithi039:> import glob 2022-04-28T14:39:30.371 DEBUG:teuthology.orchestra.run.smithi039:> import re 2022-04-28T14:39:30.371 DEBUG:teuthology.orchestra.run.smithi039:> import os 2022-04-28T14:39:30.371 DEBUG:teuthology.orchestra.run.smithi039:> import subprocess 2022-04-28T14:39:30.371 DEBUG:teuthology.orchestra.run.smithi039:> 2022-04-28T14:39:30.371 DEBUG:teuthology.orchestra.run.smithi039:> def _find_admin_socket(client_name): 2022-04-28T14:39:30.371 DEBUG:teuthology.orchestra.run.smithi039:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2022-04-28T14:39:30.371 DEBUG:teuthology.orchestra.run.smithi039:> files = glob.glob(asok_path) 2022-04-28T14:39:30.371 DEBUG:teuthology.orchestra.run.smithi039:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2022-04-28T14:39:30.371 DEBUG:teuthology.orchestra.run.smithi039:> 2022-04-28T14:39:30.372 DEBUG:teuthology.orchestra.run.smithi039:> # Given a non-glob path, it better be there 2022-04-28T14:39:30.372 DEBUG:teuthology.orchestra.run.smithi039:> if "*" not in asok_path: 2022-04-28T14:39:30.372 DEBUG:teuthology.orchestra.run.smithi039:> assert(len(files) == 1) 2022-04-28T14:39:30.372 DEBUG:teuthology.orchestra.run.smithi039:> return files[0] 2022-04-28T14:39:30.372 DEBUG:teuthology.orchestra.run.smithi039:> 2022-04-28T14:39:30.372 DEBUG:teuthology.orchestra.run.smithi039:> for f in files: 2022-04-28T14:39:30.372 DEBUG:teuthology.orchestra.run.smithi039:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-04-28T14:39:30.372 DEBUG:teuthology.orchestra.run.smithi039:> if os.path.exists("/proc/{0}".format(pid)): 2022-04-28T14:39:30.372 DEBUG:teuthology.orchestra.run.smithi039:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2022-04-28T14:39:30.373 DEBUG:teuthology.orchestra.run.smithi039:> contents = proc_f.read() 2022-04-28T14:39:30.373 DEBUG:teuthology.orchestra.run.smithi039:> if mountpoint in contents: 2022-04-28T14:39:30.373 DEBUG:teuthology.orchestra.run.smithi039:> return f 2022-04-28T14:39:30.373 DEBUG:teuthology.orchestra.run.smithi039:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-04-28T14:39:30.373 DEBUG:teuthology.orchestra.run.smithi039:> 2022-04-28T14:39:30.373 DEBUG:teuthology.orchestra.run.smithi039:> print(_find_admin_socket("client.1")) 2022-04-28T14:39:30.373 DEBUG:teuthology.orchestra.run.smithi039:> ' 2022-04-28T14:39:30.493 INFO:teuthology.orchestra.run.smithi039.stdout:/var/run/ceph/ceph-client.1.85154.asok 2022-04-28T14:39:30.675 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.85154.asok 2022-04-28T14:39:30.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-04-28T14:39:30.676 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.85154.asok status 2022-04-28T14:39:30.819 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2022-04-28T14:39:30.819 INFO:teuthology.orchestra.run.smithi039.stdout: "metadata": { 2022-04-28T14:39:30.819 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_sha1": "ca74598065096e6fcbd8433c8779a2be0c889351", 2022-04-28T14:39:30.819 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_version": "ceph version 14.2.22 (ca74598065096e6fcbd8433c8779a2be0c889351) nautilus (stable)", 2022-04-28T14:39:30.819 INFO:teuthology.orchestra.run.smithi039.stdout: "entity_id": "1", 2022-04-28T14:39:30.819 INFO:teuthology.orchestra.run.smithi039.stdout: "hostname": "smithi039", 2022-04-28T14:39:30.819 INFO:teuthology.orchestra.run.smithi039.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2022-04-28T14:39:30.820 INFO:teuthology.orchestra.run.smithi039.stdout: "pid": "85154", 2022-04-28T14:39:30.820 INFO:teuthology.orchestra.run.smithi039.stdout: "root": "/" 2022-04-28T14:39:30.820 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2022-04-28T14:39:30.820 INFO:teuthology.orchestra.run.smithi039.stdout: "dentry_count": 0, 2022-04-28T14:39:30.820 INFO:teuthology.orchestra.run.smithi039.stdout: "dentry_pinned_count": 0, 2022-04-28T14:39:30.820 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 4448, 2022-04-28T14:39:30.820 INFO:teuthology.orchestra.run.smithi039.stdout: "inst": { 2022-04-28T14:39:30.820 INFO:teuthology.orchestra.run.smithi039.stdout: "name": { 2022-04-28T14:39:30.820 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "client", 2022-04-28T14:39:30.821 INFO:teuthology.orchestra.run.smithi039.stdout: "num": 4448 2022-04-28T14:39:30.821 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2022-04-28T14:39:30.821 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": { 2022-04-28T14:39:30.821 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v1", 2022-04-28T14:39:30.821 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:0", 2022-04-28T14:39:30.821 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 1308442088 2022-04-28T14:39:30.821 INFO:teuthology.orchestra.run.smithi039.stdout: } 2022-04-28T14:39:30.821 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2022-04-28T14:39:30.821 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": { 2022-04-28T14:39:30.821 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v1", 2022-04-28T14:39:30.822 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "172.21.15.39:0", 2022-04-28T14:39:30.822 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 1308442088 2022-04-28T14:39:30.822 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2022-04-28T14:39:30.822 INFO:teuthology.orchestra.run.smithi039.stdout: "inst_str": "client.4448 172.21.15.39:0/1308442088", 2022-04-28T14:39:30.822 INFO:teuthology.orchestra.run.smithi039.stdout: "addr_str": "172.21.15.39:0/1308442088", 2022-04-28T14:39:30.822 INFO:teuthology.orchestra.run.smithi039.stdout: "inode_count": 1, 2022-04-28T14:39:30.822 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_epoch": 9, 2022-04-28T14:39:30.822 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_epoch": 17, 2022-04-28T14:39:30.822 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_epoch_barrier": 0, 2022-04-28T14:39:30.823 INFO:teuthology.orchestra.run.smithi039.stdout: "blacklisted": false, 2022-04-28T14:39:30.823 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs" 2022-04-28T14:39:30.823 INFO:teuthology.orchestra.run.smithi039.stdout:} 2022-04-28T14:39:30.828 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-04-28T14:39:30.828 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2022-04-28T14:39:30.828 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.0 2022-04-28T14:39:30.850 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2022-04-28T14:39:30.851 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-04-28T14:39:30.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-04-28T14:39:30.851 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2022-04-28T14:39:30.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-04-28T14:39:30.926 DEBUG:teuthology.orchestra.run.smithi039:> stat --file-system '--printf=%T 2022-04-28T14:39:30.926 DEBUG:teuthology.orchestra.run.smithi039:> ' -- /home/ubuntu/cephtest/mnt.1 2022-04-28T14:39:30.944 INFO:teuthology.orchestra.run.smithi039.stdout:fuseblk 2022-04-28T14:39:30.944 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2022-04-28T14:39:30.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-04-28T14:39:30.945 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2022-04-28T14:39:35.559 INFO:teuthology.run_tasks:Running task print... 2022-04-28T14:39:35.569 INFO:teuthology.task.print:**** done nautilus client 2022-04-28T14:39:35.569 INFO:teuthology.run_tasks:Running task print... 2022-04-28T14:39:35.617 INFO:teuthology.task.print:**** done fsstress 2022-04-28T14:39:35.617 INFO:teuthology.run_tasks:Running task mds_pre_upgrade... 2022-04-28T14:39:35.668 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-28T14:39:35.812 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.807 7f9031aa8700 1 Processor -- start 2022-04-28T14:39:35.812 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.807 7f9031aa8700 1 -- start start 2022-04-28T14:39:35.814 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.807 7f9031aa8700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f902c0ff240 0x7f902c1b6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:35.814 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.807 7f9031aa8700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f902c1b6eb0 0x7f902c1b9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:35.814 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.808 7f9031aa8700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f902c0ab2b0 con 0x7f902c0f6460 2022-04-28T14:39:35.815 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.808 7f9031aa8700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902c115ea0 con 0x7f902c0ff240 2022-04-28T14:39:35.815 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.808 7f9031aa8700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f902c10b8a0 con 0x7f902c1b6eb0 2022-04-28T14:39:35.815 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.808 7f902a861700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f902c0f6460 0x7f902c0fea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38592/0 (socket says 172.21.15.22:38592) 2022-04-28T14:39:35.815 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.808 7f902a861700 1 -- 172.21.15.22:0/2073648417 learned_addr learned my addr 172.21.15.22:0/2073648417 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:39:35.815 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.808 7f902a060700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f902c0ff240 0x7f902c1b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:35.815 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.808 7f902b062700 1 --2- 172.21.15.22:0/2073648417 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f902c1b6eb0 0x7f902c1b9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:35.815 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.808 7f902b062700 1 -- 172.21.15.22:0/2073648417 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f902c0ff240 msgr2=0x7f902c1b6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:35.815 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.808 7f902b062700 1 --2- 172.21.15.22:0/2073648417 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f902c0ff240 0x7f902c1b6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:35.815 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.808 7f902b062700 1 -- 172.21.15.22:0/2073648417 >> v1:172.21.15.22:6789/0 conn(0x7f902c0f6460 legacy=0x7f902c0fea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:35.816 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.808 7f902b062700 1 -- 172.21.15.22:0/2073648417 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902c0f68b0 con 0x7f902c1b6eb0 2022-04-28T14:39:35.816 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.808 7f902985f700 1 -- 172.21.15.22:0/2073648417 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745192400 0 0) 0x7f9020001110 con 0x7f902c0f6460 2022-04-28T14:39:35.816 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.808 7f902a060700 1 --2- 172.21.15.22:0/2073648417 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f902c0ff240 0x7f902c1b6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:35.816 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.808 7f902b062700 1 --2- 172.21.15.22:0/2073648417 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f902c1b6eb0 0x7f902c1b9310 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f902c116250 tx=0x7f9024009cf0).ready entity=mon.2 client_cookie=a17cbc8b028c5404 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:35.816 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.808 7f902985f700 1 -- 172.21.15.22:0/2073648417 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f902c0f68b0 con 0x7f902c1b6eb0 2022-04-28T14:39:35.816 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.808 7f902985f700 1 -- 172.21.15.22:0/2073648417 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902400b840 con 0x7f902c1b6eb0 2022-04-28T14:39:35.816 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.808 7f902985f700 1 -- 172.21.15.22:0/2073648417 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f902400ba20 con 0x7f902c1b6eb0 2022-04-28T14:39:35.816 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.808 7f9031aa8700 1 -- 172.21.15.22:0/2073648417 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f902c1b6eb0 msgr2=0x7f902c1b9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:35.816 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.808 7f9031aa8700 1 --2- 172.21.15.22:0/2073648417 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f902c1b6eb0 0x7f902c1b9310 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f902c116250 tx=0x7f9024009cf0).stop 2022-04-28T14:39:35.816 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.809 7f9031aa8700 1 -- 172.21.15.22:0/2073648417 shutdown_connections 2022-04-28T14:39:35.817 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.809 7f9031aa8700 1 --2- 172.21.15.22:0/2073648417 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f902c1b6eb0 0x7f902c1b9310 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:35.817 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.809 7f9031aa8700 1 --2- 172.21.15.22:0/2073648417 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f902c0ff240 0x7f902c1b6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:35.817 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.809 7f9031aa8700 1 -- 172.21.15.22:0/2073648417 >> 172.21.15.22:0/2073648417 conn(0x7f902c1171f0 msgr2=0x7f902c0f2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:35.817 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.809 7f9031aa8700 1 -- 172.21.15.22:0/2073648417 shutdown_connections 2022-04-28T14:39:35.817 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.809 7f9031aa8700 1 -- 172.21.15.22:0/2073648417 wait complete. 2022-04-28T14:39:35.840 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.833 7f9031aa8700 1 Processor -- start 2022-04-28T14:39:35.840 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.833 7f9031aa8700 1 -- start start 2022-04-28T14:39:35.840 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.833 7f9031aa8700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f902c0cf2e0 0x7f902c1c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:35.840 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.833 7f9031aa8700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f902c1c4200 0x7f902c0b7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:35.840 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.833 7f9031aa8700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f902c1c4650 0x7f902c0b8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:35.840 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.833 7f9031aa8700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c121ea0 con 0x7f902c1c4650 2022-04-28T14:39:35.840 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.833 7f9031aa8700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902c0cc7d0 con 0x7f902c0cf2e0 2022-04-28T14:39:35.841 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.833 7f9031aa8700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f902c0cee40 con 0x7f902c1c4200 2022-04-28T14:39:35.841 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.833 7f902a861700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f902c0cf2e0 0x7f902c1c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:35.841 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.833 7f902a060700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f902c1c4200 0x7f902c0b7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:35.841 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.833 7f902a861700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f902c0cf2e0 0x7f902c1c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46770/0 (socket says 172.21.15.22:46770) 2022-04-28T14:39:35.841 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.833 7f902a861700 1 -- 172.21.15.22:0/3630218876 learned_addr learned my addr 172.21.15.22:0/3630218876 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:35.841 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.833 7f902b062700 1 --2- 172.21.15.22:0/3630218876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f902c1c4650 0x7f902c0b8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:35.841 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.834 7f902a861700 1 -- 172.21.15.22:0/3630218876 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f902c1c4200 msgr2=0x7f902c0b7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:35.841 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.834 7f902a861700 1 --2- 172.21.15.22:0/3630218876 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f902c1c4200 0x7f902c0b7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:35.841 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.834 7f902a861700 1 -- 172.21.15.22:0/3630218876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f902c1c4650 msgr2=0x7f902c0b8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:35.841 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.834 7f902a861700 1 --2- 172.21.15.22:0/3630218876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f902c1c4650 0x7f902c0b8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:35.842 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.834 7f902a861700 1 -- 172.21.15.22:0/3630218876 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902c0cfbd0 con 0x7f902c0cf2e0 2022-04-28T14:39:35.842 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.834 7f902a060700 1 --2- 172.21.15.22:0/3630218876 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f902c1c4200 0x7f902c0b7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:35.842 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.834 7f902a861700 1 --2- 172.21.15.22:0/3630218876 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f902c0cf2e0 0x7f902c1c3bd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f902c0b8f90 tx=0x7f902000c860).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:35.842 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.834 7f901bfff700 1 -- 172.21.15.22:0/3630218876 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f90200072e0 con 0x7f902c0cf2e0 2022-04-28T14:39:35.842 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.834 7f901bfff700 1 -- 172.21.15.22:0/3630218876 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9020005620 con 0x7f902c0cf2e0 2022-04-28T14:39:35.842 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.834 7f9031aa8700 1 -- 172.21.15.22:0/3630218876 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f902c0cca40 con 0x7f902c0cf2e0 2022-04-28T14:39:35.842 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.834 7f901bfff700 1 -- 172.21.15.22:0/3630218876 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f90200059f0 con 0x7f902c0cf2e0 2022-04-28T14:39:35.842 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.834 7f9031aa8700 1 -- 172.21.15.22:0/3630218876 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f902c0cfe20 con 0x7f902c0cf2e0 2022-04-28T14:39:35.842 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.835 7f901bfff700 1 -- 172.21.15.22:0/3630218876 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f902001a070 con 0x7f902c0cf2e0 2022-04-28T14:39:35.842 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.835 7f901bfff700 1 -- 172.21.15.22:0/3630218876 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f9020028ea0 con 0x7f902c0cf2e0 2022-04-28T14:39:35.843 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.835 7f9031aa8700 1 -- 172.21.15.22:0/3630218876 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f902c0f0390 con 0x7f902c0cf2e0 2022-04-28T14:39:35.843 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.838 7f901bfff700 1 -- 172.21.15.22:0/3630218876 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f90200070d0 con 0x7f902c0cf2e0 2022-04-28T14:39:35.940 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.936 7f9031aa8700 1 -- 172.21.15.22:0/3630218876 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f902c0a5b80 con 0x7f902c0cf2e0 2022-04-28T14:39:35.941 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.936 7f901bfff700 1 -- 172.21.15.22:0/3630218876 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8818 (secure 0 0 0) 0x7f9020000c30 con 0x7f902c0cf2e0 2022-04-28T14:39:35.941 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:35.942 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":17,"fsid":"3047163a-0285-4058-8e05-ce74c6fbb9c5","created":"2022-04-28 14:38:54.232890","modified":"2022-04-28 14:39:26.606234","last_up_change":"2022-04-28 14:39:00.269721","last_in_change":"2022-04-28 14:39:00.269721","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-04-28 14:39:03.639717","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-04-28 14:39:12.000229","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-04-28 14:39:12.915097","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782ee638-1ada-48d9-9454-f9e0ca8a3135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6800","nonce":87556}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":87556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":87556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":87556}]},"public_addr":"172.21.15.22:6800/87556","cluster_addr":"172.21.15.22:6801/87556","heartbeat_back_addr":"172.21.15.22:6803/87556","heartbeat_front_addr":"172.21.15.22:6802/87556","state":["exists","up"]},{"osd":1,"uuid":"61ca6f96-fb4f-4c0f-b68b-edf1e7011f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":87557}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":87557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":87557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":87557}]},"public_addr":"172.21.15.22:6804/87557","cluster_addr":"172.21.15.22:6805/87557","heartbeat_back_addr":"172.21.15.22:6807/87557","heartbeat_front_addr":"172.21.15.22:6806/87557","state":["exists","up"]},{"osd":2,"uuid":"4b3043b9-50df-4b7f-a55a-ac8e6148c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":87558}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":87558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":87558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":87558}]},"public_addr":"172.21.15.22:6813/87558","cluster_addr":"172.21.15.22:6814/87558","heartbeat_back_addr":"172.21.15.22:6816/87558","heartbeat_front_addr":"172.21.15.22:6815/87558","state":["exists","up"]},{"osd":3,"uuid":"7807bcd1-53f8-44b5-9992-57c328e5b299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":87561}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":87561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":87561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":87561}]},"public_addr":"172.21.15.22:6809/87561","cluster_addr":"172.21.15.22:6810/87561","heartbeat_back_addr":"172.21.15.22:6812/87561","heartbeat_front_addr":"172.21.15.22:6811/87561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-04-28T14:39:35.943 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.937 7f9031aa8700 1 -- 172.21.15.22:0/3630218876 >> v1:172.21.15.22:6808/86956 conn(0x7f900801c1b0 legacy=0x7f900801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:35.943 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.937 7f9031aa8700 1 -- 172.21.15.22:0/3630218876 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f902c0cf2e0 msgr2=0x7f902c1c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:35.943 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.937 7f9031aa8700 1 --2- 172.21.15.22:0/3630218876 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f902c0cf2e0 0x7f902c1c3bd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f902c0b8f90 tx=0x7f902000c860).stop 2022-04-28T14:39:35.943 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.938 7f9031aa8700 1 -- 172.21.15.22:0/3630218876 shutdown_connections 2022-04-28T14:39:35.943 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.938 7f9031aa8700 1 --2- 172.21.15.22:0/3630218876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f902c1c4650 0x7f902c0b8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:35.943 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.938 7f9031aa8700 1 --2- 172.21.15.22:0/3630218876 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f902c0cf2e0 0x7f902c1c3bd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:35.943 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.938 7f9031aa8700 1 --2- 172.21.15.22:0/3630218876 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f902c1c4200 0x7f902c0b7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:35.944 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.938 7f9031aa8700 1 -- 172.21.15.22:0/3630218876 >> 172.21.15.22:0/3630218876 conn(0x7f902c0daec0 msgr2=0x7f902c1b97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:35.944 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.938 7f9031aa8700 1 -- 172.21.15.22:0/3630218876 shutdown_connections 2022-04-28T14:39:35.944 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:35.938 7f9031aa8700 1 -- 172.21.15.22:0/3630218876 wait complete. 2022-04-28T14:39:35.953 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2022-04-28 14:39:03.639717', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2022-04-28 14:39:12.000229', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2022-04-28 14:39:12.915097', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-04-28T14:39:35.954 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-04-28T14:39:36.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.081 7f70af96f700 1 Processor -- start 2022-04-28T14:39:36.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.081 7f70af96f700 1 -- start start 2022-04-28T14:39:36.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.082 7f70af96f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f70a80f6200 0x7f70a80f1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:36.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.082 7f70af96f700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f70a80f1cc0 0x7f70a81b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:36.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.082 7f70af96f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a80ab080 con 0x7f70a80f1870 2022-04-28T14:39:36.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.082 7f70af96f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a810ebb0 con 0x7f70a80f6200 2022-04-28T14:39:36.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.082 7f70af96f700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a81b53f0 con 0x7f70a80f1cc0 2022-04-28T14:39:36.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.082 7f70acf6f700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f70a80f1cc0 0x7f70a81b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:36.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.082 7f70acf6f700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f70a80f1cc0 0x7f70a81b4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46782/0 (socket says 172.21.15.22:46782) 2022-04-28T14:39:36.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.082 7f70acf6f700 1 -- 172.21.15.22:0/533901182 learned_addr learned my addr 172.21.15.22:0/533901182 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:36.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.082 7f70a7fff700 1 --2- 172.21.15.22:0/533901182 >> v2:172.21.15.22:3300/0 conn(0x7f70a80f6200 0x7f70a80f1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:36.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.082 7f70a7fff700 1 -- 172.21.15.22:0/533901182 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f70a80f1cc0 msgr2=0x7f70a81b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:36.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.082 7f70a7fff700 1 --2- 172.21.15.22:0/533901182 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f70a80f1cc0 0x7f70a81b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.082 7f70a7fff700 1 -- 172.21.15.22:0/533901182 >> v1:172.21.15.22:6789/0 conn(0x7f70a80f1870 legacy=0x7f70a81b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:36.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.082 7f70a77fe700 1 -- 172.21.15.22:0/533901182 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855366502 0 0) 0x7f7090001110 con 0x7f70a80f1870 2022-04-28T14:39:36.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.082 7f70a7fff700 1 -- 172.21.15.22:0/533901182 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a81160d0 con 0x7f70a80f6200 2022-04-28T14:39:36.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.082 7f70acf6f700 1 --2- 172.21.15.22:0/533901182 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f70a80f1cc0 0x7f70a81b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:36.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.082 7f70a7fff700 1 --2- 172.21.15.22:0/533901182 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a80f6200 0x7f70a80f1240 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f7098002f70 tx=0x7f709800b9f0).ready entity=mon.0 client_cookie=245c1d192584dcd2 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:36.092 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.082 7f70a77fe700 1 -- 172.21.15.22:0/533901182 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f70a81160d0 con 0x7f70a80f6200 2022-04-28T14:39:36.092 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.083 7f70a77fe700 1 -- 172.21.15.22:0/533901182 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709800d5c0 con 0x7f70a80f6200 2022-04-28T14:39:36.092 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.083 7f70a77fe700 1 -- 172.21.15.22:0/533901182 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f709800d990 con 0x7f70a80f6200 2022-04-28T14:39:36.092 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.083 7f70af96f700 1 -- 172.21.15.22:0/533901182 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a80f6200 msgr2=0x7f70a80f1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:36.092 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.083 7f70af96f700 1 --2- 172.21.15.22:0/533901182 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a80f6200 0x7f70a80f1240 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f7098002f70 tx=0x7f709800b9f0).stop 2022-04-28T14:39:36.092 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.083 7f70af96f700 1 -- 172.21.15.22:0/533901182 shutdown_connections 2022-04-28T14:39:36.093 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.083 7f70af96f700 1 --2- 172.21.15.22:0/533901182 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f70a80f1cc0 0x7f70a81b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.093 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.083 7f70af96f700 1 --2- 172.21.15.22:0/533901182 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a80f6200 0x7f70a80f1240 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.093 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.083 7f70af96f700 1 -- 172.21.15.22:0/533901182 >> 172.21.15.22:0/533901182 conn(0x7f70a81170f0 msgr2=0x7f70a80f2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:36.093 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.083 7f70af96f700 1 -- 172.21.15.22:0/533901182 shutdown_connections 2022-04-28T14:39:36.093 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.083 7f70af96f700 1 -- 172.21.15.22:0/533901182 wait complete. 2022-04-28T14:39:36.114 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.107 7f70af96f700 1 Processor -- start 2022-04-28T14:39:36.114 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.107 7f70af96f700 1 -- start start 2022-04-28T14:39:36.114 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.107 7f70af96f700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f70a80b6d20 0x7f70a80b7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:36.114 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.107 7f70af96f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a80b84a0 0x7f70a80b88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:36.114 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.107 7f70af96f700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f70a81c9900 0x7f70a81cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:36.114 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.107 7f70af96f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a80f65b0 con 0x7f70a80b84a0 2022-04-28T14:39:36.114 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.107 7f70af96f700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a80d07b0 con 0x7f70a80b6d20 2022-04-28T14:39:36.114 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.108 7f70af96f700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70a80b6880 con 0x7f70a81c9900 2022-04-28T14:39:36.115 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.108 7f70a7fff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f70a80b6d20 0x7f70a80b7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:36.115 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.108 7f70a7fff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f70a80b6d20 0x7f70a80b7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46784/0 (socket says 172.21.15.22:46784) 2022-04-28T14:39:36.115 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.108 7f709ffff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a80b84a0 0x7f70a80b88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:36.115 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.108 7f70a7fff700 1 -- 172.21.15.22:0/240061071 learned_addr learned my addr 172.21.15.22:0/240061071 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:36.115 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.108 7f70acf6f700 1 --2- 172.21.15.22:0/240061071 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f70a81c9900 0x7f70a81cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:36.115 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.108 7f709ffff700 1 -- 172.21.15.22:0/240061071 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f70a81c9900 msgr2=0x7f70a81cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:36.115 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.108 7f709ffff700 1 --2- 172.21.15.22:0/240061071 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f70a81c9900 0x7f70a81cbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.115 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.108 7f709ffff700 1 -- 172.21.15.22:0/240061071 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f70a80b6d20 msgr2=0x7f70a80b7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:36.116 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.108 7f709ffff700 1 --2- 172.21.15.22:0/240061071 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f70a80b6d20 0x7f70a80b7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.116 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.108 7f709ffff700 1 -- 172.21.15.22:0/240061071 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a80b8f20 con 0x7f70a80b84a0 2022-04-28T14:39:36.116 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.108 7f70a7fff700 1 --2- 172.21.15.22:0/240061071 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f70a80b6d20 0x7f70a80b7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:36.116 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.108 7f709ffff700 1 --2- 172.21.15.22:0/240061071 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a80b84a0 0x7f70a80b88f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f70a80d3a50 tx=0x7f709000c840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:36.116 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.108 7f70a5ffb700 1 -- 172.21.15.22:0/240061071 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f70a80b8f20 con 0x7f70a80b84a0 2022-04-28T14:39:36.116 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.108 7f70a5ffb700 1 -- 172.21.15.22:0/240061071 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7090007030 con 0x7f70a80b84a0 2022-04-28T14:39:36.116 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.108 7f70af96f700 1 -- 172.21.15.22:0/240061071 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a80d03c0 con 0x7f70a80b84a0 2022-04-28T14:39:36.117 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.108 7f70a5ffb700 1 -- 172.21.15.22:0/240061071 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f7090006520 con 0x7f70a80b84a0 2022-04-28T14:39:36.117 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.108 7f70af96f700 1 -- 172.21.15.22:0/240061071 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a80b7170 con 0x7f70a80b84a0 2022-04-28T14:39:36.117 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.109 7f70a5ffb700 1 -- 172.21.15.22:0/240061071 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f709001a020 con 0x7f70a80b84a0 2022-04-28T14:39:36.117 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.109 7f70a5ffb700 1 -- 172.21.15.22:0/240061071 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f7090029480 con 0x7f70a80b84a0 2022-04-28T14:39:36.118 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.109 7f70af96f700 1 -- 172.21.15.22:0/240061071 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a80f0290 con 0x7f70a80b84a0 2022-04-28T14:39:36.118 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.112 7f70a5ffb700 1 -- 172.21.15.22:0/240061071 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f7090007db0 con 0x7f70a80b84a0 2022-04-28T14:39:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.209 7f70af96f700 1 -- 172.21.15.22:0/240061071 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f70a80a5b50 con 0x7f70a80b84a0 2022-04-28T14:39:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.209 7f70a5ffb700 1 -- 172.21.15.22:0/240061071 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7090000c30 con 0x7f70a80b84a0 2022-04-28T14:39:36.214 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2022-04-28T14:39:36.215 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.210 7f70af96f700 1 -- 172.21.15.22:0/240061071 >> v1:172.21.15.22:6808/86956 conn(0x7f708c01c1b0 legacy=0x7f708c01e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:36.215 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.210 7f70af96f700 1 -- 172.21.15.22:0/240061071 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a80b84a0 msgr2=0x7f70a80b88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:36.216 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.210 7f70af96f700 1 --2- 172.21.15.22:0/240061071 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a80b84a0 0x7f70a80b88f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f70a80d3a50 tx=0x7f709000c840).stop 2022-04-28T14:39:36.216 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.210 7f70af96f700 1 -- 172.21.15.22:0/240061071 shutdown_connections 2022-04-28T14:39:36.216 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.210 7f70af96f700 1 --2- 172.21.15.22:0/240061071 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f70a81c9900 0x7f70a81cbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.216 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.210 7f70af96f700 1 --2- 172.21.15.22:0/240061071 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f70a80b6d20 0x7f70a80b7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.216 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.210 7f70af96f700 1 --2- 172.21.15.22:0/240061071 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f70a80b84a0 0x7f70a80b88f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.216 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.210 7f70af96f700 1 -- 172.21.15.22:0/240061071 >> 172.21.15.22:0/240061071 conn(0x7f70a80adeb0 msgr2=0x7f70a80ad480 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:36.217 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.210 7f70af96f700 1 -- 172.21.15.22:0/240061071 shutdown_connections 2022-04-28T14:39:36.217 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.210 7f70af96f700 1 -- 172.21.15.22:0/240061071 wait complete. 2022-04-28T14:39:36.226 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-04-28T14:39:36.360 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.353 7f6c6bff1700 1 Processor -- start 2022-04-28T14:39:36.360 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.353 7f6c6bff1700 1 -- start start 2022-04-28T14:39:36.360 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.353 7f6c6bff1700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6c640f6220 0x7f6c640f6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:36.361 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.353 7f6c6bff1700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6c641b24d0 0x7f6c641b2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:36.361 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.353 7f6c6bff1700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c640ab080 con 0x7f6c641b2f50 2022-04-28T14:39:36.361 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.353 7f6c6bff1700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c64111c20 con 0x7f6c640f6220 2022-04-28T14:39:36.361 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.353 7f6c6bff1700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c641115b0 con 0x7f6c641b24d0 2022-04-28T14:39:36.361 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.353 7f6c68df0700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6c640f6220 0x7f6c640f6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:36.361 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.353 7f6c68df0700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6c640f6220 0x7f6c640f6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46792/0 (socket says 172.21.15.22:46792) 2022-04-28T14:39:36.361 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.353 7f6c63fff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6c641b24d0 0x7f6c641b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:36.361 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.353 7f6c695f1700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f6c641b2f50 0x7f6c640f1240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38624/0 (socket says 172.21.15.22:38624) 2022-04-28T14:39:36.361 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.353 7f6c68df0700 1 -- 172.21.15.22:0/1784424377 learned_addr learned my addr 172.21.15.22:0/1784424377 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:36.362 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.354 7f6c637fe700 1 -- 172.21.15.22:0/1784424377 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3076222017 0 0) 0x7f6c5c001490 con 0x7f6c641b2f50 2022-04-28T14:39:36.362 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.354 7f6c63fff700 1 -- 172.21.15.22:0/1784424377 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6c640f6220 msgr2=0x7f6c640f6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:36.362 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.354 7f6c63fff700 1 --2- 172.21.15.22:0/1784424377 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6c640f6220 0x7f6c640f6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.362 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.354 7f6c63fff700 1 -- 172.21.15.22:0/1784424377 >> v1:172.21.15.22:6789/0 conn(0x7f6c641b2f50 legacy=0x7f6c640f1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:36.362 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.354 7f6c63fff700 1 -- 172.21.15.22:0/1784424377 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6410d4d0 con 0x7f6c641b24d0 2022-04-28T14:39:36.362 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.354 7f6c68df0700 1 --2- 172.21.15.22:0/1784424377 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6c640f6220 0x7f6c640f6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:36.362 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.354 7f6c63fff700 1 --2- 172.21.15.22:0/1784424377 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6c641b24d0 0x7f6c641b2920 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f6c54002f70 tx=0x7f6c5400b9a0).ready entity=mon.2 client_cookie=33aedd56ebd03876 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:36.362 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.354 7f6c637fe700 1 -- 172.21.15.22:0/1784424377 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6c6410d4d0 con 0x7f6c641b24d0 2022-04-28T14:39:36.362 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.354 7f6c637fe700 1 -- 172.21.15.22:0/1784424377 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5400d5c0 con 0x7f6c641b24d0 2022-04-28T14:39:36.363 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.354 7f6c637fe700 1 -- 172.21.15.22:0/1784424377 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6c5400d990 con 0x7f6c641b24d0 2022-04-28T14:39:36.363 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.354 7f6c6bff1700 1 -- 172.21.15.22:0/1784424377 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6c641b24d0 msgr2=0x7f6c641b2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:36.363 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.354 7f6c6bff1700 1 --2- 172.21.15.22:0/1784424377 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6c641b24d0 0x7f6c641b2920 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f6c54002f70 tx=0x7f6c5400b9a0).stop 2022-04-28T14:39:36.363 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.355 7f6c6bff1700 1 -- 172.21.15.22:0/1784424377 shutdown_connections 2022-04-28T14:39:36.363 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.355 7f6c6bff1700 1 --2- 172.21.15.22:0/1784424377 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6c640f6220 0x7f6c640f6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.363 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.355 7f6c6bff1700 1 --2- 172.21.15.22:0/1784424377 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6c641b24d0 0x7f6c641b2920 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.363 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.355 7f6c6bff1700 1 -- 172.21.15.22:0/1784424377 >> 172.21.15.22:0/1784424377 conn(0x7f6c641170f0 msgr2=0x7f6c640f2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:36.363 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.355 7f6c6bff1700 1 -- 172.21.15.22:0/1784424377 shutdown_connections 2022-04-28T14:39:36.363 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.355 7f6c6bff1700 1 -- 172.21.15.22:0/1784424377 wait complete. 2022-04-28T14:39:36.383 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.378 7f6c6bff1700 1 Processor -- start 2022-04-28T14:39:36.383 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.378 7f6c6bff1700 1 -- start start 2022-04-28T14:39:36.386 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.379 7f6c6bff1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c640b6f50 0x7f6c640d1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:36.386 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.379 7f6c6bff1700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6c640b73a0 0x7f6c640d2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:36.386 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.379 7f6c6bff1700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6c641c3070 0x7f6c641c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:36.386 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.379 7f6c6bff1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c640a7a30 con 0x7f6c640b6f50 2022-04-28T14:39:36.386 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.379 7f6c6bff1700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c640b6770 con 0x7f6c640b73a0 2022-04-28T14:39:36.387 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.379 7f6c6bff1700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c641b63d0 con 0x7f6c641c3070 2022-04-28T14:39:36.387 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.379 7f6c68df0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c640b6f50 0x7f6c640d1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:36.387 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.379 7f6c63fff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6c640b73a0 0x7f6c640d2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:36.387 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.379 7f6c695f1700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6c641c3070 0x7f6c641c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:36.387 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.379 7f6c68df0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c640b6f50 0x7f6c640d1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49230/0 (socket says 172.21.15.22:49230) 2022-04-28T14:39:36.387 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.379 7f6c68df0700 1 -- 172.21.15.22:0/3961638197 learned_addr learned my addr 172.21.15.22:0/3961638197 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:36.387 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.379 7f6c63fff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6c640b73a0 0x7f6c640d2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46800/0 (socket says 172.21.15.22:46800) 2022-04-28T14:39:36.387 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.380 7f6c63fff700 1 -- 172.21.15.22:0/3961638197 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6c641c3070 msgr2=0x7f6c641c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:36.387 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.380 7f6c63fff700 1 --2- 172.21.15.22:0/3961638197 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6c641c3070 0x7f6c641c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.387 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.380 7f6c63fff700 1 -- 172.21.15.22:0/3961638197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c640b6f50 msgr2=0x7f6c640d1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:36.388 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.380 7f6c63fff700 1 --2- 172.21.15.22:0/3961638197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c640b6f50 0x7f6c640d1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.388 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.380 7f6c63fff700 1 -- 172.21.15.22:0/3961638197 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c641b5fc0 con 0x7f6c640b73a0 2022-04-28T14:39:36.388 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.380 7f6c695f1700 1 --2- 172.21.15.22:0/3961638197 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6c641c3070 0x7f6c641c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:36.388 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.380 7f6c68df0700 1 --2- 172.21.15.22:0/3961638197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c640b6f50 0x7f6c640d1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:36.388 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.380 7f6c63fff700 1 --2- 172.21.15.22:0/3961638197 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6c640b73a0 0x7f6c640d2250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f6c54002f70 tx=0x7f6c540068c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:36.388 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.380 7f6c61ffb700 1 -- 172.21.15.22:0/3961638197 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6c641b5fc0 con 0x7f6c640b73a0 2022-04-28T14:39:36.388 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.380 7f6c61ffb700 1 -- 172.21.15.22:0/3961638197 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c54006a90 con 0x7f6c640b73a0 2022-04-28T14:39:36.388 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.380 7f6c6bff1700 1 -- 172.21.15.22:0/3961638197 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c640d2880 con 0x7f6c640b73a0 2022-04-28T14:39:36.388 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.380 7f6c61ffb700 1 -- 172.21.15.22:0/3961638197 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6c54022020 con 0x7f6c640b73a0 2022-04-28T14:39:36.388 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.380 7f6c6bff1700 1 -- 172.21.15.22:0/3961638197 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c641b5c60 con 0x7f6c640b73a0 2022-04-28T14:39:36.389 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.380 7f6c61ffb700 1 -- 172.21.15.22:0/3961638197 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f6c54011bd0 con 0x7f6c640b73a0 2022-04-28T14:39:36.389 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.380 7f6c61ffb700 1 -- 172.21.15.22:0/3961638197 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f6c54028d90 con 0x7f6c640b73a0 2022-04-28T14:39:36.389 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.381 7f6c6bff1700 1 -- 172.21.15.22:0/3961638197 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c640f0290 con 0x7f6c640b73a0 2022-04-28T14:39:36.389 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.384 7f6c61ffb700 1 -- 172.21.15.22:0/3961638197 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f6c540117d0 con 0x7f6c640b73a0 2022-04-28T14:39:36.485 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.480 7f6c6bff1700 1 -- 172.21.15.22:0/3961638197 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c641128e0 con 0x7f6c640b73a0 2022-04-28T14:39:36.485 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.480 7f6c61ffb700 1 -- 172.21.15.22:0/3961638197 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c5400d3b0 con 0x7f6c640b73a0 2022-04-28T14:39:36.485 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2022-04-28T14:39:36.487 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.481 7f6c6bff1700 1 -- 172.21.15.22:0/3961638197 >> v1:172.21.15.22:6808/86956 conn(0x7f6c4801c1b0 legacy=0x7f6c4801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:36.487 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.481 7f6c6bff1700 1 -- 172.21.15.22:0/3961638197 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6c640b73a0 msgr2=0x7f6c640d2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:36.487 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.481 7f6c6bff1700 1 --2- 172.21.15.22:0/3961638197 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6c640b73a0 0x7f6c640d2250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f6c54002f70 tx=0x7f6c540068c0).stop 2022-04-28T14:39:36.487 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.482 7f6c6bff1700 1 -- 172.21.15.22:0/3961638197 shutdown_connections 2022-04-28T14:39:36.487 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.482 7f6c6bff1700 1 --2- 172.21.15.22:0/3961638197 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6c641c3070 0x7f6c641c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.487 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.482 7f6c6bff1700 1 --2- 172.21.15.22:0/3961638197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c640b6f50 0x7f6c640d1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.487 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.482 7f6c6bff1700 1 --2- 172.21.15.22:0/3961638197 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6c640b73a0 0x7f6c640d2250 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.487 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.482 7f6c6bff1700 1 -- 172.21.15.22:0/3961638197 >> 172.21.15.22:0/3961638197 conn(0x7f6c64121b20 msgr2=0x7f6c640e0760 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:36.487 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.482 7f6c6bff1700 1 -- 172.21.15.22:0/3961638197 shutdown_connections 2022-04-28T14:39:36.488 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.482 7f6c6bff1700 1 -- 172.21.15.22:0/3961638197 wait complete. 2022-04-28T14:39:36.497 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-04-28T14:39:36.631 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.624 7fc73795d700 1 Processor -- start 2022-04-28T14:39:36.631 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.624 7fc73795d700 1 -- start start 2022-04-28T14:39:36.631 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.624 7fc73795d700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc7300ff140 0x7fc7301b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:36.631 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.624 7fc73795d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc7301b6db0 0x7fc7301b9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:36.631 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.624 7fc73795d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7300ab080 con 0x7fc7300f6360 2022-04-28T14:39:36.631 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.624 7fc73795d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc730115da0 con 0x7fc7301b6db0 2022-04-28T14:39:36.631 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.624 7fc73795d700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc73010b7a0 con 0x7fc7300ff140 2022-04-28T14:39:36.631 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.624 7fc727fff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc7300ff140 0x7fc7301b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:36.632 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.624 7fc734f5d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc7301b6db0 0x7fc7301b9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:36.632 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.624 7fc727fff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc7300ff140 0x7fc7301b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46592/0 (socket says 172.21.15.22:46592) 2022-04-28T14:39:36.632 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.624 7fc727fff700 1 -- 172.21.15.22:0/3438885279 learned_addr learned my addr 172.21.15.22:0/3438885279 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:36.632 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.625 7fc734f5d700 1 -- 172.21.15.22:0/3438885279 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc7300ff140 msgr2=0x7fc7301b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:36.632 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.625 7fc734f5d700 1 --2- 172.21.15.22:0/3438885279 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc7300ff140 0x7fc7301b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.632 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.625 7fc734f5d700 1 -- 172.21.15.22:0/3438885279 >> v1:172.21.15.22:6789/0 conn(0x7fc7300f6360 legacy=0x7fc7300fe940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:36.632 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.625 7fc734f5d700 1 -- 172.21.15.22:0/3438885279 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7300f67b0 con 0x7fc7301b6db0 2022-04-28T14:39:36.632 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.625 7fc72f7fe700 1 -- 172.21.15.22:0/3438885279 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874170581 0 0) 0x7fc720001110 con 0x7fc7300f6360 2022-04-28T14:39:36.632 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.625 7fc727fff700 1 --2- 172.21.15.22:0/3438885279 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc7300ff140 0x7fc7301b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:36.633 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.625 7fc734f5d700 1 --2- 172.21.15.22:0/3438885279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7301b6db0 0x7fc7301b9210 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fc7280032f0 tx=0x7fc728009d10).ready entity=mon.0 client_cookie=af5ff2914adf53a4 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:36.633 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.625 7fc72f7fe700 1 -- 172.21.15.22:0/3438885279 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc7300f67b0 con 0x7fc7301b6db0 2022-04-28T14:39:36.633 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.625 7fc72f7fe700 1 -- 172.21.15.22:0/3438885279 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72800b800 con 0x7fc7301b6db0 2022-04-28T14:39:36.633 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.625 7fc72f7fe700 1 -- 172.21.15.22:0/3438885279 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc72800ba30 con 0x7fc7301b6db0 2022-04-28T14:39:36.633 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.625 7fc73795d700 1 -- 172.21.15.22:0/3438885279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7301b6db0 msgr2=0x7fc7301b9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:36.633 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.625 7fc73795d700 1 --2- 172.21.15.22:0/3438885279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7301b6db0 0x7fc7301b9210 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fc7280032f0 tx=0x7fc728009d10).stop 2022-04-28T14:39:36.633 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.626 7fc73795d700 1 -- 172.21.15.22:0/3438885279 shutdown_connections 2022-04-28T14:39:36.633 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.626 7fc73795d700 1 --2- 172.21.15.22:0/3438885279 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7301b6db0 0x7fc7301b9210 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.633 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.626 7fc73795d700 1 --2- 172.21.15.22:0/3438885279 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc7300ff140 0x7fc7301b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.633 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.626 7fc73795d700 1 -- 172.21.15.22:0/3438885279 >> 172.21.15.22:0/3438885279 conn(0x7fc7301170f0 msgr2=0x7fc7300f2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:36.634 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.626 7fc73795d700 1 -- 172.21.15.22:0/3438885279 shutdown_connections 2022-04-28T14:39:36.634 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.626 7fc73795d700 1 -- 172.21.15.22:0/3438885279 wait complete. 2022-04-28T14:39:36.656 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.649 7fc73795d700 1 Processor -- start 2022-04-28T14:39:36.656 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.649 7fc73795d700 1 -- start start 2022-04-28T14:39:36.657 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.650 7fc73795d700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc7300b9210 0x7fc7300b9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:36.657 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.650 7fc73795d700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc7301b2440 0x7fc7301b2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:36.657 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.650 7fc73795d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7301b2ec0 0x7fc7300d2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:36.657 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.650 7fc73795d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7301b6340 con 0x7fc7301b2ec0 2022-04-28T14:39:36.657 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.650 7fc73795d700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7300b8a30 con 0x7fc7300b9210 2022-04-28T14:39:36.657 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.650 7fc73795d700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7300b8d70 con 0x7fc7301b2440 2022-04-28T14:39:36.657 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.650 7fc727fff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc7301b2440 0x7fc7301b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:36.657 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.650 7fc727fff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc7301b2440 0x7fc7301b2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46598/0 (socket says 172.21.15.22:46598) 2022-04-28T14:39:36.657 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.650 7fc72ffff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc7300b9210 0x7fc7300b9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:36.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.650 7fc727fff700 1 -- 172.21.15.22:0/1446552217 learned_addr learned my addr 172.21.15.22:0/1446552217 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:36.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.650 7fc734f5d700 1 --2- 172.21.15.22:0/1446552217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7301b2ec0 0x7fc7300d2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:36.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.650 7fc727fff700 1 -- 172.21.15.22:0/1446552217 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc7300b9210 msgr2=0x7fc7300b9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:36.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.650 7fc727fff700 1 --2- 172.21.15.22:0/1446552217 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc7300b9210 0x7fc7300b9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.650 7fc727fff700 1 -- 172.21.15.22:0/1446552217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7301b2ec0 msgr2=0x7fc7300d2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:36.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.650 7fc727fff700 1 --2- 172.21.15.22:0/1446552217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7301b2ec0 0x7fc7300d2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.650 7fc727fff700 1 -- 172.21.15.22:0/1446552217 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7300b7e90 con 0x7fc7301b2440 2022-04-28T14:39:36.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.650 7fc727fff700 1 --2- 172.21.15.22:0/1446552217 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc7301b2440 0x7fc7301b2890 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fc71800c000 tx=0x7fc71800ec50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:36.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.651 7fc72dffb700 1 -- 172.21.15.22:0/1446552217 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc7300b7e90 con 0x7fc7301b2440 2022-04-28T14:39:36.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.651 7fc72dffb700 1 -- 172.21.15.22:0/1446552217 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71800c620 con 0x7fc7301b2440 2022-04-28T14:39:36.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.651 7fc73795d700 1 -- 172.21.15.22:0/1446552217 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7301b5a90 con 0x7fc7301b2440 2022-04-28T14:39:36.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.651 7fc72dffb700 1 -- 172.21.15.22:0/1446552217 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc71800f040 con 0x7fc7301b2440 2022-04-28T14:39:36.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.651 7fc73795d700 1 -- 172.21.15.22:0/1446552217 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7300d33d0 con 0x7fc7301b2440 2022-04-28T14:39:36.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.651 7fc72dffb700 1 -- 172.21.15.22:0/1446552217 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fc718011070 con 0x7fc7301b2440 2022-04-28T14:39:36.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.651 7fc72dffb700 1 -- 172.21.15.22:0/1446552217 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fc718010040 con 0x7fc7301b2440 2022-04-28T14:39:36.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.652 7fc73795d700 1 -- 172.21.15.22:0/1446552217 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7300d3a50 con 0x7fc7301b2440 2022-04-28T14:39:36.660 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.655 7fc72dffb700 1 -- 172.21.15.22:0/1446552217 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fc71800ed90 con 0x7fc7301b2440 2022-04-28T14:39:36.755 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.751 7fc73795d700 1 -- 172.21.15.22:0/1446552217 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc7300f0290 con 0x7fc7301b2440 2022-04-28T14:39:36.756 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.751 7fc72dffb700 1 -- 172.21.15.22:0/1446552217 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc718000c30 con 0x7fc7301b2440 2022-04-28T14:39:36.756 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2022-04-28T14:39:36.757 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.752 7fc73795d700 1 -- 172.21.15.22:0/1446552217 >> v1:172.21.15.22:6808/86956 conn(0x7fc71401c1b0 legacy=0x7fc71401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:36.757 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.752 7fc73795d700 1 -- 172.21.15.22:0/1446552217 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc7301b2440 msgr2=0x7fc7301b2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:36.757 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.752 7fc73795d700 1 --2- 172.21.15.22:0/1446552217 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc7301b2440 0x7fc7301b2890 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fc71800c000 tx=0x7fc71800ec50).stop 2022-04-28T14:39:36.757 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.752 7fc73795d700 1 -- 172.21.15.22:0/1446552217 shutdown_connections 2022-04-28T14:39:36.757 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.752 7fc73795d700 1 --2- 172.21.15.22:0/1446552217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7301b2ec0 0x7fc7300d2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.757 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.752 7fc73795d700 1 --2- 172.21.15.22:0/1446552217 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc7300b9210 0x7fc7300b9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.758 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.752 7fc73795d700 1 --2- 172.21.15.22:0/1446552217 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc7301b2440 0x7fc7301b2890 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.758 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.752 7fc73795d700 1 -- 172.21.15.22:0/1446552217 >> 172.21.15.22:0/1446552217 conn(0x7fc7300e09e0 msgr2=0x7fc7300f12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:36.758 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.752 7fc73795d700 1 -- 172.21.15.22:0/1446552217 shutdown_connections 2022-04-28T14:39:36.758 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.752 7fc73795d700 1 -- 172.21.15.22:0/1446552217 wait complete. 2022-04-28T14:39:36.768 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-04-28T14:39:36.899 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.892 7f31ef4a1700 1 Processor -- start 2022-04-28T14:39:36.899 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.892 7f31ef4a1700 1 -- start start 2022-04-28T14:39:36.899 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.893 7f31ef4a1700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f31e80ff170 0x7f31e81b67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:36.900 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.893 7f31ef4a1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f31e81b6de0 0x7f31e81b9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:36.900 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.893 7f31ef4a1700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e80ab0b0 con 0x7f31e80f6390 2022-04-28T14:39:36.900 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.893 7f31ef4a1700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e8115dd0 con 0x7f31e81b6de0 2022-04-28T14:39:36.900 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.893 7f31ef4a1700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31e810b7d0 con 0x7f31e80ff170 2022-04-28T14:39:36.900 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.893 7f31e77fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f31e80ff170 0x7f31e81b67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:36.900 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.893 7f31e77fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f31e80ff170 0x7f31e81b67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46606/0 (socket says 172.21.15.22:46606) 2022-04-28T14:39:36.900 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.893 7f31e77fe700 1 -- 172.21.15.22:0/2701639904 learned_addr learned my addr 172.21.15.22:0/2701639904 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:36.900 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.893 7f31ecaa1700 1 --2- 172.21.15.22:0/2701639904 >> v2:172.21.15.22:3300/0 conn(0x7f31e81b6de0 0x7f31e81b9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:36.900 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.893 7f31e77fe700 1 -- 172.21.15.22:0/2701639904 >> v2:172.21.15.22:3300/0 conn(0x7f31e81b6de0 msgr2=0x7f31e81b9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:36.901 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.893 7f31e77fe700 1 --2- 172.21.15.22:0/2701639904 >> v2:172.21.15.22:3300/0 conn(0x7f31e81b6de0 0x7f31e81b9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.901 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.893 7f31e77fe700 1 -- 172.21.15.22:0/2701639904 >> v1:172.21.15.22:6789/0 conn(0x7f31e80f6390 legacy=0x7f31e80fe970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:36.901 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.893 7f31e77fe700 1 -- 172.21.15.22:0/2701639904 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e80f67e0 con 0x7f31e80ff170 2022-04-28T14:39:36.901 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.893 7f31ecaa1700 1 --2- 172.21.15.22:0/2701639904 >> v2:172.21.15.22:3300/0 conn(0x7f31e81b6de0 0x7f31e81b9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:36.901 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.894 7f31e77fe700 1 --2- 172.21.15.22:0/2701639904 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f31e80ff170 0x7f31e81b67b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f31d8002f70 tx=0x7f31d800bc00).ready entity=mon.2 client_cookie=4e4f7a7e4ea97afe server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:36.901 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.894 7f31e6ffd700 1 -- 172.21.15.22:0/2701639904 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f31e80f67e0 con 0x7f31e80ff170 2022-04-28T14:39:36.901 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.894 7f31e6ffd700 1 -- 172.21.15.22:0/2701639904 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d800dc20 con 0x7f31e80ff170 2022-04-28T14:39:36.901 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.894 7f31e6ffd700 1 -- 172.21.15.22:0/2701639904 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f31d8010470 con 0x7f31e80ff170 2022-04-28T14:39:36.902 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.894 7f31ef4a1700 1 -- 172.21.15.22:0/2701639904 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f31e80ff170 msgr2=0x7f31e81b67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:36.902 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.894 7f31ef4a1700 1 --2- 172.21.15.22:0/2701639904 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f31e80ff170 0x7f31e81b67b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f31d8002f70 tx=0x7f31d800bc00).stop 2022-04-28T14:39:36.902 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.894 7f31ef4a1700 1 -- 172.21.15.22:0/2701639904 shutdown_connections 2022-04-28T14:39:36.902 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.894 7f31ef4a1700 1 --2- 172.21.15.22:0/2701639904 >> v2:172.21.15.22:3300/0 conn(0x7f31e81b6de0 0x7f31e81b9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.902 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.894 7f31ef4a1700 1 --2- 172.21.15.22:0/2701639904 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f31e80ff170 0x7f31e81b67b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.902 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.894 7f31ef4a1700 1 -- 172.21.15.22:0/2701639904 >> 172.21.15.22:0/2701639904 conn(0x7f31e8117120 msgr2=0x7f31e80f2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:36.902 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.894 7f31ef4a1700 1 -- 172.21.15.22:0/2701639904 shutdown_connections 2022-04-28T14:39:36.902 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.894 7f31ef4a1700 1 -- 172.21.15.22:0/2701639904 wait complete. 2022-04-28T14:39:36.923 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.918 7f31ef4a1700 1 Processor -- start 2022-04-28T14:39:36.923 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.918 7f31ef4a1700 1 -- start start 2022-04-28T14:39:36.925 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.919 7f31ef4a1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31e81c5370 0x7f31e80df480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:36.925 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.919 7f31ef4a1700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f31e81c57c0 0x7f31e80dfab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:36.925 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.919 7f31ef4a1700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f31e80b71f0 0x7f31e80b7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:36.926 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.919 7f31ef4a1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e80bd670 con 0x7f31e81c5370 2022-04-28T14:39:36.926 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.919 7f31ef4a1700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e81b7e90 con 0x7f31e80b71f0 2022-04-28T14:39:36.926 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.919 7f31ef4a1700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31e81b86b0 con 0x7f31e81c57c0 2022-04-28T14:39:36.926 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.919 7f31e77fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f31e81c57c0 0x7f31e80dfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:36.926 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.919 7f31e77fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f31e81c57c0 0x7f31e80dfab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46612/0 (socket says 172.21.15.22:46612) 2022-04-28T14:39:36.926 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.919 7f31ecaa1700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f31e80b71f0 0x7f31e80b7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:36.926 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.919 7f31e77fe700 1 -- 172.21.15.22:0/3303697720 learned_addr learned my addr 172.21.15.22:0/3303697720 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:36.926 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.919 7f31e7fff700 1 --2- 172.21.15.22:0/3303697720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31e81c5370 0x7f31e80df480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:36.926 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.919 7f31e77fe700 1 -- 172.21.15.22:0/3303697720 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f31e80b71f0 msgr2=0x7f31e80b7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:36.927 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.919 7f31e77fe700 1 --2- 172.21.15.22:0/3303697720 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f31e80b71f0 0x7f31e80b7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.927 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.919 7f31e77fe700 1 -- 172.21.15.22:0/3303697720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31e81c5370 msgr2=0x7f31e80df480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:36.927 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.919 7f31e77fe700 1 --2- 172.21.15.22:0/3303697720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31e81c5370 0x7f31e80df480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:36.927 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.919 7f31e77fe700 1 -- 172.21.15.22:0/3303697720 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e80b7c70 con 0x7f31e81c57c0 2022-04-28T14:39:36.927 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.919 7f31e77fe700 1 --2- 172.21.15.22:0/3303697720 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f31e81c57c0 0x7f31e80dfab0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f31d8002f70 tx=0x7f31d80068c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:36.927 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.920 7f31e57fa700 1 -- 172.21.15.22:0/3303697720 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f31e80b7c70 con 0x7f31e81c57c0 2022-04-28T14:39:36.927 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.920 7f31e57fa700 1 -- 172.21.15.22:0/3303697720 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d8022410 con 0x7f31e81c57c0 2022-04-28T14:39:36.928 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.920 7f31ef4a1700 1 -- 172.21.15.22:0/3303697720 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e80b7f30 con 0x7f31e81c57c0 2022-04-28T14:39:36.928 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.920 7f31e57fa700 1 -- 172.21.15.22:0/3303697720 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f31d801e070 con 0x7f31e81c57c0 2022-04-28T14:39:36.928 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.920 7f31ef4a1700 1 -- 172.21.15.22:0/3303697720 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e81cc7f0 con 0x7f31e81c57c0 2022-04-28T14:39:36.928 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.920 7f31e57fa700 1 -- 172.21.15.22:0/3303697720 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f31d8018400 con 0x7f31e81c57c0 2022-04-28T14:39:36.928 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.920 7f31e57fa700 1 -- 172.21.15.22:0/3303697720 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f31d800d010 con 0x7f31e81c57c0 2022-04-28T14:39:36.928 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.921 7f31ef4a1700 1 -- 172.21.15.22:0/3303697720 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e80f02c0 con 0x7f31e81c57c0 2022-04-28T14:39:36.928 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:36.923 7f31e57fa700 1 -- 172.21.15.22:0/3303697720 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f31d8010b50 con 0x7f31e81c57c0 2022-04-28T14:39:37.054 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.049 7f31ef4a1700 1 -- 172.21.15.22:0/3303697720 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31e80a5b80 con 0x7f31e81c57c0 2022-04-28T14:39:37.054 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.049 7f31e57fa700 1 -- 172.21.15.22:0/3303697720 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+2263 (secure 0 0 0) 0x7f31d800d820 con 0x7f31e81c57c0 2022-04-28T14:39:37.055 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:37.055 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.22:6818/2291514211","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6818","nonce":2291514211}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-04-28 14:39:13.928436","modified":"2022-04-28 14:39:17.590611","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4184,"mds_1":4198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4184":{"gid":4184,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6819/356491488","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6819","nonce":356491488}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4198":{"gid":4198,"name":"b","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6817/401565232","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6817","nonce":401565232}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-04-28T14:39:37.057 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.050 7f31ef4a1700 1 -- 172.21.15.22:0/3303697720 >> v1:172.21.15.22:6808/86956 conn(0x7f31cc01c1b0 legacy=0x7f31cc01e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:37.057 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.050 7f31ef4a1700 1 -- 172.21.15.22:0/3303697720 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f31e81c57c0 msgr2=0x7f31e80dfab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:37.058 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.050 7f31ef4a1700 1 --2- 172.21.15.22:0/3303697720 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f31e81c57c0 0x7f31e80dfab0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f31d8002f70 tx=0x7f31d80068c0).stop 2022-04-28T14:39:37.058 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.050 7f31ef4a1700 1 -- 172.21.15.22:0/3303697720 shutdown_connections 2022-04-28T14:39:37.059 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.050 7f31ef4a1700 1 --2- 172.21.15.22:0/3303697720 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f31e80b71f0 0x7f31e80b7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:37.059 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.050 7f31ef4a1700 1 --2- 172.21.15.22:0/3303697720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f31e81c5370 0x7f31e80df480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:37.059 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.050 7f31ef4a1700 1 --2- 172.21.15.22:0/3303697720 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f31e81c57c0 0x7f31e80dfab0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:37.059 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.050 7f31ef4a1700 1 -- 172.21.15.22:0/3303697720 >> 172.21.15.22:0/3303697720 conn(0x7f31e80c8000 msgr2=0x7f31e8120530 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:37.059 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.050 7f31ef4a1700 1 -- 172.21.15.22:0/3303697720 shutdown_connections 2022-04-28T14:39:37.060 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.050 7f31ef4a1700 1 -- 172.21.15.22:0/3303697720 wait complete. 2022-04-28T14:39:37.060 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 9 2022-04-28T14:39:37.066 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-28T14:39:37.199 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.190 7fd5b642a700 1 Processor -- start 2022-04-28T14:39:37.199 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.190 7fd5b642a700 1 -- start start 2022-04-28T14:39:37.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.190 7fd5b642a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd5b00f63f0 0x7fd5b01b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:37.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.190 7fd5b642a700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd5b01b30e0 0x7fd5b00f1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:37.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.190 7fd5b642a700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b00ab0b0 con 0x7fd5b01b2c90 2022-04-28T14:39:37.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.190 7fd5b642a700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b010d1e0 con 0x7fd5b00f63f0 2022-04-28T14:39:37.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.190 7fd5b642a700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b010cd40 con 0x7fd5b01b30e0 2022-04-28T14:39:37.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.191 7fd5af086700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd5b00f63f0 0x7fd5b01b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:37.201 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.191 7fd5af887700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd5b01b30e0 0x7fd5b00f1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:37.201 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.191 7fd5ae885700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd5b01b2c90 0x7fd5b00f1270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38664/0 (socket says 172.21.15.22:38664) 2022-04-28T14:39:37.201 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.191 7fd5ae885700 1 -- 172.21.15.22:0/2679345809 learned_addr learned my addr 172.21.15.22:0/2679345809 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:39:37.201 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.191 7fd5af086700 1 -- 172.21.15.22:0/2679345809 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd5b01b30e0 msgr2=0x7fd5b00f1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:37.201 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.191 7fd5af086700 1 --2- 172.21.15.22:0/2679345809 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd5b01b30e0 0x7fd5b00f1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:37.201 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.191 7fd5af086700 1 -- 172.21.15.22:0/2679345809 >> v1:172.21.15.22:6789/0 conn(0x7fd5b01b2c90 legacy=0x7fd5b00f1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:37.202 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.191 7fd5ae084700 1 -- 172.21.15.22:0/2679345809 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1065053730 0 0) 0x7fd598001110 con 0x7fd5b01b2c90 2022-04-28T14:39:37.202 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.191 7fd5af086700 1 -- 172.21.15.22:0/2679345809 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b010d410 con 0x7fd5b00f63f0 2022-04-28T14:39:37.202 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.191 7fd5af086700 1 --2- 172.21.15.22:0/2679345809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5b00f63f0 0x7fd5b01b2660 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fd5a0002f70 tx=0x7fd5a000b9f0).ready entity=mon.0 client_cookie=771ab1da96bbfb13 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:37.202 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.191 7fd5ae084700 1 -- 172.21.15.22:0/2679345809 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd5a000d5c0 con 0x7fd5b00f63f0 2022-04-28T14:39:37.202 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.191 7fd5ae084700 1 -- 172.21.15.22:0/2679345809 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a000d7c0 con 0x7fd5b00f63f0 2022-04-28T14:39:37.202 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.191 7fd5ae084700 1 -- 172.21.15.22:0/2679345809 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd5a000db90 con 0x7fd5b00f63f0 2022-04-28T14:39:37.202 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.191 7fd5b642a700 1 -- 172.21.15.22:0/2679345809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5b00f63f0 msgr2=0x7fd5b01b2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:37.203 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.191 7fd5b642a700 1 --2- 172.21.15.22:0/2679345809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5b00f63f0 0x7fd5b01b2660 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fd5a0002f70 tx=0x7fd5a000b9f0).stop 2022-04-28T14:39:37.203 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.192 7fd5b642a700 1 -- 172.21.15.22:0/2679345809 shutdown_connections 2022-04-28T14:39:37.203 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.192 7fd5b642a700 1 --2- 172.21.15.22:0/2679345809 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd5b01b30e0 0x7fd5b00f1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:37.203 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.192 7fd5b642a700 1 --2- 172.21.15.22:0/2679345809 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5b00f63f0 0x7fd5b01b2660 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:37.203 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.192 7fd5b642a700 1 -- 172.21.15.22:0/2679345809 >> 172.21.15.22:0/2679345809 conn(0x7fd5b0117120 msgr2=0x7fd5b00f2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:37.203 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.192 7fd5b642a700 1 -- 172.21.15.22:0/2679345809 shutdown_connections 2022-04-28T14:39:37.203 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.192 7fd5b642a700 1 -- 172.21.15.22:0/2679345809 wait complete. 2022-04-28T14:39:37.220 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.215 7fd5b642a700 1 Processor -- start 2022-04-28T14:39:37.220 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.216 7fd5b642a700 1 -- start start 2022-04-28T14:39:37.224 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.216 7fd5b642a700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd5b00b8b70 0x7fd5b00b8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:37.224 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.216 7fd5b642a700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd5b00d48c0 0x7fd5b00d4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:37.224 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.216 7fd5b642a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5b00d5340 0x7fd5b01c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:37.224 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.216 7fd5b642a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b00efdd0 con 0x7fd5b00d5340 2022-04-28T14:39:37.224 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.216 7fd5b642a700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b00b74b0 con 0x7fd5b00b8b70 2022-04-28T14:39:37.225 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.216 7fd5b642a700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b00b77f0 con 0x7fd5b00d48c0 2022-04-28T14:39:37.225 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.216 7fd5af887700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5b00d5340 0x7fd5b01c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:37.225 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.216 7fd5ae885700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd5b00d48c0 0x7fd5b00d4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:37.225 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.216 7fd5af086700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd5b00b8b70 0x7fd5b00b8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:37.225 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.216 7fd5af887700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5b00d5340 0x7fd5b01c9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49276/0 (socket says 172.21.15.22:49276) 2022-04-28T14:39:37.225 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.216 7fd5af887700 1 -- 172.21.15.22:0/31226542 learned_addr learned my addr 172.21.15.22:0/31226542 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:37.226 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.216 7fd5ae885700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd5b00d48c0 0x7fd5b00d4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46626/0 (socket says 172.21.15.22:46626) 2022-04-28T14:39:37.226 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.217 7fd5af887700 1 -- 172.21.15.22:0/31226542 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd5b00d48c0 msgr2=0x7fd5b00d4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:37.226 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.217 7fd5af887700 1 --2- 172.21.15.22:0/31226542 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd5b00d48c0 0x7fd5b00d4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:37.226 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.217 7fd5af887700 1 -- 172.21.15.22:0/31226542 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd5b00b8b70 msgr2=0x7fd5b00b8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:37.226 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.217 7fd5af887700 1 --2- 172.21.15.22:0/31226542 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd5b00b8b70 0x7fd5b00b8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:37.226 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.217 7fd5af887700 1 -- 172.21.15.22:0/31226542 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b00b7e30 con 0x7fd5b00d5340 2022-04-28T14:39:37.226 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.217 7fd5af086700 1 --2- 172.21.15.22:0/31226542 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd5b00b8b70 0x7fd5b00b8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:37.227 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.217 7fd5af887700 1 --2- 172.21.15.22:0/31226542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5b00d5340 0x7fd5b01c9d20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fd5b0115430 tx=0x7fd5a800ee60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:37.227 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.217 7fd5ac881700 1 -- 172.21.15.22:0/31226542 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd5b00b7e30 con 0x7fd5b00d5340 2022-04-28T14:39:37.227 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.217 7fd5ac881700 1 -- 172.21.15.22:0/31226542 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a800c880 con 0x7fd5b00d5340 2022-04-28T14:39:37.227 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.217 7fd5b642a700 1 -- 172.21.15.22:0/31226542 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b00b8150 con 0x7fd5b00d5340 2022-04-28T14:39:37.227 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.217 7fd5ac881700 1 -- 172.21.15.22:0/31226542 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd5a800f040 con 0x7fd5b00d5340 2022-04-28T14:39:37.227 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.217 7fd5b642a700 1 -- 172.21.15.22:0/31226542 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b00d5790 con 0x7fd5b00d5340 2022-04-28T14:39:37.228 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.218 7fd5ac881700 1 -- 172.21.15.22:0/31226542 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fd5a8022060 con 0x7fd5b00d5340 2022-04-28T14:39:37.228 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.218 7fd5ac881700 1 -- 172.21.15.22:0/31226542 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fd5a8010040 con 0x7fd5b00d5340 2022-04-28T14:39:37.228 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.218 7fd5b642a700 1 -- 172.21.15.22:0/31226542 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b00a5b80 con 0x7fd5b00d5340 2022-04-28T14:39:37.228 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.221 7fd5ac881700 1 -- 172.21.15.22:0/31226542 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fd5a800c670 con 0x7fd5b00d5340 2022-04-28T14:39:37.323 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.318 7fd5b642a700 1 -- 172.21.15.22:0/31226542 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5b00a97e0 con 0x7fd5b00d5340 2022-04-28T14:39:37.323 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.318 7fd5ac881700 1 -- 172.21.15.22:0/31226542 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+8818 (secure 0 0 0) 0x7fd5b00ffa00 con 0x7fd5b00d5340 2022-04-28T14:39:37.324 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:37.324 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":17,"fsid":"3047163a-0285-4058-8e05-ce74c6fbb9c5","created":"2022-04-28 14:38:54.232890","modified":"2022-04-28 14:39:26.606234","last_up_change":"2022-04-28 14:39:00.269721","last_in_change":"2022-04-28 14:39:00.269721","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-04-28 14:39:03.639717","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-04-28 14:39:12.000229","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-04-28 14:39:12.915097","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782ee638-1ada-48d9-9454-f9e0ca8a3135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6800","nonce":87556}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":87556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":87556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":87556}]},"public_addr":"172.21.15.22:6800/87556","cluster_addr":"172.21.15.22:6801/87556","heartbeat_back_addr":"172.21.15.22:6803/87556","heartbeat_front_addr":"172.21.15.22:6802/87556","state":["exists","up"]},{"osd":1,"uuid":"61ca6f96-fb4f-4c0f-b68b-edf1e7011f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":87557}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":87557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":87557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":87557}]},"public_addr":"172.21.15.22:6804/87557","cluster_addr":"172.21.15.22:6805/87557","heartbeat_back_addr":"172.21.15.22:6807/87557","heartbeat_front_addr":"172.21.15.22:6806/87557","state":["exists","up"]},{"osd":2,"uuid":"4b3043b9-50df-4b7f-a55a-ac8e6148c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":87558}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":87558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":87558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":87558}]},"public_addr":"172.21.15.22:6813/87558","cluster_addr":"172.21.15.22:6814/87558","heartbeat_back_addr":"172.21.15.22:6816/87558","heartbeat_front_addr":"172.21.15.22:6815/87558","state":["exists","up"]},{"osd":3,"uuid":"7807bcd1-53f8-44b5-9992-57c328e5b299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":87561}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":87561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":87561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":87561}]},"public_addr":"172.21.15.22:6809/87561","cluster_addr":"172.21.15.22:6810/87561","heartbeat_back_addr":"172.21.15.22:6812/87561","heartbeat_front_addr":"172.21.15.22:6811/87561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-04-28T14:39:37.325 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.319 7fd5b642a700 1 -- 172.21.15.22:0/31226542 >> v1:172.21.15.22:6808/86956 conn(0x7fd59401c1b0 legacy=0x7fd59401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:37.325 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.319 7fd5b642a700 1 -- 172.21.15.22:0/31226542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5b00d5340 msgr2=0x7fd5b01c9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:37.326 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.319 7fd5b642a700 1 --2- 172.21.15.22:0/31226542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5b00d5340 0x7fd5b01c9d20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fd5b0115430 tx=0x7fd5a800ee60).stop 2022-04-28T14:39:37.326 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.320 7fd5b642a700 1 -- 172.21.15.22:0/31226542 shutdown_connections 2022-04-28T14:39:37.326 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.320 7fd5b642a700 1 --2- 172.21.15.22:0/31226542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5b00d5340 0x7fd5b01c9d20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:37.326 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.320 7fd5b642a700 1 --2- 172.21.15.22:0/31226542 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd5b00b8b70 0x7fd5b00b8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:37.326 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.320 7fd5b642a700 1 --2- 172.21.15.22:0/31226542 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd5b00d48c0 0x7fd5b00d4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:37.326 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.320 7fd5b642a700 1 -- 172.21.15.22:0/31226542 >> 172.21.15.22:0/31226542 conn(0x7fd5b00ce640 msgr2=0x7fd5b00af860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:37.326 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.320 7fd5b642a700 1 -- 172.21.15.22:0/31226542 shutdown_connections 2022-04-28T14:39:37.326 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.320 7fd5b642a700 1 -- 172.21.15.22:0/31226542 wait complete. 2022-04-28T14:39:37.336 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2022-04-28T14:39:37.470 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.463 7f840e16c700 1 Processor -- start 2022-04-28T14:39:37.471 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.463 7f840e16c700 1 -- start start 2022-04-28T14:39:37.471 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.463 7f840e16c700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f84080f6420 0x7f84080f1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:37.471 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.463 7f840e16c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f84081b7870 0x7f84081b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:37.471 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.463 7f840e16c700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84080ab280 con 0x7f84080f6870 2022-04-28T14:39:37.471 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.463 7f840e16c700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84080f2150 con 0x7f84081b7870 2022-04-28T14:39:37.471 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.463 7f840e16c700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8408111cd0 con 0x7f84080f6420 2022-04-28T14:39:37.472 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.464 7f8406dc6700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f84080f6420 0x7f84080f1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:37.472 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.464 7f8406dc6700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f84080f6420 0x7f84080f1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46848/0 (socket says 172.21.15.22:46848) 2022-04-28T14:39:37.472 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.464 7f8406dc6700 1 -- 172.21.15.22:0/972233262 learned_addr learned my addr 172.21.15.22:0/972233262 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:37.472 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.464 7f84075c7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f84081b7870 0x7f84081b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:37.472 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.464 7f84065c5700 1 --1- 172.21.15.22:0/972233262 >> v1:172.21.15.22:6789/0 conn(0x7f84080f6870 0x7f84080f1950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38678/0 (socket says 172.21.15.22:38678) 2022-04-28T14:39:37.472 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.464 7f84075c7700 1 -- 172.21.15.22:0/972233262 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f84080f6420 msgr2=0x7f84080f1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:37.472 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.464 7f84075c7700 1 --2- 172.21.15.22:0/972233262 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f84080f6420 0x7f84080f1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:37.473 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.464 7f84075c7700 1 -- 172.21.15.22:0/972233262 >> v1:172.21.15.22:6789/0 conn(0x7f84080f6870 legacy=0x7f84080f1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:37.473 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.464 7f8405dc4700 1 -- 172.21.15.22:0/972233262 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609116709 0 0) 0x7f83f8001110 con 0x7f84080f6870 2022-04-28T14:39:37.473 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.464 7f84075c7700 1 -- 172.21.15.22:0/972233262 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840810cbb0 con 0x7f84081b7870 2022-04-28T14:39:37.473 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.464 7f8406dc6700 1 --2- 172.21.15.22:0/972233262 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f84080f6420 0x7f84080f1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:37.473 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.464 7f84075c7700 1 --2- 172.21.15.22:0/972233262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84081b7870 0x7f84081b9cd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f84000032f0 tx=0x7f8400009d10).ready entity=mon.0 client_cookie=3f1fa86372525b4f server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:37.473 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.464 7f8405dc4700 1 -- 172.21.15.22:0/972233262 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f840810cbb0 con 0x7f84081b7870 2022-04-28T14:39:37.474 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.464 7f8405dc4700 1 -- 172.21.15.22:0/972233262 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840000b800 con 0x7f84081b7870 2022-04-28T14:39:37.474 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.464 7f8405dc4700 1 -- 172.21.15.22:0/972233262 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f840000ba30 con 0x7f84081b7870 2022-04-28T14:39:37.474 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.464 7f840e16c700 1 -- 172.21.15.22:0/972233262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84081b7870 msgr2=0x7f84081b9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:37.474 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.464 7f840e16c700 1 --2- 172.21.15.22:0/972233262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84081b7870 0x7f84081b9cd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f84000032f0 tx=0x7f8400009d10).stop 2022-04-28T14:39:37.474 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.465 7f840e16c700 1 -- 172.21.15.22:0/972233262 shutdown_connections 2022-04-28T14:39:37.474 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.465 7f840e16c700 1 --2- 172.21.15.22:0/972233262 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84081b7870 0x7f84081b9cd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:37.474 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.465 7f840e16c700 1 --2- 172.21.15.22:0/972233262 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f84080f6420 0x7f84080f1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:37.474 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.465 7f840e16c700 1 -- 172.21.15.22:0/972233262 >> 172.21.15.22:0/972233262 conn(0x7f84081171d0 msgr2=0x7f84080f2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:37.475 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.465 7f840e16c700 1 -- 172.21.15.22:0/972233262 shutdown_connections 2022-04-28T14:39:37.475 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.465 7f840e16c700 1 -- 172.21.15.22:0/972233262 wait complete. 2022-04-28T14:39:37.496 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.489 7f840e16c700 1 Processor -- start 2022-04-28T14:39:37.496 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.489 7f840e16c700 1 -- start start 2022-04-28T14:39:37.496 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.489 7f840e16c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84080b6070 0x7f84081c3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:37.496 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.489 7f840e16c700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f84080b64c0 0x7f84081c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:37.497 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.489 7f840e16c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f84080d0680 0x7f84080d0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:37.497 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.489 7f840e16c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84080e2630 con 0x7f84080b6070 2022-04-28T14:39:37.497 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.489 7f840e16c700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84080cf8e0 con 0x7f84080b64c0 2022-04-28T14:39:37.497 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.489 7f840e16c700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84080b5890 con 0x7f84080d0680 2022-04-28T14:39:37.497 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.489 7f84065c5700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f84080b64c0 0x7f84081c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:37.497 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.489 7f8406dc6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84080b6070 0x7f84081c3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:37.497 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.489 7f84065c5700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f84080b64c0 0x7f84081c3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46856/0 (socket says 172.21.15.22:46856) 2022-04-28T14:39:37.497 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.489 7f8406dc6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84080b6070 0x7f84081c3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49286/0 (socket says 172.21.15.22:49286) 2022-04-28T14:39:37.497 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.489 7f84065c5700 1 -- 172.21.15.22:0/3444056206 learned_addr learned my addr 172.21.15.22:0/3444056206 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:37.498 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.489 7f84075c7700 1 --2- 172.21.15.22:0/3444056206 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f84080d0680 0x7f84080d0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:37.498 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.490 7f84065c5700 1 -- 172.21.15.22:0/3444056206 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f84080d0680 msgr2=0x7f84080d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:37.498 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.490 7f84065c5700 1 --2- 172.21.15.22:0/3444056206 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f84080d0680 0x7f84080d0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:37.498 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.490 7f84065c5700 1 -- 172.21.15.22:0/3444056206 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84080b6070 msgr2=0x7f84081c3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:37.498 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.490 7f84065c5700 1 --2- 172.21.15.22:0/3444056206 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84080b6070 0x7f84081c3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:37.498 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.490 7f84065c5700 1 -- 172.21.15.22:0/3444056206 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84080d1d80 con 0x7f84080b64c0 2022-04-28T14:39:37.498 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.490 7f84075c7700 1 --2- 172.21.15.22:0/3444056206 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f84080d0680 0x7f84080d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:37.498 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.490 7f8406dc6700 1 --2- 172.21.15.22:0/3444056206 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84080b6070 0x7f84081c3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:37.499 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.490 7f84065c5700 1 --2- 172.21.15.22:0/3444056206 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f84080b64c0 0x7f84081c3ea0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f84080b56b0 tx=0x7f83f800c860).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:37.499 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.490 7f83fffff700 1 -- 172.21.15.22:0/3444056206 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f83f80072e0 con 0x7f84080b64c0 2022-04-28T14:39:37.499 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.490 7f83fffff700 1 -- 172.21.15.22:0/3444056206 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f8005560 con 0x7f84080b64c0 2022-04-28T14:39:37.499 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.490 7f840e16c700 1 -- 172.21.15.22:0/3444056206 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84080cf520 con 0x7f84080b64c0 2022-04-28T14:39:37.499 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.490 7f83fffff700 1 -- 172.21.15.22:0/3444056206 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f83f8005930 con 0x7f84080b64c0 2022-04-28T14:39:37.499 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.490 7f840e16c700 1 -- 172.21.15.22:0/3444056206 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84081c44d0 con 0x7f84080b64c0 2022-04-28T14:39:37.499 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.491 7f83fffff700 1 -- 172.21.15.22:0/3444056206 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f83f8005b30 con 0x7f84080b64c0 2022-04-28T14:39:37.499 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.491 7f83fffff700 1 -- 172.21.15.22:0/3444056206 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f83f8028b10 con 0x7f84080b64c0 2022-04-28T14:39:37.499 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.491 7f840e16c700 1 -- 172.21.15.22:0/3444056206 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84080f0370 con 0x7f84080b64c0 2022-04-28T14:39:37.500 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.494 7f83fffff700 1 -- 172.21.15.22:0/3444056206 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f83f80070d0 con 0x7f84080b64c0 2022-04-28T14:39:37.619 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.614 7f840e16c700 1 -- 172.21.15.22:0/3444056206 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f84080cfb70 con 0x7f84080b64c0 2022-04-28T14:39:37.998 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.993 7f83fffff700 1 -- 172.21.15.22:0/3444056206 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f83f8000c30 con 0x7f84080b64c0 2022-04-28T14:39:38.000 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.995 7f840e16c700 1 -- 172.21.15.22:0/3444056206 >> v1:172.21.15.22:6808/86956 conn(0x7f83ec01c1b0 legacy=0x7f83ec01e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:38.000 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.995 7f840e16c700 1 -- 172.21.15.22:0/3444056206 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f84080b64c0 msgr2=0x7f84081c3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:38.000 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.995 7f840e16c700 1 --2- 172.21.15.22:0/3444056206 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f84080b64c0 0x7f84081c3ea0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f84080b56b0 tx=0x7f83f800c860).stop 2022-04-28T14:39:38.001 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.996 7f840e16c700 1 -- 172.21.15.22:0/3444056206 shutdown_connections 2022-04-28T14:39:38.001 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.996 7f840e16c700 1 --2- 172.21.15.22:0/3444056206 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f84080d0680 0x7f84080d0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:38.001 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.996 7f840e16c700 1 --2- 172.21.15.22:0/3444056206 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84080b6070 0x7f84081c3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:38.001 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.996 7f840e16c700 1 --2- 172.21.15.22:0/3444056206 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f84080b64c0 0x7f84081c3ea0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:38.001 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.996 7f840e16c700 1 -- 172.21.15.22:0/3444056206 >> 172.21.15.22:0/3444056206 conn(0x7f84080adf50 msgr2=0x7f84080d2400 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:38.001 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.996 7f840e16c700 1 -- 172.21.15.22:0/3444056206 shutdown_connections 2022-04-28T14:39:38.002 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:37.996 7f840e16c700 1 -- 172.21.15.22:0/3444056206 wait complete. 2022-04-28T14:39:38.013 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2022-04-28T14:39:38.152 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.144 7f2a601c3700 1 Processor -- start 2022-04-28T14:39:38.152 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.144 7f2a601c3700 1 -- start start 2022-04-28T14:39:38.152 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.145 7f2a601c3700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2a580f61e0 0x7f2a580f1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:38.152 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.145 7f2a601c3700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2a580f1cc0 0x7f2a581b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:38.152 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.145 7f2a601c3700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a580ab080 con 0x7f2a580f1870 2022-04-28T14:39:38.152 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.145 7f2a601c3700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5810ebb0 con 0x7f2a580f1cc0 2022-04-28T14:39:38.152 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.145 7f2a601c3700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a581b53f0 con 0x7f2a580f61e0 2022-04-28T14:39:38.152 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.145 7f2a5d7c3700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2a580f1cc0 0x7f2a581b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:38.153 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.145 7f2a57fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2a580f1870 0x7f2a581b45c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38692/0 (socket says 172.21.15.22:38692) 2022-04-28T14:39:38.153 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.145 7f2a5cfc2700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2a580f61e0 0x7f2a580f1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:38.153 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.145 7f2a57fff700 1 -- 172.21.15.22:0/2043253421 learned_addr learned my addr 172.21.15.22:0/2043253421 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:39:38.153 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.145 7f2a577fe700 1 -- 172.21.15.22:0/2043253421 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3687787636 0 0) 0x7f2a48001110 con 0x7f2a580f1870 2022-04-28T14:39:38.153 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.145 7f2a5d7c3700 1 -- 172.21.15.22:0/2043253421 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2a580f61e0 msgr2=0x7f2a580f1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:38.153 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.145 7f2a5d7c3700 1 --2- 172.21.15.22:0/2043253421 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2a580f61e0 0x7f2a580f1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:38.153 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.145 7f2a5d7c3700 1 -- 172.21.15.22:0/2043253421 >> v1:172.21.15.22:6789/0 conn(0x7f2a580f1870 legacy=0x7f2a581b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:38.153 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.145 7f2a5d7c3700 1 -- 172.21.15.22:0/2043253421 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a58116e10 con 0x7f2a580f1cc0 2022-04-28T14:39:38.153 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.145 7f2a5cfc2700 1 --2- 172.21.15.22:0/2043253421 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2a580f61e0 0x7f2a580f1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:38.154 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.145 7f2a5d7c3700 1 --2- 172.21.15.22:0/2043253421 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2a580f1cc0 0x7f2a581b4dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f2a500032f0 tx=0x7f2a50009d40).ready entity=mon.1 client_cookie=6b5d9f5d719e9fe7 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:38.154 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.146 7f2a577fe700 1 -- 172.21.15.22:0/2043253421 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2a58116e10 con 0x7f2a580f1cc0 2022-04-28T14:39:38.154 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.146 7f2a577fe700 1 -- 172.21.15.22:0/2043253421 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5000b800 con 0x7f2a580f1cc0 2022-04-28T14:39:38.154 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.146 7f2a577fe700 1 -- 172.21.15.22:0/2043253421 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2a5000b9e0 con 0x7f2a580f1cc0 2022-04-28T14:39:38.154 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.146 7f2a601c3700 1 -- 172.21.15.22:0/2043253421 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2a580f1cc0 msgr2=0x7f2a581b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:38.154 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.146 7f2a601c3700 1 --2- 172.21.15.22:0/2043253421 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2a580f1cc0 0x7f2a581b4dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f2a500032f0 tx=0x7f2a50009d40).stop 2022-04-28T14:39:38.154 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.146 7f2a601c3700 1 -- 172.21.15.22:0/2043253421 shutdown_connections 2022-04-28T14:39:38.154 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.146 7f2a601c3700 1 --2- 172.21.15.22:0/2043253421 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2a580f1cc0 0x7f2a581b4dc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:38.154 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.146 7f2a601c3700 1 --2- 172.21.15.22:0/2043253421 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2a580f61e0 0x7f2a580f1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:38.154 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.146 7f2a601c3700 1 -- 172.21.15.22:0/2043253421 >> 172.21.15.22:0/2043253421 conn(0x7f2a581170f0 msgr2=0x7f2a580f2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:38.155 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.146 7f2a601c3700 1 -- 172.21.15.22:0/2043253421 shutdown_connections 2022-04-28T14:39:38.155 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.146 7f2a601c3700 1 -- 172.21.15.22:0/2043253421 wait complete. 2022-04-28T14:39:38.175 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.170 7f2a601c3700 1 Processor -- start 2022-04-28T14:39:38.175 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.170 7f2a601c3700 1 -- start start 2022-04-28T14:39:38.178 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.171 7f2a601c3700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2a580cf8d0 0x7f2a580bdae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:38.178 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.171 7f2a601c3700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a580b7290 0x7f2a580b76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:38.178 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.171 7f2a601c3700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2a580b7d10 0x7f2a581c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:38.178 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.171 7f2a601c3700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a58116de0 con 0x7f2a580b7290 2022-04-28T14:39:38.178 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.171 7f2a601c3700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a580b5bd0 con 0x7f2a580b7d10 2022-04-28T14:39:38.178 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.171 7f2a601c3700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a580b5f10 con 0x7f2a580cf8d0 2022-04-28T14:39:38.179 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.171 7f2a5cfc2700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2a580cf8d0 0x7f2a580bdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:38.179 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.171 7f2a57fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a580b7290 0x7f2a580b76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:38.179 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.171 7f2a5d7c3700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2a580b7d10 0x7f2a581c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:38.179 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.171 7f2a5cfc2700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2a580cf8d0 0x7f2a580bdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46652/0 (socket says 172.21.15.22:46652) 2022-04-28T14:39:38.179 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.171 7f2a5cfc2700 1 -- 172.21.15.22:0/3671688707 learned_addr learned my addr 172.21.15.22:0/3671688707 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:38.179 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.171 7f2a57fff700 1 --2- 172.21.15.22:0/3671688707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a580b7290 0x7f2a580b76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49302/0 (socket says 172.21.15.22:49302) 2022-04-28T14:39:38.179 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.171 7f2a57fff700 1 -- 172.21.15.22:0/3671688707 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2a580cf8d0 msgr2=0x7f2a580bdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:38.179 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.171 7f2a57fff700 1 --2- 172.21.15.22:0/3671688707 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2a580cf8d0 0x7f2a580bdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:38.179 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.171 7f2a57fff700 1 -- 172.21.15.22:0/3671688707 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2a580b7d10 msgr2=0x7f2a581c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:38.180 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.171 7f2a57fff700 1 --2- 172.21.15.22:0/3671688707 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2a580b7d10 0x7f2a581c5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:38.180 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.171 7f2a57fff700 1 -- 172.21.15.22:0/3671688707 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a580b8320 con 0x7f2a580b7290 2022-04-28T14:39:38.180 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.171 7f2a5d7c3700 1 --2- 172.21.15.22:0/3671688707 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2a580b7d10 0x7f2a581c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:38.180 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.171 7f2a57fff700 1 --2- 172.21.15.22:0/3671688707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a580b7290 0x7f2a580b76e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f2a48000bc0 tx=0x7f2a4800c7d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:38.180 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.171 7f2a55ffb700 1 -- 172.21.15.22:0/3671688707 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2a580b8320 con 0x7f2a580b7290 2022-04-28T14:39:38.180 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.172 7f2a55ffb700 1 -- 172.21.15.22:0/3671688707 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a480070d0 con 0x7f2a580b7290 2022-04-28T14:39:38.180 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.172 7f2a55ffb700 1 -- 172.21.15.22:0/3671688707 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2a48005620 con 0x7f2a580b7290 2022-04-28T14:39:38.180 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.172 7f2a601c3700 1 -- 172.21.15.22:0/3671688707 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a580d1a90 con 0x7f2a580b7290 2022-04-28T14:39:38.180 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.172 7f2a601c3700 1 -- 172.21.15.22:0/3671688707 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a581c5e10 con 0x7f2a580b7290 2022-04-28T14:39:38.181 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.172 7f2a55ffb700 1 -- 172.21.15.22:0/3671688707 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f2a4801b070 con 0x7f2a580b7290 2022-04-28T14:39:38.181 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.172 7f2a55ffb700 1 -- 172.21.15.22:0/3671688707 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f2a48028e60 con 0x7f2a580b7290 2022-04-28T14:39:38.181 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.173 7f2a601c3700 1 -- 172.21.15.22:0/3671688707 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a580f0290 con 0x7f2a580b7290 2022-04-28T14:39:38.181 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.175 7f2a55ffb700 1 -- 172.21.15.22:0/3671688707 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f2a4800cdc0 con 0x7f2a580b7290 2022-04-28T14:39:38.300 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.295 7f2a601c3700 1 -- 172.21.15.22:0/3671688707 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f2a580a5b50 con 0x7f2a580b7290 2022-04-28T14:39:39.004 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:38.999 7f2a55ffb700 1 -- 172.21.15.22:0/3671688707 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v11) v1 ==== 105+0+0 (secure 0 0 0) 0x7f2a48000c30 con 0x7f2a580b7290 2022-04-28T14:39:39.007 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.002 7f2a601c3700 1 -- 172.21.15.22:0/3671688707 >> v1:172.21.15.22:6808/86956 conn(0x7f2a3c01c150 legacy=0x7f2a3c01e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:39.007 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.002 7f2a601c3700 1 -- 172.21.15.22:0/3671688707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a580b7290 msgr2=0x7f2a580b76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:39.007 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.002 7f2a601c3700 1 --2- 172.21.15.22:0/3671688707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a580b7290 0x7f2a580b76e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f2a48000bc0 tx=0x7f2a4800c7d0).stop 2022-04-28T14:39:39.007 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.002 7f2a601c3700 1 -- 172.21.15.22:0/3671688707 shutdown_connections 2022-04-28T14:39:39.007 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.002 7f2a601c3700 1 --2- 172.21.15.22:0/3671688707 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2a580b7d10 0x7f2a581c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:39.007 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.002 7f2a601c3700 1 --2- 172.21.15.22:0/3671688707 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2a580cf8d0 0x7f2a580bdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:39.008 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.002 7f2a601c3700 1 --2- 172.21.15.22:0/3671688707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a580b7290 0x7f2a580b76e0 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0x7f2a48000bc0 tx=0x7f2a4800c7d0).stop 2022-04-28T14:39:39.008 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.002 7f2a601c3700 1 -- 172.21.15.22:0/3671688707 >> 172.21.15.22:0/3671688707 conn(0x7f2a580ae3f0 msgr2=0x7f2a580d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:39.008 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.002 7f2a601c3700 1 -- 172.21.15.22:0/3671688707 shutdown_connections 2022-04-28T14:39:39.008 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.002 7f2a601c3700 1 -- 172.21.15.22:0/3671688707 wait complete. 2022-04-28T14:39:39.020 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-04-28T14:39:39.158 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.152 7f4d60cf5700 1 Processor -- start 2022-04-28T14:39:39.159 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.152 7f4d60cf5700 1 -- start start 2022-04-28T14:39:39.159 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.152 7f4d60cf5700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4d5c0f62e0 0x7f4d5c0f1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:39.159 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.152 7f4d60cf5700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4d5c0f1970 0x7f4d5c1b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:39.159 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.152 7f4d60cf5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4d5c0f1dc0 0x7f4d5c1b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:39.159 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.152 7f4d60cf5700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d5c10ecb0 con 0x7f4d5c0f1dc0 2022-04-28T14:39:39.159 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.152 7f4d60cf5700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c116f10 con 0x7f4d5c0f62e0 2022-04-28T14:39:39.159 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.152 7f4d60cf5700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c0f6730 con 0x7f4d5c0f1970 2022-04-28T14:39:39.159 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.152 7f4d59a8b700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4d5c0f62e0 0x7f4d5c0f1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:39.160 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.152 7f4d5a28c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4d5c0f1dc0 0x7f4d5c1b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:39.160 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.152 7f4d5928a700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4d5c0f1970 0x7f4d5c1b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:39.160 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.152 7f4d59a8b700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4d5c0f62e0 0x7f4d5c0f1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46876/0 (socket says 172.21.15.22:46876) 2022-04-28T14:39:39.160 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.152 7f4d59a8b700 1 -- 172.21.15.22:0/2180568052 learned_addr learned my addr 172.21.15.22:0/2180568052 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:39.160 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.153 7f4d5928a700 1 -- 172.21.15.22:0/2180568052 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4d5c0f62e0 msgr2=0x7f4d5c0f1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:39.160 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.153 7f4d5928a700 1 --2- 172.21.15.22:0/2180568052 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4d5c0f62e0 0x7f4d5c0f1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:39.160 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.153 7f4d5928a700 1 -- 172.21.15.22:0/2180568052 >> v2:172.21.15.22:3300/0 conn(0x7f4d5c0f1dc0 msgr2=0x7f4d5c1b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:39.160 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.153 7f4d5928a700 1 --2- 172.21.15.22:0/2180568052 >> v2:172.21.15.22:3300/0 conn(0x7f4d5c0f1dc0 0x7f4d5c1b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:39.160 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.153 7f4d5928a700 1 -- 172.21.15.22:0/2180568052 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c1b5320 con 0x7f4d5c0f1970 2022-04-28T14:39:39.161 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.153 7f4d59a8b700 1 --2- 172.21.15.22:0/2180568052 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4d5c0f62e0 0x7f4d5c0f1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:39.161 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.153 7f4d5a28c700 1 --2- 172.21.15.22:0/2180568052 >> v2:172.21.15.22:3300/0 conn(0x7f4d5c0f1dc0 0x7f4d5c1b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:39.161 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.153 7f4d5928a700 1 --2- 172.21.15.22:0/2180568052 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4d5c0f1970 0x7f4d5c1b46c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f4d4c002f70 tx=0x7f4d4c00b970).ready entity=mon.2 client_cookie=d6ed112670511594 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:39.161 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.153 7f4d58a89700 1 -- 172.21.15.22:0/2180568052 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4d5c1b5320 con 0x7f4d5c0f1970 2022-04-28T14:39:39.161 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.153 7f4d58a89700 1 -- 172.21.15.22:0/2180568052 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4c00d570 con 0x7f4d5c0f1970 2022-04-28T14:39:39.161 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.153 7f4d58a89700 1 -- 172.21.15.22:0/2180568052 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4d4c00d940 con 0x7f4d5c0f1970 2022-04-28T14:39:39.161 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.153 7f4d60cf5700 1 -- 172.21.15.22:0/2180568052 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4d5c0f1970 msgr2=0x7f4d5c1b46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:39.161 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.153 7f4d60cf5700 1 --2- 172.21.15.22:0/2180568052 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4d5c0f1970 0x7f4d5c1b46c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f4d4c002f70 tx=0x7f4d4c00b970).stop 2022-04-28T14:39:39.161 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.154 7f4d60cf5700 1 -- 172.21.15.22:0/2180568052 shutdown_connections 2022-04-28T14:39:39.162 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.154 7f4d60cf5700 1 --2- 172.21.15.22:0/2180568052 >> v2:172.21.15.22:3300/0 conn(0x7f4d5c0f1dc0 0x7f4d5c1b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:39.162 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.154 7f4d60cf5700 1 --2- 172.21.15.22:0/2180568052 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4d5c0f62e0 0x7f4d5c0f1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:39.162 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.154 7f4d60cf5700 1 --2- 172.21.15.22:0/2180568052 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4d5c0f1970 0x7f4d5c1b46c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:39.162 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.154 7f4d60cf5700 1 -- 172.21.15.22:0/2180568052 >> 172.21.15.22:0/2180568052 conn(0x7f4d5c1171f0 msgr2=0x7f4d5c0f2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:39.162 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.154 7f4d60cf5700 1 -- 172.21.15.22:0/2180568052 shutdown_connections 2022-04-28T14:39:39.162 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.154 7f4d60cf5700 1 -- 172.21.15.22:0/2180568052 wait complete. 2022-04-28T14:39:39.185 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.178 7f4d60cf5700 1 Processor -- start 2022-04-28T14:39:39.185 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.178 7f4d60cf5700 1 -- start start 2022-04-28T14:39:39.185 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.178 7f4d60cf5700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4d5c0cff10 0x7f4d5c0bb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:39.185 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.178 7f4d60cf5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d5c1c5b80 0x7f4d5c1c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:39.185 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.178 7f4d60cf5700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4d5c1c6600 0x7f4d5c0b3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:39.185 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.178 7f4d60cf5700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c0cfbf0 con 0x7f4d5c1c5b80 2022-04-28T14:39:39.185 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.178 7f4d60cf5700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c0baca0 con 0x7f4d5c1c6600 2022-04-28T14:39:39.185 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.178 7f4d60cf5700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c0ba960 con 0x7f4d5c0cff10 2022-04-28T14:39:39.185 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.178 7f4d59a8b700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4d5c0cff10 0x7f4d5c0bb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:39.186 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.178 7f4d5a28c700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4d5c1c6600 0x7f4d5c0b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:39.186 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.178 7f4d59a8b700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4d5c0cff10 0x7f4d5c0bb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46666/0 (socket says 172.21.15.22:46666) 2022-04-28T14:39:39.186 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.178 7f4d59a8b700 1 -- 172.21.15.22:0/2551205056 learned_addr learned my addr 172.21.15.22:0/2551205056 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:39.186 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.178 7f4d5928a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d5c1c5b80 0x7f4d5c1c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:39.186 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.178 7f4d5a28c700 1 -- 172.21.15.22:0/2551205056 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4d5c0cff10 msgr2=0x7f4d5c0bb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:39.186 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.178 7f4d5a28c700 1 --2- 172.21.15.22:0/2551205056 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4d5c0cff10 0x7f4d5c0bb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:39.186 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.178 7f4d5a28c700 1 -- 172.21.15.22:0/2551205056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d5c1c5b80 msgr2=0x7f4d5c1c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:39.186 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.178 7f4d5a28c700 1 --2- 172.21.15.22:0/2551205056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d5c1c5b80 0x7f4d5c1c5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:39.186 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.178 7f4d5a28c700 1 -- 172.21.15.22:0/2551205056 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c115ee0 con 0x7f4d5c1c6600 2022-04-28T14:39:39.187 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.178 7f4d5928a700 1 --2- 172.21.15.22:0/2551205056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d5c1c5b80 0x7f4d5c1c5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:39.187 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.178 7f4d59a8b700 1 --2- 172.21.15.22:0/2551205056 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4d5c0cff10 0x7f4d5c0bb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:39.187 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.179 7f4d5a28c700 1 --2- 172.21.15.22:0/2551205056 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4d5c1c6600 0x7f4d5c0b3700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f4d5c0bae50 tx=0x7f4d5400eda0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:39.187 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.179 7f4d4affd700 1 -- 172.21.15.22:0/2551205056 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4d5c115ee0 con 0x7f4d5c1c6600 2022-04-28T14:39:39.187 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.179 7f4d4affd700 1 -- 172.21.15.22:0/2551205056 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5400c880 con 0x7f4d5c1c6600 2022-04-28T14:39:39.187 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.179 7f4d4affd700 1 -- 172.21.15.22:0/2551205056 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f4d5400f040 con 0x7f4d5c1c6600 2022-04-28T14:39:39.187 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.179 7f4d60cf5700 1 -- 172.21.15.22:0/2551205056 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d5c0bb770 con 0x7f4d5c1c6600 2022-04-28T14:39:39.187 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.179 7f4d60cf5700 1 -- 172.21.15.22:0/2551205056 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d5c0b3d30 con 0x7f4d5c1c6600 2022-04-28T14:39:39.187 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.179 7f4d4affd700 1 -- 172.21.15.22:0/2551205056 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f4d54022060 con 0x7f4d5c1c6600 2022-04-28T14:39:39.188 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.179 7f4d4affd700 1 -- 172.21.15.22:0/2551205056 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f4d54010040 con 0x7f4d5c1c6600 2022-04-28T14:39:39.188 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.180 7f4d60cf5700 1 -- 172.21.15.22:0/2551205056 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d5c0f0390 con 0x7f4d5c1c6600 2022-04-28T14:39:39.188 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.183 7f4d4affd700 1 -- 172.21.15.22:0/2551205056 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f4d5400c670 con 0x7f4d5c1c6600 2022-04-28T14:39:39.308 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.303 7f4d60cf5700 1 -- 172.21.15.22:0/2551205056 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d5c0a5b80 con 0x7f4d5c1c6600 2022-04-28T14:39:39.308 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.303 7f4d4affd700 1 -- 172.21.15.22:0/2551205056 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2267 (secure 0 0 0) 0x7f4d5c0ffad0 con 0x7f4d5c1c6600 2022-04-28T14:39:39.308 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:39.308 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.22:6818/2291514211","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6818","nonce":2291514211}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-04-28 14:39:13.928436","modified":"2022-04-28 14:39:39.000957","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4184,"mds_1":4198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4184":{"gid":4184,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6819/356491488","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6819","nonce":356491488}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4198":{"gid":4198,"name":"b","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.22:6817/401565232","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6817","nonce":401565232}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-04-28T14:39:39.309 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.304 7f4d60cf5700 1 -- 172.21.15.22:0/2551205056 >> v1:172.21.15.22:6808/86956 conn(0x7f4d3801c1b0 legacy=0x7f4d3801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:39.310 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.304 7f4d60cf5700 1 -- 172.21.15.22:0/2551205056 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4d5c1c6600 msgr2=0x7f4d5c0b3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:39.310 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.304 7f4d60cf5700 1 --2- 172.21.15.22:0/2551205056 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4d5c1c6600 0x7f4d5c0b3700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f4d5c0bae50 tx=0x7f4d5400eda0).stop 2022-04-28T14:39:39.310 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.304 7f4d60cf5700 1 -- 172.21.15.22:0/2551205056 shutdown_connections 2022-04-28T14:39:39.310 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.304 7f4d60cf5700 1 --2- 172.21.15.22:0/2551205056 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4d5c1c6600 0x7f4d5c0b3700 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:39.310 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.304 7f4d60cf5700 1 --2- 172.21.15.22:0/2551205056 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4d5c0cff10 0x7f4d5c0bb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:39.310 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.304 7f4d60cf5700 1 --2- 172.21.15.22:0/2551205056 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4d5c1c5b80 0x7f4d5c1c5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:39.310 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.304 7f4d60cf5700 1 -- 172.21.15.22:0/2551205056 >> 172.21.15.22:0/2551205056 conn(0x7f4d5c125400 msgr2=0x7f4d5c0ab5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:39.310 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.304 7f4d60cf5700 1 -- 172.21.15.22:0/2551205056 shutdown_connections 2022-04-28T14:39:39.311 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:39.304 7f4d60cf5700 1 -- 172.21.15.22:0/2551205056 wait complete. 2022-04-28T14:39:39.311 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 12 2022-04-28T14:39:39.622 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-04-28 14:39:13.928436', 'modified': '2022-04-28 14:39:39.000957', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4184, 'mds_1': 4198}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4184': {'gid': 4184, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6819/356491488', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6819', 'nonce': 356491488}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4198': {'gid': 4198, 'name': 'b', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.22:6817/401565232', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6817', 'nonce': 401565232}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-04-28T14:39:39.622 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4198:up:stopping 2022-04-28T14:39:40.623 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-04-28T14:39:40.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.762 7fb9400cd700 1 Processor -- start 2022-04-28T14:39:40.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.762 7fb9400cd700 1 -- start start 2022-04-28T14:39:40.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.762 7fb9400cd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb9380f6460 0x7fb9380fea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:40.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.762 7fb9400cd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb9380ff070 0x7fb9381b1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:40.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.762 7fb9400cd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb9380ff4c0 0x7fb9381b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:40.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.762 7fb9400cd700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb938115ea0 con 0x7fb9380ff4c0 2022-04-28T14:39:40.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.762 7fb9400cd700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93810b8a0 con 0x7fb9380f6460 2022-04-28T14:39:40.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.762 7fb9400cd700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9380f68b0 con 0x7fb9380ff070 2022-04-28T14:39:40.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.763 7fb93cecc700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb9380f6460 0x7fb9380fea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:40.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.763 7fb93d6cd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb9380ff4c0 0x7fb9381b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:40.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.763 7fb937fff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb9380ff070 0x7fb9381b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:40.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.763 7fb93cecc700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb9380f6460 0x7fb9380fea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46890/0 (socket says 172.21.15.22:46890) 2022-04-28T14:39:40.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.763 7fb93d6cd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb9380ff4c0 0x7fb9381b1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49324/0 (socket says 172.21.15.22:49324) 2022-04-28T14:39:40.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.763 7fb93cecc700 1 -- 172.21.15.22:0/2579898384 learned_addr learned my addr 172.21.15.22:0/2579898384 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:40.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.763 7fb93d6cd700 1 -- 172.21.15.22:0/2579898384 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb9380ff070 msgr2=0x7fb9381b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:40.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.763 7fb93d6cd700 1 --2- 172.21.15.22:0/2579898384 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb9380ff070 0x7fb9381b1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:40.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.763 7fb93d6cd700 1 -- 172.21.15.22:0/2579898384 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb9380f6460 msgr2=0x7fb9380fea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:40.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.763 7fb93d6cd700 1 --2- 172.21.15.22:0/2579898384 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb9380f6460 0x7fb9380fea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:40.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.763 7fb93d6cd700 1 -- 172.21.15.22:0/2579898384 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb938111550 con 0x7fb9380ff4c0 2022-04-28T14:39:40.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.763 7fb937fff700 1 --2- 172.21.15.22:0/2579898384 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb9380ff070 0x7fb9381b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:40.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.763 7fb93cecc700 1 --2- 172.21.15.22:0/2579898384 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb9380f6460 0x7fb9380fea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:40.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.763 7fb93d6cd700 1 --2- 172.21.15.22:0/2579898384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9380ff4c0 0x7fb9381b1b60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fb938116050 tx=0x7fb930009d40).ready entity=mon.0 client_cookie=1da91cd61ca4fcf server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:40.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.763 7fb9377fe700 1 -- 172.21.15.22:0/2579898384 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb938111550 con 0x7fb9380ff4c0 2022-04-28T14:39:40.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.763 7fb9377fe700 1 -- 172.21.15.22:0/2579898384 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93000b7c0 con 0x7fb9380ff4c0 2022-04-28T14:39:40.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.763 7fb9377fe700 1 -- 172.21.15.22:0/2579898384 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb93000b9a0 con 0x7fb9380ff4c0 2022-04-28T14:39:40.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.763 7fb9400cd700 1 -- 172.21.15.22:0/2579898384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9380ff4c0 msgr2=0x7fb9381b1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:40.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.763 7fb9400cd700 1 --2- 172.21.15.22:0/2579898384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9380ff4c0 0x7fb9381b1b60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fb938116050 tx=0x7fb930009d40).stop 2022-04-28T14:39:40.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.764 7fb9400cd700 1 -- 172.21.15.22:0/2579898384 shutdown_connections 2022-04-28T14:39:40.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.764 7fb9400cd700 1 --2- 172.21.15.22:0/2579898384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9380ff4c0 0x7fb9381b1b60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:40.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.764 7fb9400cd700 1 --2- 172.21.15.22:0/2579898384 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb9380f6460 0x7fb9380fea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:40.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.764 7fb9400cd700 1 --2- 172.21.15.22:0/2579898384 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb9380ff070 0x7fb9381b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:40.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.764 7fb9400cd700 1 -- 172.21.15.22:0/2579898384 >> 172.21.15.22:0/2579898384 conn(0x7fb9381171f0 msgr2=0x7fb9380f2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:40.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.764 7fb9400cd700 1 -- 172.21.15.22:0/2579898384 shutdown_connections 2022-04-28T14:39:40.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.764 7fb9400cd700 1 -- 172.21.15.22:0/2579898384 wait complete. 2022-04-28T14:39:40.792 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.788 7fb9400cd700 1 Processor -- start 2022-04-28T14:39:40.793 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.788 7fb9400cd700 1 -- start start 2022-04-28T14:39:40.795 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.789 7fb9400cd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb9380dca60 0x7fb9380b3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:40.795 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.789 7fb9400cd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb9380b3f40 0x7fb9381c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:40.795 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.789 7fb9400cd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9381c5ae0 0x7fb9381c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:40.796 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.789 7fb9400cd700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9381c3200 con 0x7fb9381c5ae0 2022-04-28T14:39:40.796 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.789 7fb9400cd700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9380bd880 con 0x7fb9380b3f40 2022-04-28T14:39:40.796 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.789 7fb9400cd700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9380cba20 con 0x7fb9380dca60 2022-04-28T14:39:40.796 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.789 7fb937fff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb9380b3f40 0x7fb9381c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:40.796 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.789 7fb93d6cd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9381c5ae0 0x7fb9381c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:40.796 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.789 7fb93cecc700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb9380dca60 0x7fb9380b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:40.796 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.789 7fb937fff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb9380b3f40 0x7fb9381c54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46898/0 (socket says 172.21.15.22:46898) 2022-04-28T14:39:40.796 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.789 7fb93d6cd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9381c5ae0 0x7fb9381c5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49332/0 (socket says 172.21.15.22:49332) 2022-04-28T14:39:40.796 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.789 7fb937fff700 1 -- 172.21.15.22:0/2874805700 learned_addr learned my addr 172.21.15.22:0/2874805700 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:40.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.789 7fb937fff700 1 -- 172.21.15.22:0/2874805700 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb9380dca60 msgr2=0x7fb9380b3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:40.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.789 7fb937fff700 1 --2- 172.21.15.22:0/2874805700 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb9380dca60 0x7fb9380b3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:40.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.789 7fb937fff700 1 -- 172.21.15.22:0/2874805700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9381c5ae0 msgr2=0x7fb9381c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:40.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.789 7fb937fff700 1 --2- 172.21.15.22:0/2874805700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9381c5ae0 0x7fb9381c5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:40.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.789 7fb937fff700 1 -- 172.21.15.22:0/2874805700 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9380b4390 con 0x7fb9380b3f40 2022-04-28T14:39:40.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.789 7fb93d6cd700 1 --2- 172.21.15.22:0/2874805700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9381c5ae0 0x7fb9381c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:40.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.789 7fb937fff700 1 --2- 172.21.15.22:0/2874805700 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb9380b3f40 0x7fb9381c54b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fb92400c000 tx=0x7fb92400ecd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:40.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.789 7fb935ffb700 1 -- 172.21.15.22:0/2874805700 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb9380b4390 con 0x7fb9380b3f40 2022-04-28T14:39:40.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.789 7fb935ffb700 1 -- 172.21.15.22:0/2874805700 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92400c7b0 con 0x7fb9380b3f40 2022-04-28T14:39:40.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.789 7fb935ffb700 1 -- 172.21.15.22:0/2874805700 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fb92400f040 con 0x7fb9380b3f40 2022-04-28T14:39:40.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.790 7fb9400cd700 1 -- 172.21.15.22:0/2874805700 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9381bfb10 con 0x7fb9380b3f40 2022-04-28T14:39:40.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.790 7fb9400cd700 1 -- 172.21.15.22:0/2874805700 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9380dceb0 con 0x7fb9380b3f40 2022-04-28T14:39:40.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.790 7fb935ffb700 1 -- 172.21.15.22:0/2874805700 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fb924011070 con 0x7fb9380b3f40 2022-04-28T14:39:40.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.790 7fb935ffb700 1 -- 172.21.15.22:0/2874805700 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fb924010040 con 0x7fb9380b3f40 2022-04-28T14:39:40.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.790 7fb9400cd700 1 -- 172.21.15.22:0/2874805700 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9380f0390 con 0x7fb9380b3f40 2022-04-28T14:39:40.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.793 7fb935ffb700 1 -- 172.21.15.22:0/2874805700 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fb92400c5a0 con 0x7fb9380b3f40 2022-04-28T14:39:40.919 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.914 7fb9400cd700 1 -- 172.21.15.22:0/2874805700 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9380a5b80 con 0x7fb9380b3f40 2022-04-28T14:39:40.919 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.914 7fb935ffb700 1 -- 172.21.15.22:0/2874805700 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2267 (secure 0 0 0) 0x7fb924000c30 con 0x7fb9380b3f40 2022-04-28T14:39:40.920 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:40.920 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.22:6818/2291514211","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6818","nonce":2291514211}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-04-28 14:39:13.928436","modified":"2022-04-28 14:39:39.000957","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4184,"mds_1":4198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4184":{"gid":4184,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6819/356491488","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6819","nonce":356491488}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4198":{"gid":4198,"name":"b","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.22:6817/401565232","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6817","nonce":401565232}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-04-28T14:39:40.921 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.915 7fb9400cd700 1 -- 172.21.15.22:0/2874805700 >> v1:172.21.15.22:6808/86956 conn(0x7fb92001c1b0 legacy=0x7fb92001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:40.921 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.916 7fb9400cd700 1 -- 172.21.15.22:0/2874805700 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb9380b3f40 msgr2=0x7fb9381c54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:40.921 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.916 7fb9400cd700 1 --2- 172.21.15.22:0/2874805700 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb9380b3f40 0x7fb9381c54b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fb92400c000 tx=0x7fb92400ecd0).stop 2022-04-28T14:39:40.921 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.916 7fb9400cd700 1 -- 172.21.15.22:0/2874805700 shutdown_connections 2022-04-28T14:39:40.921 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.916 7fb9400cd700 1 --2- 172.21.15.22:0/2874805700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9381c5ae0 0x7fb9381c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:40.922 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.916 7fb9400cd700 1 --2- 172.21.15.22:0/2874805700 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb9380dca60 0x7fb9380b3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:40.922 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.916 7fb9400cd700 1 --2- 172.21.15.22:0/2874805700 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb9380b3f40 0x7fb9381c54b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:40.922 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.916 7fb9400cd700 1 -- 172.21.15.22:0/2874805700 >> 172.21.15.22:0/2874805700 conn(0x7fb9380cf260 msgr2=0x7fb9380cd260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:40.922 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.916 7fb9400cd700 1 -- 172.21.15.22:0/2874805700 shutdown_connections 2022-04-28T14:39:40.922 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:40.916 7fb9400cd700 1 -- 172.21.15.22:0/2874805700 wait complete. 2022-04-28T14:39:40.922 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 12 2022-04-28T14:39:41.233 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-04-28 14:39:13.928436', 'modified': '2022-04-28 14:39:39.000957', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4184, 'mds_1': 4198}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4184': {'gid': 4184, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6819/356491488', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6819', 'nonce': 356491488}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4198': {'gid': 4198, 'name': 'b', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.22:6817/401565232', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6817', 'nonce': 401565232}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-04-28T14:39:41.234 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4198:up:stopping 2022-04-28T14:39:42.235 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-04-28T14:39:42.381 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.374 7f91fdf9c700 1 Processor -- start 2022-04-28T14:39:42.381 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.374 7f91fdf9c700 1 -- start start 2022-04-28T14:39:42.381 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.374 7f91fdf9c700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f91f80f1b40 0x7f91f81b9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:42.381 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.374 7f91fdf9c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f91f81ba040 0x7f91f81bc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.374 7f91fdf9c700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f80ab2b0 con 0x7f91f80f62e0 2022-04-28T14:39:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.374 7f91fdf9c700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f810ecb0 con 0x7f91f80f1b40 2022-04-28T14:39:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.374 7f91fdf9c700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91f8116f10 con 0x7f91f81ba040 2022-04-28T14:39:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.375 7f91f6571700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f91f80f1b40 0x7f91f81b9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.375 7f91f7573700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f91f81ba040 0x7f91f81bc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.375 7f91f6d72700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f91f80f62e0 0x7f91f80f1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38732/0 (socket says 172.21.15.22:38732) 2022-04-28T14:39:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.375 7f91f6d72700 1 -- 172.21.15.22:0/1962881851 learned_addr learned my addr 172.21.15.22:0/1962881851 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:39:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.375 7f91f5d70700 1 -- 172.21.15.22:0/1962881851 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1203368826 0 0) 0x7f91e8001110 con 0x7f91f80f62e0 2022-04-28T14:39:42.382 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.375 7f91f5d70700 1 -- 172.21.15.22:0/1962881851 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91dc003270 con 0x7f91f80f62e0 2022-04-28T14:39:42.383 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.375 7f91f6571700 1 -- 172.21.15.22:0/1962881851 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f91f81ba040 msgr2=0x7f91f81bc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:42.383 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.375 7f91f6571700 1 --2- 172.21.15.22:0/1962881851 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f91f81ba040 0x7f91f81bc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:42.383 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.375 7f91f6571700 1 -- 172.21.15.22:0/1962881851 >> v1:172.21.15.22:6789/0 conn(0x7f91f80f62e0 legacy=0x7f91f80f1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:42.383 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.375 7f91f6571700 1 -- 172.21.15.22:0/1962881851 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f80f6730 con 0x7f91f80f1b40 2022-04-28T14:39:42.383 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.375 7f91f7573700 1 --2- 172.21.15.22:0/1962881851 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f91f81ba040 0x7f91f81bc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:42.383 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.375 7f91f6571700 1 --2- 172.21.15.22:0/1962881851 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f91f80f1b40 0x7f91f81b9a10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f91ec002f70 tx=0x7f91ec00ba20).ready entity=mon.1 client_cookie=23ccd7b22b971779 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:42.383 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.375 7f91f5d70700 1 -- 172.21.15.22:0/1962881851 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f91f80f6730 con 0x7f91f80f1b40 2022-04-28T14:39:42.383 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.375 7f91f5d70700 1 -- 172.21.15.22:0/1962881851 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ec00d570 con 0x7f91f80f1b40 2022-04-28T14:39:42.383 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.375 7f91f5d70700 1 -- 172.21.15.22:0/1962881851 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f91ec00d940 con 0x7f91f80f1b40 2022-04-28T14:39:42.383 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.375 7f91fdf9c700 1 -- 172.21.15.22:0/1962881851 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f91f80f1b40 msgr2=0x7f91f81b9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:42.384 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.375 7f91fdf9c700 1 --2- 172.21.15.22:0/1962881851 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f91f80f1b40 0x7f91f81b9a10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f91ec002f70 tx=0x7f91ec00ba20).stop 2022-04-28T14:39:42.384 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.376 7f91fdf9c700 1 -- 172.21.15.22:0/1962881851 shutdown_connections 2022-04-28T14:39:42.384 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.376 7f91fdf9c700 1 --2- 172.21.15.22:0/1962881851 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f91f81ba040 0x7f91f81bc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:42.384 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.376 7f91fdf9c700 1 --2- 172.21.15.22:0/1962881851 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f91f80f1b40 0x7f91f81b9a10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:42.384 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.376 7f91fdf9c700 1 -- 172.21.15.22:0/1962881851 >> 172.21.15.22:0/1962881851 conn(0x7f91f81171f0 msgr2=0x7f91f80f2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:42.384 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.376 7f91fdf9c700 1 -- 172.21.15.22:0/1962881851 shutdown_connections 2022-04-28T14:39:42.384 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.376 7f91fdf9c700 1 -- 172.21.15.22:0/1962881851 wait complete. 2022-04-28T14:39:42.404 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.400 7f91fdf9c700 1 Processor -- start 2022-04-28T14:39:42.405 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.400 7f91fdf9c700 1 -- start start 2022-04-28T14:39:42.407 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.400 7f91fdf9c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f91f80b1f10 0x7f91f80d2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:42.407 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.400 7f91fdf9c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91f80d2890 0x7f91f81c5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:42.407 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.400 7f91fdf9c700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f91f81c5870 0x7f91f81c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:42.407 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.400 7f91fdf9c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f80d2ce0 con 0x7f91f80d2890 2022-04-28T14:39:42.407 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.400 7f91fdf9c700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f80b1730 con 0x7f91f81c5870 2022-04-28T14:39:42.408 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.400 7f91fdf9c700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91f81b7fe0 con 0x7f91f80b1f10 2022-04-28T14:39:42.408 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.400 7f91f6d72700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f91f80b1f10 0x7f91f80d2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:42.408 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.400 7f91f6571700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91f80d2890 0x7f91f81c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:42.408 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.400 7f91f6d72700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f91f80b1f10 0x7f91f80d2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46694/0 (socket says 172.21.15.22:46694) 2022-04-28T14:39:42.408 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.400 7f91f6d72700 1 -- 172.21.15.22:0/1428106362 learned_addr learned my addr 172.21.15.22:0/1428106362 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:42.408 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.401 7f91f7573700 1 --2- 172.21.15.22:0/1428106362 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f91f81c5870 0x7f91f81c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:42.408 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.401 7f91f6d72700 1 -- 172.21.15.22:0/1428106362 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f91f81c5870 msgr2=0x7f91f81c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:42.408 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.401 7f91f6d72700 1 --2- 172.21.15.22:0/1428106362 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f91f81c5870 0x7f91f81c5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:42.408 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.401 7f91f6d72700 1 -- 172.21.15.22:0/1428106362 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91f80d2890 msgr2=0x7f91f81c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:42.409 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.401 7f91f6d72700 1 --2- 172.21.15.22:0/1428106362 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91f80d2890 0x7f91f81c5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:42.409 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.401 7f91f6d72700 1 -- 172.21.15.22:0/1428106362 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f81b85c0 con 0x7f91f80b1f10 2022-04-28T14:39:42.409 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.401 7f91f6d72700 1 --2- 172.21.15.22:0/1428106362 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f91f80b1f10 0x7f91f80d2260 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f91f80e0590 tx=0x7f91e800c7c0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:42.409 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.401 7f91e7fff700 1 -- 172.21.15.22:0/1428106362 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f91f81b85c0 con 0x7f91f80b1f10 2022-04-28T14:39:42.409 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.401 7f91e7fff700 1 -- 172.21.15.22:0/1428106362 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e80072e0 con 0x7f91f80b1f10 2022-04-28T14:39:42.409 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.401 7f91e7fff700 1 -- 172.21.15.22:0/1428106362 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f91e8005810 con 0x7f91f80b1f10 2022-04-28T14:39:42.409 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.401 7f91fdf9c700 1 -- 172.21.15.22:0/1428106362 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f80b0e00 con 0x7f91f80b1f10 2022-04-28T14:39:42.409 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.401 7f91fdf9c700 1 -- 172.21.15.22:0/1428106362 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f80b2360 con 0x7f91f80b1f10 2022-04-28T14:39:42.409 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.402 7f91e7fff700 1 -- 172.21.15.22:0/1428106362 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f91e8005a10 con 0x7f91f80b1f10 2022-04-28T14:39:42.409 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.402 7f91e7fff700 1 -- 172.21.15.22:0/1428106362 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f91e8028b10 con 0x7f91f80b1f10 2022-04-28T14:39:42.410 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.402 7f91fdf9c700 1 -- 172.21.15.22:0/1428106362 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f80f0390 con 0x7f91f80b1f10 2022-04-28T14:39:42.410 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.405 7f91e7fff700 1 -- 172.21.15.22:0/1428106362 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f91e80070d0 con 0x7f91f80b1f10 2022-04-28T14:39:42.530 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.525 7f91fdf9c700 1 -- 172.21.15.22:0/1428106362 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91f80a5b80 con 0x7f91f80b1f10 2022-04-28T14:39:42.530 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.526 7f91e7fff700 1 -- 172.21.15.22:0/1428106362 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2267 (secure 0 0 0) 0x7f91f81149e0 con 0x7f91f80b1f10 2022-04-28T14:39:42.531 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:42.531 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.22:6818/2291514211","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6818","nonce":2291514211}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-04-28 14:39:13.928436","modified":"2022-04-28 14:39:39.000957","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4184,"mds_1":4198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4184":{"gid":4184,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6819/356491488","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6819","nonce":356491488}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4198":{"gid":4198,"name":"b","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.22:6817/401565232","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6817","nonce":401565232}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-04-28T14:39:42.532 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.527 7f91fdf9c700 1 -- 172.21.15.22:0/1428106362 >> v1:172.21.15.22:6808/86956 conn(0x7f91d401c1b0 legacy=0x7f91d401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:42.532 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.527 7f91fdf9c700 1 -- 172.21.15.22:0/1428106362 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f91f80b1f10 msgr2=0x7f91f80d2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:42.532 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.527 7f91fdf9c700 1 --2- 172.21.15.22:0/1428106362 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f91f80b1f10 0x7f91f80d2260 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f91f80e0590 tx=0x7f91e800c7c0).stop 2022-04-28T14:39:42.532 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.527 7f91fdf9c700 1 -- 172.21.15.22:0/1428106362 shutdown_connections 2022-04-28T14:39:42.532 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.527 7f91fdf9c700 1 --2- 172.21.15.22:0/1428106362 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f91f81c5870 0x7f91f81c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:42.532 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.527 7f91fdf9c700 1 --2- 172.21.15.22:0/1428106362 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f91f80b1f10 0x7f91f80d2260 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:42.533 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.527 7f91fdf9c700 1 --2- 172.21.15.22:0/1428106362 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f91f80d2890 0x7f91f81c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:42.533 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.527 7f91fdf9c700 1 -- 172.21.15.22:0/1428106362 >> 172.21.15.22:0/1428106362 conn(0x7f91f80d5ff0 msgr2=0x7f91f8124dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:42.533 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.527 7f91fdf9c700 1 -- 172.21.15.22:0/1428106362 shutdown_connections 2022-04-28T14:39:42.533 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:42.527 7f91fdf9c700 1 -- 172.21.15.22:0/1428106362 wait complete. 2022-04-28T14:39:42.533 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 12 2022-04-28T14:39:42.844 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-04-28 14:39:13.928436', 'modified': '2022-04-28 14:39:39.000957', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4184, 'mds_1': 4198}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4184': {'gid': 4184, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6819/356491488', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6819', 'nonce': 356491488}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4198': {'gid': 4198, 'name': 'b', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.22:6817/401565232', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6817', 'nonce': 401565232}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-04-28T14:39:42.844 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4198:up:stopping 2022-04-28T14:39:43.845 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-04-28T14:39:43.990 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:43.984 7fe599632700 1 Processor -- start 2022-04-28T14:39:43.990 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:43.984 7fe599632700 1 -- start start 2022-04-28T14:39:43.990 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:43.984 7fe599632700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe5940f6210 0x7fe5940f1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:43.990 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:43.984 7fe599632700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe5940f1cf0 0x7fe5941b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:43.991 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:43.984 7fe599632700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5940ab0b0 con 0x7fe5940f18a0 2022-04-28T14:39:43.991 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:43.984 7fe599632700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59410ebe0 con 0x7fe5940f6210 2022-04-28T14:39:43.991 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:43.984 7fe599632700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5941b5420 con 0x7fe5940f1cf0 2022-04-28T14:39:43.991 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:43.984 7fe592ab2700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe5940f1cf0 0x7fe5941b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:43.991 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:43.984 7fe5922b1700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe5940f6210 0x7fe5940f1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:43.991 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:43.984 7fe592ab2700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe5940f1cf0 0x7fe5941b4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46706/0 (socket says 172.21.15.22:46706) 2022-04-28T14:39:43.991 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:43.984 7fe592ab2700 1 -- 172.21.15.22:0/1916953773 learned_addr learned my addr 172.21.15.22:0/1916953773 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:43.991 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:43.985 7fe592ab2700 1 -- 172.21.15.22:0/1916953773 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe5940f6210 msgr2=0x7fe5940f1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:43.991 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:43.985 7fe592ab2700 1 --2- 172.21.15.22:0/1916953773 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe5940f6210 0x7fe5940f1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:43.992 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:43.985 7fe592ab2700 1 -- 172.21.15.22:0/1916953773 >> v1:172.21.15.22:6789/0 conn(0x7fe5940f18a0 legacy=0x7fe5941b45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:43.992 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:43.985 7fe592ab2700 1 -- 172.21.15.22:0/1916953773 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe594116e40 con 0x7fe5940f1cf0 2022-04-28T14:39:43.992 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:43.985 7fe5922b1700 1 --2- 172.21.15.22:0/1916953773 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe5940f6210 0x7fe5940f1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:43.992 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:43.985 7fe592ab2700 1 --2- 172.21.15.22:0/1916953773 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe5940f1cf0 0x7fe5941b4df0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fe5940f3e60 tx=0x7fe58c009dc0).ready entity=mon.2 client_cookie=18cefb0f164d9a6f server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:43.992 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:43.985 7fe5912af700 1 -- 172.21.15.22:0/1916953773 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe594116e40 con 0x7fe5940f1cf0 2022-04-28T14:39:43.992 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:43.985 7fe5912af700 1 -- 172.21.15.22:0/1916953773 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58c00b910 con 0x7fe5940f1cf0 2022-04-28T14:39:43.992 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:43.985 7fe5912af700 1 -- 172.21.15.22:0/1916953773 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe58c00baf0 con 0x7fe5940f1cf0 2022-04-28T14:39:43.993 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:43.985 7fe599632700 1 -- 172.21.15.22:0/1916953773 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe5940f1cf0 msgr2=0x7fe5941b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:43.993 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:43.985 7fe599632700 1 --2- 172.21.15.22:0/1916953773 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe5940f1cf0 0x7fe5941b4df0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fe5940f3e60 tx=0x7fe58c009dc0).stop 2022-04-28T14:39:43.993 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:43.986 7fe599632700 1 -- 172.21.15.22:0/1916953773 shutdown_connections 2022-04-28T14:39:43.994 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:43.986 7fe599632700 1 --2- 172.21.15.22:0/1916953773 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe5940f1cf0 0x7fe5941b4df0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:43.994 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:43.986 7fe599632700 1 --2- 172.21.15.22:0/1916953773 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe5940f6210 0x7fe5940f1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:43.994 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:43.986 7fe599632700 1 -- 172.21.15.22:0/1916953773 >> 172.21.15.22:0/1916953773 conn(0x7fe594117120 msgr2=0x7fe5940f2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:43.994 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:43.986 7fe599632700 1 -- 172.21.15.22:0/1916953773 shutdown_connections 2022-04-28T14:39:43.994 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:43.986 7fe599632700 1 -- 172.21.15.22:0/1916953773 wait complete. 2022-04-28T14:39:44.017 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.010 7fe599632700 1 Processor -- start 2022-04-28T14:39:44.017 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.010 7fe599632700 1 -- start start 2022-04-28T14:39:44.017 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.011 7fe599632700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe5941b8ed0 0x7fe5941c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:44.018 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.011 7fe599632700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe5941c6240 0x7fe5940d4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:44.018 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.011 7fe599632700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5941c6690 0x7fe5940d5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:44.018 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.011 7fe599632700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5940a7a60 con 0x7fe5941c6690 2022-04-28T14:39:44.018 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.011 7fe599632700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5940af410 con 0x7fe5941c6240 2022-04-28T14:39:44.018 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.011 7fe599632700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5940af0d0 con 0x7fe5941b8ed0 2022-04-28T14:39:44.018 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.011 7fe5922b1700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe5941b8ed0 0x7fe5941c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:44.018 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.011 7fe592ab2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5941c6690 0x7fe5940d5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:44.018 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.011 7fe5922b1700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe5941b8ed0 0x7fe5941c5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46708/0 (socket says 172.21.15.22:46708) 2022-04-28T14:39:44.018 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.011 7fe592ab2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5941c6690 0x7fe5940d5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49360/0 (socket says 172.21.15.22:49360) 2022-04-28T14:39:44.019 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.011 7fe5922b1700 1 -- 172.21.15.22:0/4180226717 learned_addr learned my addr 172.21.15.22:0/4180226717 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:44.019 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.011 7fe591ab0700 1 --2- 172.21.15.22:0/4180226717 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe5941c6240 0x7fe5940d4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:44.019 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.011 7fe592ab2700 1 -- 172.21.15.22:0/4180226717 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe5941b8ed0 msgr2=0x7fe5941c5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:44.019 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.011 7fe592ab2700 1 --2- 172.21.15.22:0/4180226717 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe5941b8ed0 0x7fe5941c5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:44.019 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.011 7fe592ab2700 1 -- 172.21.15.22:0/4180226717 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe5941c6240 msgr2=0x7fe5940d4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:44.019 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.011 7fe592ab2700 1 --2- 172.21.15.22:0/4180226717 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe5941c6240 0x7fe5940d4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:44.019 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.011 7fe592ab2700 1 -- 172.21.15.22:0/4180226717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5940d0780 con 0x7fe5941c6690 2022-04-28T14:39:44.019 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.011 7fe5922b1700 1 --2- 172.21.15.22:0/4180226717 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe5941b8ed0 0x7fe5941c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:44.019 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.011 7fe591ab0700 1 --2- 172.21.15.22:0/4180226717 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe5941c6240 0x7fe5940d4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:44.020 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.011 7fe592ab2700 1 --2- 172.21.15.22:0/4180226717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5941c6690 0x7fe5940d5250 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fe5940af900 tx=0x7fe58c006c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:44.020 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.012 7fe5837fe700 1 -- 172.21.15.22:0/4180226717 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe5940d0780 con 0x7fe5941c6690 2022-04-28T14:39:44.020 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.012 7fe5837fe700 1 -- 172.21.15.22:0/4180226717 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58c011cf0 con 0x7fe5941c6690 2022-04-28T14:39:44.020 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.012 7fe5837fe700 1 -- 172.21.15.22:0/4180226717 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fe58c017040 con 0x7fe5941c6690 2022-04-28T14:39:44.020 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.012 7fe599632700 1 -- 172.21.15.22:0/4180226717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5940cfbc0 con 0x7fe5941c6690 2022-04-28T14:39:44.020 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.012 7fe599632700 1 -- 172.21.15.22:0/4180226717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5940cff80 con 0x7fe5941c6690 2022-04-28T14:39:44.020 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.012 7fe5837fe700 1 -- 172.21.15.22:0/4180226717 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fe58c01c660 con 0x7fe5941c6690 2022-04-28T14:39:44.020 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.012 7fe5837fe700 1 -- 172.21.15.22:0/4180226717 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fe58c018030 con 0x7fe5941c6690 2022-04-28T14:39:44.020 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.013 7fe599632700 1 -- 172.21.15.22:0/4180226717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5940af9d0 con 0x7fe5941c6690 2022-04-28T14:39:44.021 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.016 7fe5837fe700 1 -- 172.21.15.22:0/4180226717 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fe58c011ae0 con 0x7fe5941c6690 2022-04-28T14:39:44.141 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.137 7fe599632700 1 -- 172.21.15.22:0/4180226717 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5940f02c0 con 0x7fe5941c6690 2022-04-28T14:39:44.142 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.137 7fe5837fe700 1 -- 172.21.15.22:0/4180226717 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2267 (secure 0 0 0) 0x7fe58c00b700 con 0x7fe5941c6690 2022-04-28T14:39:44.142 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:44.142 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.22:6818/2291514211","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6818","nonce":2291514211}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-04-28 14:39:13.928436","modified":"2022-04-28 14:39:39.000957","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4184,"mds_1":4198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4184":{"gid":4184,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6819/356491488","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6819","nonce":356491488}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4198":{"gid":4198,"name":"b","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.22:6817/401565232","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6817","nonce":401565232}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-04-28T14:39:44.143 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.138 7fe599632700 1 -- 172.21.15.22:0/4180226717 >> v1:172.21.15.22:6808/86956 conn(0x7fe57001c1b0 legacy=0x7fe57001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:44.143 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.138 7fe599632700 1 -- 172.21.15.22:0/4180226717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5941c6690 msgr2=0x7fe5940d5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:44.144 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.138 7fe599632700 1 --2- 172.21.15.22:0/4180226717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5941c6690 0x7fe5940d5250 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fe5940af900 tx=0x7fe58c006c40).stop 2022-04-28T14:39:44.144 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.138 7fe599632700 1 -- 172.21.15.22:0/4180226717 shutdown_connections 2022-04-28T14:39:44.144 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.138 7fe599632700 1 --2- 172.21.15.22:0/4180226717 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5941c6690 0x7fe5940d5250 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:44.144 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.138 7fe599632700 1 --2- 172.21.15.22:0/4180226717 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe5941b8ed0 0x7fe5941c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:44.144 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.138 7fe599632700 1 --2- 172.21.15.22:0/4180226717 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe5941c6240 0x7fe5940d4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:44.144 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.138 7fe599632700 1 -- 172.21.15.22:0/4180226717 >> 172.21.15.22:0/4180226717 conn(0x7fe5940bd180 msgr2=0x7fe5940d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:44.144 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.138 7fe599632700 1 -- 172.21.15.22:0/4180226717 shutdown_connections 2022-04-28T14:39:44.144 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:44.138 7fe599632700 1 -- 172.21.15.22:0/4180226717 wait complete. 2022-04-28T14:39:44.145 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 12 2022-04-28T14:39:44.456 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-04-28 14:39:13.928436', 'modified': '2022-04-28 14:39:39.000957', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4184, 'mds_1': 4198}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4184': {'gid': 4184, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6819/356491488', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6819', 'nonce': 356491488}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4198': {'gid': 4198, 'name': 'b', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.22:6817/401565232', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6817', 'nonce': 401565232}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-04-28T14:39:44.457 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4198:up:stopping 2022-04-28T14:39:45.457 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-04-28T14:39:45.602 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.595 7f48c13a0700 1 Processor -- start 2022-04-28T14:39:45.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.596 7f48c13a0700 1 -- start start 2022-04-28T14:39:45.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.596 7f48c13a0700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f48bc0f7ae0 0x7f48bc0f08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:45.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.596 7f48c13a0700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f48bc0f7f30 0x7f48bc0f0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:45.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.596 7f48c13a0700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48bc0ab190 con 0x7f48bc1b23e0 2022-04-28T14:39:45.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.596 7f48c13a0700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48bc0f87e0 con 0x7f48bc0f7ae0 2022-04-28T14:39:45.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.596 7f48c13a0700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc117dc0 con 0x7f48bc0f7f30 2022-04-28T14:39:45.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.596 7f48bb3b0700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f48bc0f7ae0 0x7f48bc0f08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:45.604 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.596 7f48bbbb1700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f48bc1b23e0 0x7f48bc1b2830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38764/0 (socket says 172.21.15.22:38764) 2022-04-28T14:39:45.604 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.596 7f48bbbb1700 1 -- 172.21.15.22:0/1640501412 learned_addr learned my addr 172.21.15.22:0/1640501412 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:39:45.604 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.596 7f48babaf700 1 --2- 172.21.15.22:0/1640501412 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f48bc0f7f30 0x7f48bc0f0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:45.604 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.596 7f48bb3b0700 1 -- 172.21.15.22:0/1640501412 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f48bc0f7f30 msgr2=0x7f48bc0f0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:45.604 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.596 7f48bb3b0700 1 --2- 172.21.15.22:0/1640501412 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f48bc0f7f30 0x7f48bc0f0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:45.604 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.596 7f48bb3b0700 1 -- 172.21.15.22:0/1640501412 >> v1:172.21.15.22:6789/0 conn(0x7f48bc1b23e0 legacy=0x7f48bc1b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:45.604 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.596 7f48ba3ae700 1 -- 172.21.15.22:0/1640501412 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2911821082 0 0) 0x7f48b4001490 con 0x7f48bc1b23e0 2022-04-28T14:39:45.604 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.597 7f48bb3b0700 1 -- 172.21.15.22:0/1640501412 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc0f1b10 con 0x7f48bc0f7ae0 2022-04-28T14:39:45.604 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.597 7f48bb3b0700 1 --2- 172.21.15.22:0/1640501412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48bc0f7ae0 0x7f48bc0f08a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f48bc115c80 tx=0x7f48ac00ba20).ready entity=mon.0 client_cookie=36d05891758cca15 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:45.604 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.597 7f48ba3ae700 1 -- 172.21.15.22:0/1640501412 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f48bc0f1b10 con 0x7f48bc0f7ae0 2022-04-28T14:39:45.605 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.597 7f48ba3ae700 1 -- 172.21.15.22:0/1640501412 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac00d5c0 con 0x7f48bc0f7ae0 2022-04-28T14:39:45.605 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.597 7f48ba3ae700 1 -- 172.21.15.22:0/1640501412 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f48ac00d9e0 con 0x7f48bc0f7ae0 2022-04-28T14:39:45.605 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.597 7f48c13a0700 1 -- 172.21.15.22:0/1640501412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48bc0f7ae0 msgr2=0x7f48bc0f08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:45.605 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.597 7f48c13a0700 1 --2- 172.21.15.22:0/1640501412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48bc0f7ae0 0x7f48bc0f08a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f48bc115c80 tx=0x7f48ac00ba20).stop 2022-04-28T14:39:45.605 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.597 7f48c13a0700 1 -- 172.21.15.22:0/1640501412 shutdown_connections 2022-04-28T14:39:45.605 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.597 7f48c13a0700 1 --2- 172.21.15.22:0/1640501412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48bc0f7ae0 0x7f48bc0f08a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:45.605 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.597 7f48c13a0700 1 --2- 172.21.15.22:0/1640501412 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f48bc0f7f30 0x7f48bc0f0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:45.605 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.597 7f48c13a0700 1 -- 172.21.15.22:0/1640501412 >> 172.21.15.22:0/1640501412 conn(0x7f48bc125730 msgr2=0x7f48bc125b80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:45.605 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.597 7f48c13a0700 1 -- 172.21.15.22:0/1640501412 shutdown_connections 2022-04-28T14:39:45.606 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.597 7f48c13a0700 1 -- 172.21.15.22:0/1640501412 wait complete. 2022-04-28T14:39:45.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.621 7f48c13a0700 1 Processor -- start 2022-04-28T14:39:45.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.621 7f48c13a0700 1 -- start start 2022-04-28T14:39:45.628 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.622 7f48c13a0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48bc0cf890 0x7f48bc0d4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:45.629 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.622 7f48c13a0700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f48bc0d0790 0x7f48bc0d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:45.629 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.622 7f48c13a0700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f48bc0d1210 0x7f48bc1c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:45.629 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.622 7f48c13a0700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc0e5f50 con 0x7f48bc0cf890 2022-04-28T14:39:45.629 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.622 7f48c13a0700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc0d5270 con 0x7f48bc0d0790 2022-04-28T14:39:45.629 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.622 7f48c13a0700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc0cfe40 con 0x7f48bc0d1210 2022-04-28T14:39:45.629 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.622 7f48bb3b0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48bc0cf890 0x7f48bc0d4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:45.629 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.622 7f48babaf700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f48bc0d0790 0x7f48bc0d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:45.629 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.622 7f48bb3b0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48bc0cf890 0x7f48bc0d4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49370/0 (socket says 172.21.15.22:49370) 2022-04-28T14:39:45.629 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.622 7f48bbbb1700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f48bc0d1210 0x7f48bc1c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:45.630 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.622 7f48babaf700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f48bc0d0790 0x7f48bc0d0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46940/0 (socket says 172.21.15.22:46940) 2022-04-28T14:39:45.630 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.622 7f48bb3b0700 1 -- 172.21.15.22:0/1425947201 learned_addr learned my addr 172.21.15.22:0/1425947201 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:45.630 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.622 7f48bb3b0700 1 -- 172.21.15.22:0/1425947201 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f48bc0d1210 msgr2=0x7f48bc1c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:45.630 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.622 7f48bb3b0700 1 --2- 172.21.15.22:0/1425947201 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f48bc0d1210 0x7f48bc1c3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:45.630 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.622 7f48bb3b0700 1 -- 172.21.15.22:0/1425947201 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f48bc0d0790 msgr2=0x7f48bc0d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:45.630 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.622 7f48bb3b0700 1 --2- 172.21.15.22:0/1425947201 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f48bc0d0790 0x7f48bc0d0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:45.630 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.622 7f48bb3b0700 1 -- 172.21.15.22:0/1425947201 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc0cf570 con 0x7f48bc0cf890 2022-04-28T14:39:45.630 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.622 7f48babaf700 1 --2- 172.21.15.22:0/1425947201 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f48bc0d0790 0x7f48bc0d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:45.630 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.622 7f48bb3b0700 1 --2- 172.21.15.22:0/1425947201 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48bc0cf890 0x7f48bc0d4390 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f48bc0d65c0 tx=0x7f48ac0068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:45.631 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.623 7f48b8bab700 1 -- 172.21.15.22:0/1425947201 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f48bc0cf570 con 0x7f48bc0cf890 2022-04-28T14:39:45.631 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.623 7f48b8bab700 1 -- 172.21.15.22:0/1425947201 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac00d5c0 con 0x7f48bc0cf890 2022-04-28T14:39:45.631 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.623 7f48c13a0700 1 -- 172.21.15.22:0/1425947201 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48bc0bde00 con 0x7f48bc0cf890 2022-04-28T14:39:45.631 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.623 7f48b8bab700 1 -- 172.21.15.22:0/1425947201 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f48ac022020 con 0x7f48bc0cf890 2022-04-28T14:39:45.631 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.623 7f48c13a0700 1 -- 172.21.15.22:0/1425947201 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48bc0d49c0 con 0x7f48bc0cf890 2022-04-28T14:39:45.631 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.623 7f48b8bab700 1 -- 172.21.15.22:0/1425947201 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f48ac01d450 con 0x7f48bc0cf890 2022-04-28T14:39:45.631 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.623 7f48b8bab700 1 -- 172.21.15.22:0/1425947201 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f48ac013da0 con 0x7f48bc0cf890 2022-04-28T14:39:45.631 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.624 7f48c13a0700 1 -- 172.21.15.22:0/1425947201 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48bc0f0180 con 0x7f48bc0cf890 2022-04-28T14:39:45.632 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.627 7f48b8bab700 1 -- 172.21.15.22:0/1425947201 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f48ac011b50 con 0x7f48bc0cf890 2022-04-28T14:39:45.751 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.746 7f48c13a0700 1 -- 172.21.15.22:0/1425947201 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48bc116550 con 0x7f48bc0cf890 2022-04-28T14:39:45.752 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.747 7f48b8bab700 1 -- 172.21.15.22:0/1425947201 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2267 (secure 0 0 0) 0x7f48ac0358f0 con 0x7f48bc0cf890 2022-04-28T14:39:45.752 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:45.752 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.22:6818/2291514211","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6818","nonce":2291514211}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-04-28 14:39:13.928436","modified":"2022-04-28 14:39:39.000957","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4184,"mds_1":4198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4184":{"gid":4184,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6819/356491488","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6819","nonce":356491488}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4198":{"gid":4198,"name":"b","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.22:6817/401565232","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6817","nonce":401565232}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-04-28T14:39:45.754 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.748 7f48c13a0700 1 -- 172.21.15.22:0/1425947201 >> v1:172.21.15.22:6808/86956 conn(0x7f48a001c1b0 legacy=0x7f48a001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:45.754 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.748 7f48c13a0700 1 -- 172.21.15.22:0/1425947201 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48bc0cf890 msgr2=0x7f48bc0d4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:45.754 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.748 7f48c13a0700 1 --2- 172.21.15.22:0/1425947201 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48bc0cf890 0x7f48bc0d4390 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f48bc0d65c0 tx=0x7f48ac0068c0).stop 2022-04-28T14:39:45.754 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.748 7f48c13a0700 1 -- 172.21.15.22:0/1425947201 shutdown_connections 2022-04-28T14:39:45.754 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.748 7f48c13a0700 1 --2- 172.21.15.22:0/1425947201 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f48bc0d1210 0x7f48bc1c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:45.754 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.748 7f48c13a0700 1 --2- 172.21.15.22:0/1425947201 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48bc0cf890 0x7f48bc0d4390 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:45.755 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.748 7f48c13a0700 1 --2- 172.21.15.22:0/1425947201 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f48bc0d0790 0x7f48bc0d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:45.755 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.748 7f48c13a0700 1 -- 172.21.15.22:0/1425947201 >> 172.21.15.22:0/1425947201 conn(0x7f48bc0bb600 msgr2=0x7f48bc0baaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:45.755 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.748 7f48c13a0700 1 -- 172.21.15.22:0/1425947201 shutdown_connections 2022-04-28T14:39:45.755 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:45.748 7f48c13a0700 1 -- 172.21.15.22:0/1425947201 wait complete. 2022-04-28T14:39:45.755 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 12 2022-04-28T14:39:46.065 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-04-28 14:39:13.928436', 'modified': '2022-04-28 14:39:39.000957', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4184, 'mds_1': 4198}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4184': {'gid': 4184, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6819/356491488', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6819', 'nonce': 356491488}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4198': {'gid': 4198, 'name': 'b', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.22:6817/401565232', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6817', 'nonce': 401565232}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-04-28T14:39:46.065 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4198:up:stopping 2022-04-28T14:39:47.066 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-04-28T14:39:47.212 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.205 7fd14d7b1700 1 Processor -- start 2022-04-28T14:39:47.212 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.205 7fd14d7b1700 1 -- start start 2022-04-28T14:39:47.212 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.205 7fd14d7b1700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd1480f6390 0x7fd1480fe970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:47.212 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.205 7fd14d7b1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd1480fefa0 0x7fd1481b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:47.212 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.205 7fd14d7b1700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1480ab0b0 con 0x7fd1480ff3f0 2022-04-28T14:39:47.212 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.205 7fd14d7b1700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1481b2290 con 0x7fd1480fefa0 2022-04-28T14:39:47.212 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.205 7fd14d7b1700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd148115dd0 con 0x7fd1480f6390 2022-04-28T14:39:47.212 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.205 7fd146571700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd1480f6390 0x7fd1480fe970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:47.212 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.206 7fd145d70700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd1480fefa0 0x7fd1481b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:47.213 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.206 7fd146571700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd1480f6390 0x7fd1480fe970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46946/0 (socket says 172.21.15.22:46946) 2022-04-28T14:39:47.213 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.206 7fd146571700 1 -- 172.21.15.22:0/380406037 learned_addr learned my addr 172.21.15.22:0/380406037 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:47.213 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.206 7fd145d70700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd1480fefa0 0x7fd1481b1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49380/0 (socket says 172.21.15.22:49380) 2022-04-28T14:39:47.213 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.206 7fd146d72700 1 --1- 172.21.15.22:0/380406037 >> v1:172.21.15.22:6789/0 conn(0x7fd1480ff3f0 0x7fd1481b1a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38778/0 (socket says 172.21.15.22:38778) 2022-04-28T14:39:47.213 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.206 7fd146571700 1 -- 172.21.15.22:0/380406037 >> v2:172.21.15.22:3300/0 conn(0x7fd1480fefa0 msgr2=0x7fd1481b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:47.213 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.206 7fd146571700 1 --2- 172.21.15.22:0/380406037 >> v2:172.21.15.22:3300/0 conn(0x7fd1480fefa0 0x7fd1481b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:47.213 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.206 7fd146571700 1 -- 172.21.15.22:0/380406037 >> v1:172.21.15.22:6789/0 conn(0x7fd1480ff3f0 legacy=0x7fd1481b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:47.213 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.206 7fd146571700 1 -- 172.21.15.22:0/380406037 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14810b7d0 con 0x7fd1480f6390 2022-04-28T14:39:47.213 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.206 7fd146571700 1 --2- 172.21.15.22:0/380406037 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd1480f6390 0x7fd1480fe970 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd138002f70 tx=0x7fd1380099d0).ready entity=mon.1 client_cookie=6044397c3d24bcd5 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:47.214 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.206 7fd14556f700 1 -- 172.21.15.22:0/380406037 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd14810b7d0 con 0x7fd1480f6390 2022-04-28T14:39:47.214 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.206 7fd14556f700 1 -- 172.21.15.22:0/380406037 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13800f510 con 0x7fd1480f6390 2022-04-28T14:39:47.214 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.206 7fd14556f700 1 -- 172.21.15.22:0/380406037 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd13800f6f0 con 0x7fd1480f6390 2022-04-28T14:39:47.214 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.206 7fd14d7b1700 1 -- 172.21.15.22:0/380406037 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd1480f6390 msgr2=0x7fd1480fe970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:47.214 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.206 7fd14d7b1700 1 --2- 172.21.15.22:0/380406037 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd1480f6390 0x7fd1480fe970 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd138002f70 tx=0x7fd1380099d0).stop 2022-04-28T14:39:47.214 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.207 7fd14d7b1700 1 -- 172.21.15.22:0/380406037 shutdown_connections 2022-04-28T14:39:47.214 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.207 7fd14d7b1700 1 --2- 172.21.15.22:0/380406037 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd1480f6390 0x7fd1480fe970 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:47.214 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.207 7fd14d7b1700 1 --2- 172.21.15.22:0/380406037 >> v2:172.21.15.22:3300/0 conn(0x7fd1480fefa0 0x7fd1481b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:47.214 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.207 7fd14d7b1700 1 -- 172.21.15.22:0/380406037 >> 172.21.15.22:0/380406037 conn(0x7fd148117120 msgr2=0x7fd1480f2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:47.215 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.207 7fd14d7b1700 1 -- 172.21.15.22:0/380406037 shutdown_connections 2022-04-28T14:39:47.215 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.207 7fd14d7b1700 1 -- 172.21.15.22:0/380406037 wait complete. 2022-04-28T14:39:47.237 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.231 7fd14d7b1700 1 Processor -- start 2022-04-28T14:39:47.238 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.231 7fd14d7b1700 1 -- start start 2022-04-28T14:39:47.238 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.231 7fd14d7b1700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd1480cbae0 0x7fd1481ba840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:47.238 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.231 7fd14d7b1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1481bae70 0x7fd1481c1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:47.238 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.231 7fd14d7b1700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd1481bb2c0 0x7fd1481c1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:47.238 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.231 7fd14d7b1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1480a2fa0 con 0x7fd1481bae70 2022-04-28T14:39:47.238 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.231 7fd14d7b1700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1480c94b0 con 0x7fd1480cbae0 2022-04-28T14:39:47.238 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.231 7fd14d7b1700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1480c9170 con 0x7fd1481bb2c0 2022-04-28T14:39:47.239 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.231 7fd145d70700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1481bae70 0x7fd1481c1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:47.239 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.231 7fd145d70700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1481bae70 0x7fd1481c1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49386/0 (socket says 172.21.15.22:49386) 2022-04-28T14:39:47.239 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.231 7fd145d70700 1 -- 172.21.15.22:0/2924587028 learned_addr learned my addr 172.21.15.22:0/2924587028 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:47.239 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.231 7fd146d72700 1 --2- 172.21.15.22:0/2924587028 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd1481bb2c0 0x7fd1481c1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:47.239 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.231 7fd146571700 1 --2- 172.21.15.22:0/2924587028 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd1480cbae0 0x7fd1481ba840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:47.239 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.232 7fd145d70700 1 -- 172.21.15.22:0/2924587028 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd1481bb2c0 msgr2=0x7fd1481c1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:47.239 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.232 7fd145d70700 1 --2- 172.21.15.22:0/2924587028 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd1481bb2c0 0x7fd1481c1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:47.239 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.232 7fd145d70700 1 -- 172.21.15.22:0/2924587028 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd1480cbae0 msgr2=0x7fd1481ba840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:47.239 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.232 7fd145d70700 1 --2- 172.21.15.22:0/2924587028 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd1480cbae0 0x7fd1481ba840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:47.239 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.232 7fd145d70700 1 -- 172.21.15.22:0/2924587028 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1480df800 con 0x7fd1481bae70 2022-04-28T14:39:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.232 7fd145d70700 1 --2- 172.21.15.22:0/2924587028 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1481bae70 0x7fd1481c1100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fd148120630 tx=0x7fd13c0103a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.232 7fd1377fe700 1 -- 172.21.15.22:0/2924587028 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd1480df800 con 0x7fd1481bae70 2022-04-28T14:39:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.232 7fd1377fe700 1 -- 172.21.15.22:0/2924587028 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13c014040 con 0x7fd1481bae70 2022-04-28T14:39:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.232 7fd14d7b1700 1 -- 172.21.15.22:0/2924587028 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1480ca490 con 0x7fd1481bae70 2022-04-28T14:39:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.232 7fd1377fe700 1 -- 172.21.15.22:0/2924587028 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd13c010b20 con 0x7fd1481bae70 2022-04-28T14:39:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.232 7fd14d7b1700 1 -- 172.21.15.22:0/2924587028 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1480cbf30 con 0x7fd1481bae70 2022-04-28T14:39:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.233 7fd1377fe700 1 -- 172.21.15.22:0/2924587028 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fd13c010d20 con 0x7fd1481bae70 2022-04-28T14:39:47.240 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.233 7fd1377fe700 1 -- 172.21.15.22:0/2924587028 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fd13c02dfc0 con 0x7fd1481bae70 2022-04-28T14:39:47.241 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.233 7fd14d7b1700 1 -- 172.21.15.22:0/2924587028 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1480f02c0 con 0x7fd1481bae70 2022-04-28T14:39:47.241 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.236 7fd1377fe700 1 -- 172.21.15.22:0/2924587028 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fd13c012e10 con 0x7fd1481bae70 2022-04-28T14:39:47.362 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.357 7fd14d7b1700 1 -- 172.21.15.22:0/2924587028 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1480a5b80 con 0x7fd1481bae70 2022-04-28T14:39:47.362 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.357 7fd1377fe700 1 -- 172.21.15.22:0/2924587028 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2267 (secure 0 0 0) 0x7fd13c000c30 con 0x7fd1481bae70 2022-04-28T14:39:47.362 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:47.363 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.22:6818/2291514211","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6818","nonce":2291514211}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-04-28 14:39:13.928436","modified":"2022-04-28 14:39:39.000957","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4184,"mds_1":4198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4184":{"gid":4184,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6819/356491488","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6819","nonce":356491488}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4198":{"gid":4198,"name":"b","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.22:6817/401565232","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6817","nonce":401565232}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-04-28T14:39:47.364 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.358 7fd14d7b1700 1 -- 172.21.15.22:0/2924587028 >> v1:172.21.15.22:6808/86956 conn(0x7fd12401c1b0 legacy=0x7fd12401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:47.364 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.358 7fd14d7b1700 1 -- 172.21.15.22:0/2924587028 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1481bae70 msgr2=0x7fd1481c1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:47.364 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.359 7fd14d7b1700 1 --2- 172.21.15.22:0/2924587028 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1481bae70 0x7fd1481c1100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fd148120630 tx=0x7fd13c0103a0).stop 2022-04-28T14:39:47.364 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.359 7fd14d7b1700 1 -- 172.21.15.22:0/2924587028 shutdown_connections 2022-04-28T14:39:47.364 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.359 7fd14d7b1700 1 --2- 172.21.15.22:0/2924587028 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd1481bb2c0 0x7fd1481c1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:47.364 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.359 7fd14d7b1700 1 --2- 172.21.15.22:0/2924587028 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd1480cbae0 0x7fd1481ba840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:47.364 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.359 7fd14d7b1700 1 --2- 172.21.15.22:0/2924587028 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd1481bae70 0x7fd1481c1100 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:47.365 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.359 7fd14d7b1700 1 -- 172.21.15.22:0/2924587028 >> 172.21.15.22:0/2924587028 conn(0x7fd1480ab450 msgr2=0x7fd148120670 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:47.365 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.359 7fd14d7b1700 1 -- 172.21.15.22:0/2924587028 shutdown_connections 2022-04-28T14:39:47.365 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:47.359 7fd14d7b1700 1 -- 172.21.15.22:0/2924587028 wait complete. 2022-04-28T14:39:47.365 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 12 2022-04-28T14:39:47.676 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-04-28 14:39:13.928436', 'modified': '2022-04-28 14:39:39.000957', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4184, 'mds_1': 4198}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4184': {'gid': 4184, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6819/356491488', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6819', 'nonce': 356491488}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4198': {'gid': 4198, 'name': 'b', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.22:6817/401565232', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6817', 'nonce': 401565232}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-04-28T14:39:47.677 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4198:up:stopping 2022-04-28T14:39:48.678 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-04-28T14:39:48.823 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.817 7f61aed0f700 1 Processor -- start 2022-04-28T14:39:48.824 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.817 7f61aed0f700 1 -- start start 2022-04-28T14:39:48.824 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.817 7f61aed0f700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f61a80f6210 0x7f61a80f1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:48.824 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.817 7f61aed0f700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f61a80f18a0 0x7f61a81b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:48.824 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.817 7f61aed0f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a80ab0b0 con 0x7f61a80f1cf0 2022-04-28T14:39:48.824 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.817 7f61aed0f700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a810ebe0 con 0x7f61a80f6210 2022-04-28T14:39:48.824 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.817 7f61aed0f700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61a81b5420 con 0x7f61a80f18a0 2022-04-28T14:39:48.824 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.817 7f61a6ffd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f61a80f18a0 0x7f61a81b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:48.824 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.817 7f61a77fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f61a80f6210 0x7f61a80f1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:48.825 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.817 7f61a6ffd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f61a80f18a0 0x7f61a81b45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46746/0 (socket says 172.21.15.22:46746) 2022-04-28T14:39:48.825 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.817 7f61a77fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f61a80f6210 0x7f61a80f1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46960/0 (socket says 172.21.15.22:46960) 2022-04-28T14:39:48.825 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.817 7f61a6ffd700 1 -- 172.21.15.22:0/3825302194 learned_addr learned my addr 172.21.15.22:0/3825302194 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:48.825 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.818 7f61a77fe700 1 -- 172.21.15.22:0/3825302194 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f61a80f18a0 msgr2=0x7f61a81b45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:48.825 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.818 7f61a77fe700 1 --2- 172.21.15.22:0/3825302194 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f61a80f18a0 0x7f61a81b45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:48.825 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.818 7f61a77fe700 1 -- 172.21.15.22:0/3825302194 >> v1:172.21.15.22:6789/0 conn(0x7f61a80f1cf0 legacy=0x7f61a81b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:48.825 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.818 7f61a77fe700 1 -- 172.21.15.22:0/3825302194 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a8116e40 con 0x7f61a80f6210 2022-04-28T14:39:48.825 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.818 7f61a67fc700 1 -- 172.21.15.22:0/3825302194 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424696830 0 0) 0x7f61a0001490 con 0x7f61a80f1cf0 2022-04-28T14:39:48.825 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.818 7f61a6ffd700 1 --2- 172.21.15.22:0/3825302194 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f61a80f18a0 0x7f61a81b45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:48.825 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.818 7f61a77fe700 1 --2- 172.21.15.22:0/3825302194 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f61a80f6210 0x7f61a80f1270 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f6198002f70 tx=0x7f619800ba20).ready entity=mon.1 client_cookie=485fbd5fe9962e96 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:48.826 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.818 7f61a67fc700 1 -- 172.21.15.22:0/3825302194 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f61a8116e40 con 0x7f61a80f6210 2022-04-28T14:39:48.826 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.818 7f61a67fc700 1 -- 172.21.15.22:0/3825302194 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619800d5c0 con 0x7f61a80f6210 2022-04-28T14:39:48.826 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.818 7f61a67fc700 1 -- 172.21.15.22:0/3825302194 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f619800d9e0 con 0x7f61a80f6210 2022-04-28T14:39:48.826 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.818 7f61aed0f700 1 -- 172.21.15.22:0/3825302194 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f61a80f6210 msgr2=0x7f61a80f1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:48.826 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.818 7f61aed0f700 1 --2- 172.21.15.22:0/3825302194 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f61a80f6210 0x7f61a80f1270 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f6198002f70 tx=0x7f619800ba20).stop 2022-04-28T14:39:48.826 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.819 7f61aed0f700 1 -- 172.21.15.22:0/3825302194 shutdown_connections 2022-04-28T14:39:48.826 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.819 7f61aed0f700 1 --2- 172.21.15.22:0/3825302194 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f61a80f6210 0x7f61a80f1270 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:48.826 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.819 7f61aed0f700 1 --2- 172.21.15.22:0/3825302194 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f61a80f18a0 0x7f61a81b45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:48.826 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.819 7f61aed0f700 1 -- 172.21.15.22:0/3825302194 >> 172.21.15.22:0/3825302194 conn(0x7f61a8117120 msgr2=0x7f61a80f2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:48.827 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.819 7f61aed0f700 1 -- 172.21.15.22:0/3825302194 shutdown_connections 2022-04-28T14:39:48.827 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.819 7f61aed0f700 1 -- 172.21.15.22:0/3825302194 wait complete. 2022-04-28T14:39:48.849 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.843 7f61aed0f700 1 Processor -- start 2022-04-28T14:39:48.849 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.843 7f61aed0f700 1 -- start start 2022-04-28T14:39:48.849 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.843 7f61aed0f700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f61a80cf460 0x7f61a8124400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:48.849 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.843 7f61aed0f700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f61a81c5830 0x7f61a81c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:48.850 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.843 7f61aed0f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61a81c62b0 0x7f61a80b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:48.850 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.843 7f61aed0f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a80efb30 con 0x7f61a81c62b0 2022-04-28T14:39:48.850 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.843 7f61aed0f700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a80d57c0 con 0x7f61a81c5830 2022-04-28T14:39:48.850 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.843 7f61aed0f700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61a80b38e0 con 0x7f61a80cf460 2022-04-28T14:39:48.850 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.843 7f61a77fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f61a80cf460 0x7f61a8124400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:48.850 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.843 7f61a7fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61a81c62b0 0x7f61a80b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:48.850 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.843 7f61a6ffd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f61a81c5830 0x7f61a81c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:48.850 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.843 7f61a77fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f61a80cf460 0x7f61a8124400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46750/0 (socket says 172.21.15.22:46750) 2022-04-28T14:39:48.851 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.843 7f61a77fe700 1 -- 172.21.15.22:0/1028814237 learned_addr learned my addr 172.21.15.22:0/1028814237 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:48.851 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.844 7f61a6ffd700 1 -- 172.21.15.22:0/1028814237 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f61a80cf460 msgr2=0x7f61a8124400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:48.851 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.844 7f61a6ffd700 1 --2- 172.21.15.22:0/1028814237 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f61a80cf460 0x7f61a8124400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:48.851 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.844 7f61a6ffd700 1 -- 172.21.15.22:0/1028814237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61a81c62b0 msgr2=0x7f61a80b3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:48.851 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.844 7f61a6ffd700 1 --2- 172.21.15.22:0/1028814237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61a81c62b0 0x7f61a80b3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:48.851 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.844 7f61a6ffd700 1 -- 172.21.15.22:0/1028814237 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a80cfe90 con 0x7f61a81c5830 2022-04-28T14:39:48.851 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.844 7f61a7fff700 1 --2- 172.21.15.22:0/1028814237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61a81c62b0 0x7f61a80b3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:48.851 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.844 7f61a6ffd700 1 --2- 172.21.15.22:0/1028814237 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f61a81c5830 0x7f61a81c5c80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f61a80d5670 tx=0x7f619c00eaa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:48.851 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.844 7f61a4ff9700 1 -- 172.21.15.22:0/1028814237 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f61a80cfe90 con 0x7f61a81c5830 2022-04-28T14:39:48.851 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.844 7f61a4ff9700 1 -- 172.21.15.22:0/1028814237 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619c012600 con 0x7f61a81c5830 2022-04-28T14:39:48.852 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.844 7f61aed0f700 1 -- 172.21.15.22:0/1028814237 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a80b41a0 con 0x7f61a81c5830 2022-04-28T14:39:48.852 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.844 7f61a4ff9700 1 -- 172.21.15.22:0/1028814237 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f619c00f040 con 0x7f61a81c5830 2022-04-28T14:39:48.852 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.844 7f61aed0f700 1 -- 172.21.15.22:0/1028814237 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a80b4720 con 0x7f61a81c5830 2022-04-28T14:39:48.852 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.845 7f61a4ff9700 1 -- 172.21.15.22:0/1028814237 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f619c022060 con 0x7f61a81c5830 2022-04-28T14:39:48.852 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.845 7f61a4ff9700 1 -- 172.21.15.22:0/1028814237 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f619c010040 con 0x7f61a81c5830 2022-04-28T14:39:48.852 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.845 7f61aed0f700 1 -- 172.21.15.22:0/1028814237 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a80f02c0 con 0x7f61a81c5830 2022-04-28T14:39:48.853 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.848 7f61a4ff9700 1 -- 172.21.15.22:0/1028814237 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f619c0123f0 con 0x7f61a81c5830 2022-04-28T14:39:48.974 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.969 7f61aed0f700 1 -- 172.21.15.22:0/1028814237 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61a80cfc60 con 0x7f61a81c5830 2022-04-28T14:39:48.974 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.969 7f61a4ff9700 1 -- 172.21.15.22:0/1028814237 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2267 (secure 0 0 0) 0x7f619c000c30 con 0x7f61a81c5830 2022-04-28T14:39:48.974 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:48.975 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.22:6818/2291514211","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6818","nonce":2291514211}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-04-28 14:39:13.928436","modified":"2022-04-28 14:39:39.000957","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4184,"mds_1":4198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4184":{"gid":4184,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6819/356491488","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6819","nonce":356491488}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4198":{"gid":4198,"name":"b","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.22:6817/401565232","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6817","nonce":401565232}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-04-28T14:39:48.976 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.970 7f61aed0f700 1 -- 172.21.15.22:0/1028814237 >> v1:172.21.15.22:6808/86956 conn(0x7f618801c1b0 legacy=0x7f618801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:48.976 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.970 7f61aed0f700 1 -- 172.21.15.22:0/1028814237 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f61a81c5830 msgr2=0x7f61a81c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:48.976 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.970 7f61aed0f700 1 --2- 172.21.15.22:0/1028814237 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f61a81c5830 0x7f61a81c5c80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f61a80d5670 tx=0x7f619c00eaa0).stop 2022-04-28T14:39:48.976 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.970 7f61aed0f700 1 -- 172.21.15.22:0/1028814237 shutdown_connections 2022-04-28T14:39:48.976 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.970 7f61aed0f700 1 --2- 172.21.15.22:0/1028814237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61a81c62b0 0x7f61a80b3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:48.976 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.970 7f61aed0f700 1 --2- 172.21.15.22:0/1028814237 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f61a80cf460 0x7f61a8124400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:48.976 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.971 7f61aed0f700 1 --2- 172.21.15.22:0/1028814237 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f61a81c5830 0x7f61a81c5c80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:48.976 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.971 7f61aed0f700 1 -- 172.21.15.22:0/1028814237 >> 172.21.15.22:0/1028814237 conn(0x7f61a80af220 msgr2=0x7f61a80b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:48.977 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.971 7f61aed0f700 1 -- 172.21.15.22:0/1028814237 shutdown_connections 2022-04-28T14:39:48.977 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:48.971 7f61aed0f700 1 -- 172.21.15.22:0/1028814237 wait complete. 2022-04-28T14:39:48.977 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 12 2022-04-28T14:39:49.288 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-04-28 14:39:13.928436', 'modified': '2022-04-28 14:39:39.000957', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4184, 'mds_1': 4198}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4184': {'gid': 4184, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6819/356491488', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6819', 'nonce': 356491488}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4198': {'gid': 4198, 'name': 'b', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.22:6817/401565232', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6817', 'nonce': 401565232}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-04-28T14:39:49.288 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4198:up:stopping 2022-04-28T14:39:50.289 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-04-28T14:39:50.432 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.427 7f3670332700 1 Processor -- start 2022-04-28T14:39:50.432 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.427 7f3670332700 1 -- start start 2022-04-28T14:39:50.434 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.427 7f3670332700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f36680f6390 0x7f36680fe970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:50.435 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.427 7f3670332700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36680fefa0 0x7f36681b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:50.435 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.427 7f3670332700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f36680ff3f0 0x7f36681b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:50.435 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.428 7f3670332700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3668115dd0 con 0x7f36680f6390 2022-04-28T14:39:50.435 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.428 7f3670332700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366810b7d0 con 0x7f36680fefa0 2022-04-28T14:39:50.435 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.428 7f3670332700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36680f67e0 con 0x7f36680ff3f0 2022-04-28T14:39:50.435 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.428 7f366c930700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36680fefa0 0x7f36681b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:50.435 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.428 7f366d131700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f36680f6390 0x7f36680fe970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:50.435 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.428 7f366d932700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f36680ff3f0 0x7f36681b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:50.436 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.428 7f366c930700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36680fefa0 0x7f36681b1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46974/0 (socket says 172.21.15.22:46974) 2022-04-28T14:39:50.436 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.428 7f366d131700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f36680f6390 0x7f36680fe970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49406/0 (socket says 172.21.15.22:49406) 2022-04-28T14:39:50.436 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.428 7f366c930700 1 -- 172.21.15.22:0/2725444273 learned_addr learned my addr 172.21.15.22:0/2725444273 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:50.436 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.428 7f366d131700 1 -- 172.21.15.22:0/2725444273 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f36680ff3f0 msgr2=0x7f36681b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:50.436 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.428 7f366d131700 1 --2- 172.21.15.22:0/2725444273 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f36680ff3f0 0x7f36681b1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:50.436 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.428 7f366d131700 1 -- 172.21.15.22:0/2725444273 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36680fefa0 msgr2=0x7f36681b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:50.436 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.428 7f366d131700 1 --2- 172.21.15.22:0/2725444273 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36680fefa0 0x7f36681b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:50.436 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.428 7f366d131700 1 -- 172.21.15.22:0/2725444273 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3668111480 con 0x7f36680f6390 2022-04-28T14:39:50.437 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.428 7f366c930700 1 --2- 172.21.15.22:0/2725444273 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36680fefa0 0x7f36681b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:50.437 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.428 7f366d131700 1 --2- 172.21.15.22:0/2725444273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36680f6390 0x7f36680fe970 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f3664002f70 tx=0x7f366400b9f0).ready entity=mon.0 client_cookie=845c815e18f2d27c server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:50.437 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.428 7f365bfff700 1 -- 172.21.15.22:0/2725444273 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f3668111480 con 0x7f36680f6390 2022-04-28T14:39:50.437 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.428 7f365bfff700 1 -- 172.21.15.22:0/2725444273 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366400d570 con 0x7f36680f6390 2022-04-28T14:39:50.437 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.428 7f3670332700 1 -- 172.21.15.22:0/2725444273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36680f6390 msgr2=0x7f36680fe970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:50.437 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.428 7f3670332700 1 --2- 172.21.15.22:0/2725444273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36680f6390 0x7f36680fe970 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f3664002f70 tx=0x7f366400b9f0).stop 2022-04-28T14:39:50.437 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.429 7f3670332700 1 -- 172.21.15.22:0/2725444273 shutdown_connections 2022-04-28T14:39:50.437 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.429 7f3670332700 1 --2- 172.21.15.22:0/2725444273 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f36680ff3f0 0x7f36681b1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:50.438 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.429 7f3670332700 1 --2- 172.21.15.22:0/2725444273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36680f6390 0x7f36680fe970 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:50.438 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.429 7f3670332700 1 --2- 172.21.15.22:0/2725444273 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36680fefa0 0x7f36681b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:50.438 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.429 7f3670332700 1 -- 172.21.15.22:0/2725444273 >> 172.21.15.22:0/2725444273 conn(0x7f3668117120 msgr2=0x7f36680f2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:50.438 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.429 7f3670332700 1 -- 172.21.15.22:0/2725444273 shutdown_connections 2022-04-28T14:39:50.438 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.429 7f3670332700 1 -- 172.21.15.22:0/2725444273 wait complete. 2022-04-28T14:39:50.460 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.453 7f3670332700 1 Processor -- start 2022-04-28T14:39:50.460 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.453 7f3670332700 1 -- start start 2022-04-28T14:39:50.460 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.453 7f3670332700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36680d4360 0x7f36680d8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:50.460 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.453 7f3670332700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36680d8a50 0x7f36680cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:50.461 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.453 7f3670332700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f36680d8ea0 0x7f36680cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:50.461 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.453 7f3670332700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36680bb620 con 0x7f36680d4360 2022-04-28T14:39:50.461 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.453 7f3670332700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36680bb2e0 con 0x7f36680d8a50 2022-04-28T14:39:50.461 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.453 7f3670332700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36680bdf10 con 0x7f36680d8ea0 2022-04-28T14:39:50.461 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.454 7f366d932700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f36680d8ea0 0x7f36680cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:50.461 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.454 7f366c930700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36680d8a50 0x7f36680cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:50.461 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.454 7f366d131700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36680d4360 0x7f36680d8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:50.461 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.454 7f366d932700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f36680d8ea0 0x7f36680cd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46768/0 (socket says 172.21.15.22:46768) 2022-04-28T14:39:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.454 7f366d932700 1 -- 172.21.15.22:0/1006568270 learned_addr learned my addr 172.21.15.22:0/1006568270 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.454 7f366c930700 1 -- 172.21.15.22:0/1006568270 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f36680d8ea0 msgr2=0x7f36680cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.454 7f366c930700 1 --2- 172.21.15.22:0/1006568270 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f36680d8ea0 0x7f36680cd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.454 7f366c930700 1 -- 172.21.15.22:0/1006568270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36680d4360 msgr2=0x7f36680d8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.454 7f366c930700 1 --2- 172.21.15.22:0/1006568270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36680d4360 0x7f36680d8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.454 7f366c930700 1 -- 172.21.15.22:0/1006568270 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36681c3270 con 0x7f36680d8a50 2022-04-28T14:39:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.454 7f366d131700 1 --2- 172.21.15.22:0/1006568270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36680d4360 0x7f36680d8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.454 7f366c930700 1 --2- 172.21.15.22:0/1006568270 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36680d8a50 0x7f36680cceb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f36680da080 tx=0x7f365c00eaa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:50.462 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.454 7f365a7fc700 1 -- 172.21.15.22:0/1006568270 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f36681c3270 con 0x7f36680d8a50 2022-04-28T14:39:50.463 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.454 7f365a7fc700 1 -- 172.21.15.22:0/1006568270 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365c012600 con 0x7f36680d8a50 2022-04-28T14:39:50.463 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.454 7f3670332700 1 -- 172.21.15.22:0/1006568270 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36681bfcb0 con 0x7f36680d8a50 2022-04-28T14:39:50.463 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.454 7f365a7fc700 1 -- 172.21.15.22:0/1006568270 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f365c00f040 con 0x7f36680d8a50 2022-04-28T14:39:50.463 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.454 7f3670332700 1 -- 172.21.15.22:0/1006568270 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36680d47b0 con 0x7f36680d8a50 2022-04-28T14:39:50.463 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.455 7f365a7fc700 1 -- 172.21.15.22:0/1006568270 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f365c022060 con 0x7f36680d8a50 2022-04-28T14:39:50.463 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.455 7f365a7fc700 1 -- 172.21.15.22:0/1006568270 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f365c010040 con 0x7f36680d8a50 2022-04-28T14:39:50.463 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.456 7f3670332700 1 -- 172.21.15.22:0/1006568270 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36680f02c0 con 0x7f36680d8a50 2022-04-28T14:39:50.464 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.458 7f365a7fc700 1 -- 172.21.15.22:0/1006568270 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f365c0123f0 con 0x7f36680d8a50 2022-04-28T14:39:50.583 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.578 7f3670332700 1 -- 172.21.15.22:0/1006568270 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36680ef990 con 0x7f36680d8a50 2022-04-28T14:39:50.583 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.579 7f365a7fc700 1 -- 172.21.15.22:0/1006568270 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2267 (secure 0 0 0) 0x7f365c000c30 con 0x7f36680d8a50 2022-04-28T14:39:50.584 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:50.584 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.22:6818/2291514211","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6818","nonce":2291514211}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-04-28 14:39:13.928436","modified":"2022-04-28 14:39:39.000957","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4184,"mds_1":4198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4184":{"gid":4184,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6819/356491488","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6819","nonce":356491488}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4198":{"gid":4198,"name":"b","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.22:6817/401565232","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6817","nonce":401565232}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-04-28T14:39:50.585 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.580 7f3670332700 1 -- 172.21.15.22:0/1006568270 >> v1:172.21.15.22:6808/86956 conn(0x7f364801c1b0 legacy=0x7f364801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:50.585 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.580 7f3670332700 1 -- 172.21.15.22:0/1006568270 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36680d8a50 msgr2=0x7f36680cceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:50.585 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.580 7f3670332700 1 --2- 172.21.15.22:0/1006568270 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36680d8a50 0x7f36680cceb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f36680da080 tx=0x7f365c00eaa0).stop 2022-04-28T14:39:50.585 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.580 7f3670332700 1 -- 172.21.15.22:0/1006568270 shutdown_connections 2022-04-28T14:39:50.586 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.580 7f3670332700 1 --2- 172.21.15.22:0/1006568270 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f36680d8ea0 0x7f36680cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:50.586 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.580 7f3670332700 1 --2- 172.21.15.22:0/1006568270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f36680d4360 0x7f36680d8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:50.586 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.580 7f3670332700 1 --2- 172.21.15.22:0/1006568270 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f36680d8a50 0x7f36680cceb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:50.586 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.580 7f3670332700 1 -- 172.21.15.22:0/1006568270 >> 172.21.15.22:0/1006568270 conn(0x7f3668120a20 msgr2=0x7f36680d66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:50.586 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.580 7f3670332700 1 -- 172.21.15.22:0/1006568270 shutdown_connections 2022-04-28T14:39:50.586 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:50.580 7f3670332700 1 -- 172.21.15.22:0/1006568270 wait complete. 2022-04-28T14:39:50.586 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 12 2022-04-28T14:39:50.898 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-04-28 14:39:13.928436', 'modified': '2022-04-28 14:39:39.000957', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4184, 'mds_1': 4198}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4184': {'gid': 4184, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6819/356491488', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6819', 'nonce': 356491488}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4198': {'gid': 4198, 'name': 'b', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.22:6817/401565232', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6817', 'nonce': 401565232}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-04-28T14:39:50.898 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4198:up:stopping 2022-04-28T14:39:51.899 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-04-28T14:39:52.042 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.038 7f06999e0700 1 Processor -- start 2022-04-28T14:39:52.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.038 7f06999e0700 1 -- start start 2022-04-28T14:39:52.046 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.038 7f06999e0700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f06940f1b40 0x7f06941b9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:52.046 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.038 7f06999e0700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f06941ba040 0x7f06941bc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:52.046 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.038 7f06999e0700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06940ab2b0 con 0x7f06940f6300 2022-04-28T14:39:52.047 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.038 7f06999e0700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f069410ecb0 con 0x7f06941ba040 2022-04-28T14:39:52.047 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.038 7f06999e0700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f069410f240 con 0x7f06940f1b40 2022-04-28T14:39:52.047 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.038 7f0691fd7700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f06940f1b40 0x7f06941b9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:52.047 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.039 7f0691fd7700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f06940f1b40 0x7f06941b9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46774/0 (socket says 172.21.15.22:46774) 2022-04-28T14:39:52.048 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.039 7f0691fd7700 1 -- 172.21.15.22:0/2438053217 learned_addr learned my addr 172.21.15.22:0/2438053217 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:52.048 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.039 7f0692fd9700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f06941ba040 0x7f06941bc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:52.048 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.039 7f0692fd9700 1 -- 172.21.15.22:0/2438053217 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f06940f1b40 msgr2=0x7f06941b9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:52.048 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.039 7f0692fd9700 1 --2- 172.21.15.22:0/2438053217 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f06940f1b40 0x7f06941b9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:52.048 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.039 7f0692fd9700 1 -- 172.21.15.22:0/2438053217 >> v1:172.21.15.22:6789/0 conn(0x7f06940f6300 legacy=0x7f06940f1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:52.049 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.039 7f06917d6700 1 -- 172.21.15.22:0/2438053217 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357356133 0 0) 0x7f0684001110 con 0x7f06940f6300 2022-04-28T14:39:52.049 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.039 7f0692fd9700 1 -- 172.21.15.22:0/2438053217 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06941161d0 con 0x7f06941ba040 2022-04-28T14:39:52.049 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.039 7f0691fd7700 1 --2- 172.21.15.22:0/2438053217 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f06940f1b40 0x7f06941b9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:52.049 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.039 7f0692fd9700 1 --2- 172.21.15.22:0/2438053217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06941ba040 0x7f06941bc4a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f069410f3f0 tx=0x7f068c009d40).ready entity=mon.0 client_cookie=d99e9b1a113a933a server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:52.049 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.039 7f06917d6700 1 -- 172.21.15.22:0/2438053217 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f06941161d0 con 0x7f06941ba040 2022-04-28T14:39:52.049 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.039 7f06917d6700 1 -- 172.21.15.22:0/2438053217 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068c00b7c0 con 0x7f06941ba040 2022-04-28T14:39:52.050 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.039 7f06917d6700 1 -- 172.21.15.22:0/2438053217 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f068c00b9f0 con 0x7f06941ba040 2022-04-28T14:39:52.050 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.039 7f06999e0700 1 -- 172.21.15.22:0/2438053217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06941ba040 msgr2=0x7f06941bc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:52.050 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.039 7f06999e0700 1 --2- 172.21.15.22:0/2438053217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06941ba040 0x7f06941bc4a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f069410f3f0 tx=0x7f068c009d40).stop 2022-04-28T14:39:52.050 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.040 7f06999e0700 1 -- 172.21.15.22:0/2438053217 shutdown_connections 2022-04-28T14:39:52.050 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.040 7f06999e0700 1 --2- 172.21.15.22:0/2438053217 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06941ba040 0x7f06941bc4a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:52.051 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.040 7f06999e0700 1 --2- 172.21.15.22:0/2438053217 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f06940f1b40 0x7f06941b9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:52.051 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.040 7f06999e0700 1 -- 172.21.15.22:0/2438053217 >> 172.21.15.22:0/2438053217 conn(0x7f06941171f0 msgr2=0x7f06940f2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:52.051 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.040 7f06999e0700 1 -- 172.21.15.22:0/2438053217 shutdown_connections 2022-04-28T14:39:52.051 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.040 7f06999e0700 1 -- 172.21.15.22:0/2438053217 wait complete. 2022-04-28T14:39:52.068 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.064 7f06999e0700 1 Processor -- start 2022-04-28T14:39:52.068 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.064 7f06999e0700 1 -- start start 2022-04-28T14:39:52.071 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.064 7f06999e0700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f06940b83b0 0x7f06941c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:52.071 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.064 7f06999e0700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f06940b8800 0x7f06941c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:52.071 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.064 7f06999e0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06940b9290 0x7f06940b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:52.071 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.064 7f06999e0700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06940b7bd0 con 0x7f06940b9290 2022-04-28T14:39:52.071 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.064 7f06999e0700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06940b7f10 con 0x7f06940b8800 2022-04-28T14:39:52.071 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.064 7f06999e0700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06940b78f0 con 0x7f06940b83b0 2022-04-28T14:39:52.071 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.064 7f0691fd7700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f06940b8800 0x7f06941c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:52.071 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.064 7f0692fd9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06940b9290 0x7f06940b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:52.072 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.064 7f06927d8700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f06940b83b0 0x7f06941c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:52.072 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.064 7f0692fd9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06940b9290 0x7f06940b96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49430/0 (socket says 172.21.15.22:49430) 2022-04-28T14:39:52.072 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.064 7f06927d8700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f06940b83b0 0x7f06941c5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46778/0 (socket says 172.21.15.22:46778) 2022-04-28T14:39:52.072 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.064 7f0691fd7700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f06940b8800 0x7f06941c5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:46996/0 (socket says 172.21.15.22:46996) 2022-04-28T14:39:52.072 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.064 7f0692fd9700 1 -- 172.21.15.22:0/2107643009 learned_addr learned my addr 172.21.15.22:0/2107643009 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:52.072 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.065 7f0692fd9700 1 -- 172.21.15.22:0/2107643009 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f06940b83b0 msgr2=0x7f06941c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:52.072 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.065 7f0692fd9700 1 --2- 172.21.15.22:0/2107643009 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f06940b83b0 0x7f06941c5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:52.072 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.065 7f0692fd9700 1 -- 172.21.15.22:0/2107643009 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f06940b8800 msgr2=0x7f06941c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:52.072 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.065 7f0692fd9700 1 --2- 172.21.15.22:0/2107643009 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f06940b8800 0x7f06941c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:52.073 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.065 7f0692fd9700 1 -- 172.21.15.22:0/2107643009 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06940cf8d0 con 0x7f06940b9290 2022-04-28T14:39:52.073 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.065 7f06927d8700 1 --2- 172.21.15.22:0/2107643009 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f06940b83b0 0x7f06941c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:52.073 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.065 7f0692fd9700 1 --2- 172.21.15.22:0/2107643009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06940b9290 0x7f06940b96e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f068c006fc0 tx=0x7f068c006c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:52.073 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.065 7f068b7fe700 1 -- 172.21.15.22:0/2107643009 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f06940cf8d0 con 0x7f06940b9290 2022-04-28T14:39:52.073 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.065 7f068b7fe700 1 -- 172.21.15.22:0/2107643009 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068c0119c0 con 0x7f06940b9290 2022-04-28T14:39:52.073 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.065 7f06999e0700 1 -- 172.21.15.22:0/2107643009 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06941c65f0 con 0x7f06940b9290 2022-04-28T14:39:52.074 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.065 7f068b7fe700 1 -- 172.21.15.22:0/2107643009 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f068c017040 con 0x7f06940b9290 2022-04-28T14:39:52.074 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.065 7f06999e0700 1 -- 172.21.15.22:0/2107643009 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06940b9ef0 con 0x7f06940b9290 2022-04-28T14:39:52.074 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.066 7f068b7fe700 1 -- 172.21.15.22:0/2107643009 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f068c01c470 con 0x7f06940b9290 2022-04-28T14:39:52.074 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.066 7f068b7fe700 1 -- 172.21.15.22:0/2107643009 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f068c018030 con 0x7f06940b9290 2022-04-28T14:39:52.074 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.066 7f06999e0700 1 -- 172.21.15.22:0/2107643009 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06940f0390 con 0x7f06940b9290 2022-04-28T14:39:52.074 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.070 7f068b7fe700 1 -- 172.21.15.22:0/2107643009 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f068c0117b0 con 0x7f06940b9290 2022-04-28T14:39:52.195 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.191 7f06999e0700 1 -- 172.21.15.22:0/2107643009 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06940a5b80 con 0x7f06940b9290 2022-04-28T14:39:52.196 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.191 7f068b7fe700 1 -- 172.21.15.22:0/2107643009 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2267 (secure 0 0 0) 0x7f068c00b5b0 con 0x7f06940b9290 2022-04-28T14:39:52.196 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:52.196 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.22:6818/2291514211","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6818","nonce":2291514211}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-04-28 14:39:13.928436","modified":"2022-04-28 14:39:39.000957","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4184,"mds_1":4198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4184":{"gid":4184,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6819/356491488","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6819","nonce":356491488}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4198":{"gid":4198,"name":"b","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.22:6817/401565232","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6817","nonce":401565232}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-04-28T14:39:52.198 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.192 7f06999e0700 1 -- 172.21.15.22:0/2107643009 >> v1:172.21.15.22:6808/86956 conn(0x7f067801c1b0 legacy=0x7f067801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:52.198 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.192 7f06999e0700 1 -- 172.21.15.22:0/2107643009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06940b9290 msgr2=0x7f06940b96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:52.198 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.192 7f06999e0700 1 --2- 172.21.15.22:0/2107643009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06940b9290 0x7f06940b96e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f068c006fc0 tx=0x7f068c006c40).stop 2022-04-28T14:39:52.198 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.192 7f06999e0700 1 -- 172.21.15.22:0/2107643009 shutdown_connections 2022-04-28T14:39:52.198 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.192 7f06999e0700 1 --2- 172.21.15.22:0/2107643009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06940b9290 0x7f06940b96e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:52.198 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.192 7f06999e0700 1 --2- 172.21.15.22:0/2107643009 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f06940b83b0 0x7f06941c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:52.198 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.192 7f06999e0700 1 --2- 172.21.15.22:0/2107643009 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f06940b8800 0x7f06941c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:52.198 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.192 7f06999e0700 1 -- 172.21.15.22:0/2107643009 >> 172.21.15.22:0/2107643009 conn(0x7f0694125230 msgr2=0x7f06940bb240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:52.199 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.192 7f06999e0700 1 -- 172.21.15.22:0/2107643009 shutdown_connections 2022-04-28T14:39:52.199 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:52.192 7f06999e0700 1 -- 172.21.15.22:0/2107643009 wait complete. 2022-04-28T14:39:52.199 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 12 2022-04-28T14:39:52.510 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-04-28 14:39:13.928436', 'modified': '2022-04-28 14:39:39.000957', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4184, 'mds_1': 4198}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4184': {'gid': 4184, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6819/356491488', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6819', 'nonce': 356491488}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4198': {'gid': 4198, 'name': 'b', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.22:6817/401565232', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6817', 'nonce': 401565232}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-04-28T14:39:52.510 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4198:up:stopping 2022-04-28T14:39:53.511 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-04-28T14:39:53.657 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.651 7f6bb635a700 1 Processor -- start 2022-04-28T14:39:53.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.652 7f6bb635a700 1 -- start start 2022-04-28T14:39:53.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.652 7f6bb635a700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6bb00f6390 0x7f6bb00fe970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:53.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.652 7f6bb635a700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6bb00fefa0 0x7f6bb01b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:53.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.652 7f6bb635a700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb00ab0b0 con 0x7f6bb00ff3f0 2022-04-28T14:39:53.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.652 7f6bb635a700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb01b2290 con 0x7f6bb00fefa0 2022-04-28T14:39:53.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.652 7f6bb635a700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb0115dd0 con 0x7f6bb00f6390 2022-04-28T14:39:53.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.652 7f6bae885700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6bb00fefa0 0x7f6bb01b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:53.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.652 7f6baf086700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6bb00f6390 0x7f6bb00fe970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:53.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.652 7f6bae885700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6bb00fefa0 0x7f6bb01b1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:47004/0 (socket says 172.21.15.22:47004) 2022-04-28T14:39:53.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.652 7f6bae885700 1 -- 172.21.15.22:0/530801283 learned_addr learned my addr 172.21.15.22:0/530801283 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:53.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.652 7f6baf086700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6bb00f6390 0x7f6bb00fe970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46786/0 (socket says 172.21.15.22:46786) 2022-04-28T14:39:53.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.652 7f6bae885700 1 -- 172.21.15.22:0/530801283 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6bb00f6390 msgr2=0x7f6bb00fe970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:53.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.652 7f6bae885700 1 --2- 172.21.15.22:0/530801283 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6bb00f6390 0x7f6bb00fe970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:53.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.652 7f6bae885700 1 -- 172.21.15.22:0/530801283 >> v1:172.21.15.22:6789/0 conn(0x7f6bb00ff3f0 legacy=0x7f6bb01b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:53.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.652 7f6bae084700 1 -- 172.21.15.22:0/530801283 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755916822 0 0) 0x7f6ba8001490 con 0x7f6bb00ff3f0 2022-04-28T14:39:53.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.653 7f6bae885700 1 -- 172.21.15.22:0/530801283 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb010b7d0 con 0x7f6bb00fefa0 2022-04-28T14:39:53.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.653 7f6baf086700 1 --2- 172.21.15.22:0/530801283 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6bb00f6390 0x7f6bb00fe970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:53.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.653 7f6bae885700 1 --2- 172.21.15.22:0/530801283 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6bb00fefa0 0x7f6bb01b1460 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f6ba4002f70 tx=0x7f6ba400bcb0).ready entity=mon.1 client_cookie=ca1f754c86216d6e server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:53.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.653 7f6bae084700 1 -- 172.21.15.22:0/530801283 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6bb010b7d0 con 0x7f6bb00fefa0 2022-04-28T14:39:53.660 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.653 7f6bae084700 1 -- 172.21.15.22:0/530801283 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba400dc00 con 0x7f6bb00fefa0 2022-04-28T14:39:53.660 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.653 7f6bae084700 1 -- 172.21.15.22:0/530801283 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6ba4010470 con 0x7f6bb00fefa0 2022-04-28T14:39:53.660 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.653 7f6bb635a700 1 -- 172.21.15.22:0/530801283 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6bb00fefa0 msgr2=0x7f6bb01b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:53.660 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.653 7f6bb635a700 1 --2- 172.21.15.22:0/530801283 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6bb00fefa0 0x7f6bb01b1460 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f6ba4002f70 tx=0x7f6ba400bcb0).stop 2022-04-28T14:39:53.660 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.653 7f6bb635a700 1 -- 172.21.15.22:0/530801283 shutdown_connections 2022-04-28T14:39:53.660 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.653 7f6bb635a700 1 --2- 172.21.15.22:0/530801283 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6bb00f6390 0x7f6bb00fe970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:53.660 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.653 7f6bb635a700 1 --2- 172.21.15.22:0/530801283 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6bb00fefa0 0x7f6bb01b1460 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:53.660 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.653 7f6bb635a700 1 -- 172.21.15.22:0/530801283 >> 172.21.15.22:0/530801283 conn(0x7f6bb0117120 msgr2=0x7f6bb00f2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:53.660 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.653 7f6bb635a700 1 -- 172.21.15.22:0/530801283 shutdown_connections 2022-04-28T14:39:53.660 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.653 7f6bb635a700 1 -- 172.21.15.22:0/530801283 wait complete. 2022-04-28T14:39:53.681 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.677 7f6bb635a700 1 Processor -- start 2022-04-28T14:39:53.681 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.678 7f6bb635a700 1 -- start start 2022-04-28T14:39:53.683 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.678 7f6bb635a700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6bb00b9970 0x7f6bb00b8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:53.684 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.678 7f6bb635a700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6bb00d3420 0x7f6bb00d43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:53.684 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.678 7f6bb635a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bb00d4a10 0x7f6bb01c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:53.684 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.678 7f6bb635a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb00b82b0 con 0x7f6bb00d4a10 2022-04-28T14:39:53.684 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.678 7f6bb635a700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb00d3ff0 con 0x7f6bb00d3420 2022-04-28T14:39:53.684 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.678 7f6bb635a700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb00d39b0 con 0x7f6bb00b9970 2022-04-28T14:39:53.684 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.678 7f6baf086700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6bb00b9970 0x7f6bb00b8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:53.684 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.678 7f6baf887700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bb00d4a10 0x7f6bb01c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:53.684 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.678 7f6baf086700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6bb00b9970 0x7f6bb00b8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46792/0 (socket says 172.21.15.22:46792) 2022-04-28T14:39:53.684 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.678 7f6baf086700 1 -- 172.21.15.22:0/3569770916 learned_addr learned my addr 172.21.15.22:0/3569770916 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:53.685 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.678 7f6bae885700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6bb00d3420 0x7f6bb00d43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:53.685 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.678 7f6baf887700 1 -- 172.21.15.22:0/3569770916 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6bb00b9970 msgr2=0x7f6bb00b8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:53.685 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.678 7f6baf887700 1 --2- 172.21.15.22:0/3569770916 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6bb00b9970 0x7f6bb00b8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:53.685 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.678 7f6baf887700 1 -- 172.21.15.22:0/3569770916 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6bb00d3420 msgr2=0x7f6bb00d43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:53.685 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.678 7f6baf887700 1 --2- 172.21.15.22:0/3569770916 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6bb00d3420 0x7f6bb00d43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:53.685 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.678 7f6baf887700 1 -- 172.21.15.22:0/3569770916 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb00b9410 con 0x7f6bb00d4a10 2022-04-28T14:39:53.685 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.678 7f6baf086700 1 --2- 172.21.15.22:0/3569770916 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6bb00b9970 0x7f6bb00b8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:53.685 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.678 7f6bae885700 1 --2- 172.21.15.22:0/3569770916 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6bb00d3420 0x7f6bb00d43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:53.685 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.679 7f6baf887700 1 --2- 172.21.15.22:0/3569770916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bb00d4a10 0x7f6bb01c57b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f6bb00d6a80 tx=0x7f6ba800c960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:53.686 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.679 7f6bac881700 1 -- 172.21.15.22:0/3569770916 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6bb00b9410 con 0x7f6bb00d4a10 2022-04-28T14:39:53.686 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.679 7f6bac881700 1 -- 172.21.15.22:0/3569770916 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba8006ab0 con 0x7f6bb00d4a10 2022-04-28T14:39:53.686 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.679 7f6bb635a700 1 -- 172.21.15.22:0/3569770916 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb00d4e60 con 0x7f6bb00d4a10 2022-04-28T14:39:53.686 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.679 7f6bac881700 1 -- 172.21.15.22:0/3569770916 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f6ba8007030 con 0x7f6bb00d4a10 2022-04-28T14:39:53.686 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.679 7f6bb635a700 1 -- 172.21.15.22:0/3569770916 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb01c5de0 con 0x7f6bb00d4a10 2022-04-28T14:39:53.686 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.679 7f6bac881700 1 -- 172.21.15.22:0/3569770916 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f6ba801a020 con 0x7f6bb00d4a10 2022-04-28T14:39:53.686 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.679 7f6bac881700 1 -- 172.21.15.22:0/3569770916 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f6ba8029960 con 0x7f6bb00d4a10 2022-04-28T14:39:53.686 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.680 7f6bb635a700 1 -- 172.21.15.22:0/3569770916 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb00f02c0 con 0x7f6bb00d4a10 2022-04-28T14:39:53.687 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.683 7f6bac881700 1 -- 172.21.15.22:0/3569770916 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f6ba80068a0 con 0x7f6bb00d4a10 2022-04-28T14:39:53.807 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.804 7f6bb635a700 1 -- 172.21.15.22:0/3569770916 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6bb00a5b80 con 0x7f6bb00d4a10 2022-04-28T14:39:53.808 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.804 7f6bac881700 1 -- 172.21.15.22:0/3569770916 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2267 (secure 0 0 0) 0x7f6bb00ffa00 con 0x7f6bb00d4a10 2022-04-28T14:39:53.808 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:53.808 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.22:6818/2291514211","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6818","nonce":2291514211}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-04-28 14:39:13.928436","modified":"2022-04-28 14:39:39.000957","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4184,"mds_1":4198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4184":{"gid":4184,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6819/356491488","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6819","nonce":356491488}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4198":{"gid":4198,"name":"b","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.22:6817/401565232","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6817","nonce":401565232}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-04-28T14:39:53.809 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.805 7f6bb635a700 1 -- 172.21.15.22:0/3569770916 >> v1:172.21.15.22:6808/86956 conn(0x7f6b9001c1b0 legacy=0x7f6b9001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:53.809 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.805 7f6bb635a700 1 -- 172.21.15.22:0/3569770916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bb00d4a10 msgr2=0x7f6bb01c57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:53.810 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.805 7f6bb635a700 1 --2- 172.21.15.22:0/3569770916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bb00d4a10 0x7f6bb01c57b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f6bb00d6a80 tx=0x7f6ba800c960).stop 2022-04-28T14:39:53.810 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.805 7f6bb635a700 1 -- 172.21.15.22:0/3569770916 shutdown_connections 2022-04-28T14:39:53.810 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.805 7f6bb635a700 1 --2- 172.21.15.22:0/3569770916 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6bb00d4a10 0x7f6bb01c57b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:53.810 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.805 7f6bb635a700 1 --2- 172.21.15.22:0/3569770916 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6bb00b9970 0x7f6bb00b8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:53.810 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.805 7f6bb635a700 1 --2- 172.21.15.22:0/3569770916 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6bb00d3420 0x7f6bb00d43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:53.810 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.805 7f6bb635a700 1 -- 172.21.15.22:0/3569770916 >> 172.21.15.22:0/3569770916 conn(0x7f6bb00af7d0 msgr2=0x7f6bb00b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:53.810 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.805 7f6bb635a700 1 -- 172.21.15.22:0/3569770916 shutdown_connections 2022-04-28T14:39:53.810 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:53.805 7f6bb635a700 1 -- 172.21.15.22:0/3569770916 wait complete. 2022-04-28T14:39:53.811 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 12 2022-04-28T14:39:54.121 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-04-28 14:39:13.928436', 'modified': '2022-04-28 14:39:39.000957', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4184, 'mds_1': 4198}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4184': {'gid': 4184, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6819/356491488', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6819', 'nonce': 356491488}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4198': {'gid': 4198, 'name': 'b', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.22:6817/401565232', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6817', 'nonce': 401565232}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-04-28T14:39:54.122 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4198:up:stopping 2022-04-28T14:39:55.122 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-04-28T14:39:55.265 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.261 7f512d9bb700 1 Processor -- start 2022-04-28T14:39:55.265 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.261 7f512d9bb700 1 -- start start 2022-04-28T14:39:55.268 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.262 7f512d9bb700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f51280f6210 0x7f51280f1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:55.269 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.262 7f512d9bb700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f51280f18a0 0x7f51281b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:55.269 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.262 7f512d9bb700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f51280f1cf0 0x7f51281b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:55.269 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.262 7f512d9bb700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f512810ebe0 con 0x7f51280f18a0 2022-04-28T14:39:55.269 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.262 7f512d9bb700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5128116e40 con 0x7f51280f1cf0 2022-04-28T14:39:55.269 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.262 7f512d9bb700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51280f6660 con 0x7f51280f6210 2022-04-28T14:39:55.269 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.262 7f5125dc4700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f51280f18a0 0x7f51281b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:55.269 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.262 7f5126dc6700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f51280f1cf0 0x7f51281b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:55.269 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.262 7f51265c5700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f51280f6210 0x7f51280f1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:55.269 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.262 7f5125dc4700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f51280f18a0 0x7f51281b45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49448/0 (socket says 172.21.15.22:49448) 2022-04-28T14:39:55.269 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.262 7f5125dc4700 1 -- 172.21.15.22:0/3868772895 learned_addr learned my addr 172.21.15.22:0/3868772895 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:55.270 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.262 7f5126dc6700 1 --2- 172.21.15.22:0/3868772895 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f51280f1cf0 0x7f51281b4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:47020/0 (socket says 172.21.15.22:47020) 2022-04-28T14:39:55.270 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.262 7f5125dc4700 1 -- 172.21.15.22:0/3868772895 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f51280f6210 msgr2=0x7f51280f1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:55.270 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.262 7f5125dc4700 1 --2- 172.21.15.22:0/3868772895 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f51280f6210 0x7f51280f1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:55.270 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.262 7f5125dc4700 1 -- 172.21.15.22:0/3868772895 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f51280f1cf0 msgr2=0x7f51281b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:55.270 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.262 7f5125dc4700 1 --2- 172.21.15.22:0/3868772895 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f51280f1cf0 0x7f51281b4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:55.270 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.262 7f5125dc4700 1 -- 172.21.15.22:0/3868772895 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51281b5250 con 0x7f51280f18a0 2022-04-28T14:39:55.270 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.263 7f5126dc6700 1 --2- 172.21.15.22:0/3868772895 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f51280f1cf0 0x7f51281b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:55.270 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.263 7f51265c5700 1 --2- 172.21.15.22:0/3868772895 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f51280f6210 0x7f51280f1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:55.270 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.263 7f5125dc4700 1 --2- 172.21.15.22:0/3868772895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51280f18a0 0x7f51281b45f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f5118002f70 tx=0x7f5118009a50).ready entity=mon.0 client_cookie=7e0bfbec916324c server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:55.271 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.263 7f51255c3700 1 -- 172.21.15.22:0/3868772895 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f51281b5250 con 0x7f51280f18a0 2022-04-28T14:39:55.271 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.263 7f51255c3700 1 -- 172.21.15.22:0/3868772895 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511800f510 con 0x7f51280f18a0 2022-04-28T14:39:55.271 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.263 7f51255c3700 1 -- 172.21.15.22:0/3868772895 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f511800f6f0 con 0x7f51280f18a0 2022-04-28T14:39:55.271 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.263 7f512d9bb700 1 -- 172.21.15.22:0/3868772895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51280f18a0 msgr2=0x7f51281b45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:55.271 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.263 7f512d9bb700 1 --2- 172.21.15.22:0/3868772895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51280f18a0 0x7f51281b45f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f5118002f70 tx=0x7f5118009a50).stop 2022-04-28T14:39:55.271 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.264 7f512d9bb700 1 -- 172.21.15.22:0/3868772895 shutdown_connections 2022-04-28T14:39:55.271 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.264 7f512d9bb700 1 --2- 172.21.15.22:0/3868772895 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f51280f1cf0 0x7f51281b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:55.271 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.264 7f512d9bb700 1 --2- 172.21.15.22:0/3868772895 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f51280f6210 0x7f51280f1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:55.271 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.264 7f512d9bb700 1 --2- 172.21.15.22:0/3868772895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51280f18a0 0x7f51281b45f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:55.272 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.264 7f512d9bb700 1 -- 172.21.15.22:0/3868772895 >> 172.21.15.22:0/3868772895 conn(0x7f5128117120 msgr2=0x7f51280f2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:55.272 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.264 7f512d9bb700 1 -- 172.21.15.22:0/3868772895 shutdown_connections 2022-04-28T14:39:55.272 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.264 7f512d9bb700 1 -- 172.21.15.22:0/3868772895 wait complete. 2022-04-28T14:39:55.291 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.288 7f512d9bb700 1 Processor -- start 2022-04-28T14:39:55.291 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.288 7f512d9bb700 1 -- start start 2022-04-28T14:39:55.294 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.288 7f512d9bb700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f51280b5ff0 0x7f51280d1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:55.294 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.288 7f512d9bb700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f51280b6440 0x7f51281c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:55.294 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.288 7f512d9bb700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51280d1730 0x7f51281c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:55.294 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.288 7f512d9bb700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5128116ba0 con 0x7f51280d1730 2022-04-28T14:39:55.295 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.288 7f512d9bb700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51280b5b50 con 0x7f51280b6440 2022-04-28T14:39:55.295 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.288 7f512d9bb700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51280b5810 con 0x7f51280b5ff0 2022-04-28T14:39:55.295 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.288 7f51265c5700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f51280b5ff0 0x7f51280d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:55.295 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.288 7f5126dc6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51280d1730 0x7f51281c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:55.295 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.288 7f51265c5700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f51280b5ff0 0x7f51280d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46806/0 (socket says 172.21.15.22:46806) 2022-04-28T14:39:55.295 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.288 7f51265c5700 1 -- 172.21.15.22:0/1629129613 learned_addr learned my addr 172.21.15.22:0/1629129613 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:55.295 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.288 7f5125dc4700 1 --2- 172.21.15.22:0/1629129613 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f51280b6440 0x7f51281c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:55.295 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.289 7f51265c5700 1 -- 172.21.15.22:0/1629129613 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f51280b6440 msgr2=0x7f51281c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:55.295 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.289 7f51265c5700 1 --2- 172.21.15.22:0/1629129613 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f51280b6440 0x7f51281c52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:55.295 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.289 7f51265c5700 1 -- 172.21.15.22:0/1629129613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51280d1730 msgr2=0x7f51281c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:55.295 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.289 7f51265c5700 1 --2- 172.21.15.22:0/1629129613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51280d1730 0x7f51281c58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:55.296 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.289 7f51265c5700 1 -- 172.21.15.22:0/1629129613 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51280b6970 con 0x7f51280b5ff0 2022-04-28T14:39:55.296 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.289 7f5125dc4700 1 --2- 172.21.15.22:0/1629129613 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f51280b6440 0x7f51281c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:55.296 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.289 7f5126dc6700 1 --2- 172.21.15.22:0/1629129613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51280d1730 0x7f51281c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:55.296 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.289 7f51265c5700 1 --2- 172.21.15.22:0/1629129613 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f51280b5ff0 0x7f51280d1100 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f51280d3a50 tx=0x7f511c00ec20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:55.296 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.289 7f51177fe700 1 -- 172.21.15.22:0/1629129613 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f51280b6970 con 0x7f51280b5ff0 2022-04-28T14:39:55.296 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.289 7f51177fe700 1 -- 172.21.15.22:0/1629129613 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511c00c810 con 0x7f51280b5ff0 2022-04-28T14:39:55.296 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.289 7f51177fe700 1 -- 172.21.15.22:0/1629129613 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f511c00f040 con 0x7f51280b5ff0 2022-04-28T14:39:55.296 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.289 7f512d9bb700 1 -- 172.21.15.22:0/1629129613 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51281b8630 con 0x7f51280b5ff0 2022-04-28T14:39:55.296 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.289 7f512d9bb700 1 -- 172.21.15.22:0/1629129613 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51280b6ed0 con 0x7f51280b5ff0 2022-04-28T14:39:55.296 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.290 7f51177fe700 1 -- 172.21.15.22:0/1629129613 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f511c011070 con 0x7f51280b5ff0 2022-04-28T14:39:55.297 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.290 7f51177fe700 1 -- 172.21.15.22:0/1629129613 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f511c010040 con 0x7f51280b5ff0 2022-04-28T14:39:55.297 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.290 7f512d9bb700 1 -- 172.21.15.22:0/1629129613 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51280f02c0 con 0x7f51280b5ff0 2022-04-28T14:39:55.297 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.293 7f51177fe700 1 -- 172.21.15.22:0/1629129613 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f511c00ee30 con 0x7f51280b5ff0 2022-04-28T14:39:55.417 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.413 7f512d9bb700 1 -- 172.21.15.22:0/1629129613 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51280a5b80 con 0x7f51280b5ff0 2022-04-28T14:39:55.417 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.413 7f51177fe700 1 -- 172.21.15.22:0/1629129613 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2267 (secure 0 0 0) 0x7f511c000c30 con 0x7f51280b5ff0 2022-04-28T14:39:55.417 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:55.417 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.22:6818/2291514211","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6818","nonce":2291514211}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-04-28 14:39:13.928436","modified":"2022-04-28 14:39:39.000957","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4184,"mds_1":4198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4184":{"gid":4184,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6819/356491488","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6819","nonce":356491488}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4198":{"gid":4198,"name":"b","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.22:6817/401565232","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6817","nonce":401565232}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-04-28T14:39:55.418 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.414 7f512d9bb700 1 -- 172.21.15.22:0/1629129613 >> v1:172.21.15.22:6808/86956 conn(0x7f510401c1b0 legacy=0x7f510401e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:55.419 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.414 7f512d9bb700 1 -- 172.21.15.22:0/1629129613 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f51280b5ff0 msgr2=0x7f51280d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:55.419 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.414 7f512d9bb700 1 --2- 172.21.15.22:0/1629129613 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f51280b5ff0 0x7f51280d1100 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f51280d3a50 tx=0x7f511c00ec20).stop 2022-04-28T14:39:55.419 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.414 7f512d9bb700 1 -- 172.21.15.22:0/1629129613 shutdown_connections 2022-04-28T14:39:55.419 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.414 7f512d9bb700 1 --2- 172.21.15.22:0/1629129613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51280d1730 0x7f51281c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:55.419 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.414 7f512d9bb700 1 --2- 172.21.15.22:0/1629129613 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f51280b5ff0 0x7f51280d1100 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:55.419 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.414 7f512d9bb700 1 --2- 172.21.15.22:0/1629129613 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f51280b6440 0x7f51281c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:55.419 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.414 7f512d9bb700 1 -- 172.21.15.22:0/1629129613 >> 172.21.15.22:0/1629129613 conn(0x7f51280e0b10 msgr2=0x7f51280ad390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:55.419 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.414 7f512d9bb700 1 -- 172.21.15.22:0/1629129613 shutdown_connections 2022-04-28T14:39:55.420 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:55.414 7f512d9bb700 1 -- 172.21.15.22:0/1629129613 wait complete. 2022-04-28T14:39:55.420 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 12 2022-04-28T14:39:55.731 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-04-28 14:39:13.928436', 'modified': '2022-04-28 14:39:39.000957', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4184, 'mds_1': 4198}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4184': {'gid': 4184, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6819/356491488', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6819', 'nonce': 356491488}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4198': {'gid': 4198, 'name': 'b', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.22:6817/401565232', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6817', 'nonce': 401565232}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-04-28T14:39:55.732 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4198:up:stopping 2022-04-28T14:39:56.733 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-04-28T14:39:56.876 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.872 7f2481da1700 1 Processor -- start 2022-04-28T14:39:56.876 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.872 7f2481da1700 1 -- start start 2022-04-28T14:39:56.878 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.873 7f2481da1700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f247c0f1a70 0x7f247c1b9940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:56.878 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.873 7f2481da1700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f247c1b9f70 0x7f247c1bc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:56.878 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.873 7f2481da1700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f247c0ab0b0 con 0x7f247c0f6210 2022-04-28T14:39:56.879 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.873 7f2481da1700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247c10ebe0 con 0x7f247c0f1a70 2022-04-28T14:39:56.879 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.873 7f2481da1700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f247c116e40 con 0x7f247c1b9f70 2022-04-28T14:39:56.879 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.873 7f247a2b1700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f247c0f1a70 0x7f247c1b9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:56.879 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.873 7f247b2b3700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f247c1b9f70 0x7f247c1bc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:56.879 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.873 7f247aab2700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f247c0f6210 0x7f247c0f1270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38858/0 (socket says 172.21.15.22:38858) 2022-04-28T14:39:56.879 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.873 7f247a2b1700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f247c0f1a70 0x7f247c1b9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:47032/0 (socket says 172.21.15.22:47032) 2022-04-28T14:39:56.879 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.873 7f247b2b3700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f247c1b9f70 0x7f247c1bc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46818/0 (socket says 172.21.15.22:46818) 2022-04-28T14:39:56.879 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.873 7f247aab2700 1 -- 172.21.15.22:0/1640680411 learned_addr learned my addr 172.21.15.22:0/1640680411 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:39:56.879 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.873 7f247a2b1700 1 -- 172.21.15.22:0/1640680411 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f247c1b9f70 msgr2=0x7f247c1bc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:56.879 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.873 7f247a2b1700 1 --2- 172.21.15.22:0/1640680411 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f247c1b9f70 0x7f247c1bc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.873 7f247a2b1700 1 -- 172.21.15.22:0/1640680411 >> v1:172.21.15.22:6789/0 conn(0x7f247c0f6210 legacy=0x7f247c0f1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.873 7f2479ab0700 1 -- 172.21.15.22:0/1640680411 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3514229789 0 0) 0x7f246c001110 con 0x7f247c0f6210 2022-04-28T14:39:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.873 7f247a2b1700 1 -- 172.21.15.22:0/1640680411 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247c0f6660 con 0x7f247c0f1a70 2022-04-28T14:39:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.874 7f247a2b1700 1 --2- 172.21.15.22:0/1640680411 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f247c0f1a70 0x7f247c1b9940 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f2470002f70 tx=0x7f247000ba20).ready entity=mon.1 client_cookie=95c3db4d83d87211 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.874 7f2479ab0700 1 -- 172.21.15.22:0/1640680411 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f247c0f6660 con 0x7f247c0f1a70 2022-04-28T14:39:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.874 7f2479ab0700 1 -- 172.21.15.22:0/1640680411 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247000d570 con 0x7f247c0f1a70 2022-04-28T14:39:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.874 7f2479ab0700 1 -- 172.21.15.22:0/1640680411 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f247000d940 con 0x7f247c0f1a70 2022-04-28T14:39:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.874 7f2481da1700 1 -- 172.21.15.22:0/1640680411 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f247c0f1a70 msgr2=0x7f247c1b9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:56.880 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.874 7f2481da1700 1 --2- 172.21.15.22:0/1640680411 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f247c0f1a70 0x7f247c1b9940 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f2470002f70 tx=0x7f247000ba20).stop 2022-04-28T14:39:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.874 7f2481da1700 1 -- 172.21.15.22:0/1640680411 shutdown_connections 2022-04-28T14:39:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.874 7f2481da1700 1 --2- 172.21.15.22:0/1640680411 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f247c1b9f70 0x7f247c1bc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.874 7f2481da1700 1 --2- 172.21.15.22:0/1640680411 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f247c0f1a70 0x7f247c1b9940 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.874 7f2481da1700 1 -- 172.21.15.22:0/1640680411 >> 172.21.15.22:0/1640680411 conn(0x7f247c117120 msgr2=0x7f247c0f2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.875 7f2481da1700 1 -- 172.21.15.22:0/1640680411 shutdown_connections 2022-04-28T14:39:56.881 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.875 7f2481da1700 1 -- 172.21.15.22:0/1640680411 wait complete. 2022-04-28T14:39:56.902 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.899 7f2481da1700 1 Processor -- start 2022-04-28T14:39:56.902 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.899 7f2481da1700 1 -- start start 2022-04-28T14:39:56.904 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.899 7f2481da1700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f247c0b73a0 0x7f247c0d1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:56.904 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.899 7f2481da1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f247c0d2380 0x7f247c1c5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:56.905 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.899 7f2481da1700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f247c0d27d0 0x7f247c1c5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:56.905 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.899 7f2481da1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247c0f3060 con 0x7f247c0d2380 2022-04-28T14:39:56.905 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.899 7f2481da1700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247c0b6980 con 0x7f247c0b73a0 2022-04-28T14:39:56.905 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.899 7f2481da1700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f247c1b81e0 con 0x7f247c0d27d0 2022-04-28T14:39:56.905 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.899 7f247aab2700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f247c0b73a0 0x7f247c0d1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:56.905 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.899 7f247a2b1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f247c0d2380 0x7f247c1c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:56.905 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.899 7f247b2b3700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f247c0d27d0 0x7f247c1c5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:56.905 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.899 7f247aab2700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f247c0b73a0 0x7f247c0d1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:47036/0 (socket says 172.21.15.22:47036) 2022-04-28T14:39:56.905 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.899 7f247a2b1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f247c0d2380 0x7f247c1c5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49470/0 (socket says 172.21.15.22:49470) 2022-04-28T14:39:56.905 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.899 7f247aab2700 1 -- 172.21.15.22:0/395765705 learned_addr learned my addr 172.21.15.22:0/395765705 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:56.906 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.899 7f247b2b3700 1 -- 172.21.15.22:0/395765705 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f247c0b73a0 msgr2=0x7f247c0d1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:56.906 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.899 7f247b2b3700 1 --2- 172.21.15.22:0/395765705 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f247c0b73a0 0x7f247c0d1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:56.906 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.899 7f247b2b3700 1 -- 172.21.15.22:0/395765705 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f247c0d2380 msgr2=0x7f247c1c5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:56.906 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.899 7f247b2b3700 1 --2- 172.21.15.22:0/395765705 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f247c0d2380 0x7f247c1c5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:56.906 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.900 7f247b2b3700 1 -- 172.21.15.22:0/395765705 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247c1b85a0 con 0x7f247c0d27d0 2022-04-28T14:39:56.906 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.900 7f247aab2700 1 --2- 172.21.15.22:0/395765705 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f247c0b73a0 0x7f247c0d1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:56.906 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.900 7f247a2b1700 1 --2- 172.21.15.22:0/395765705 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f247c0d2380 0x7f247c1c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:56.906 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.900 7f247b2b3700 1 --2- 172.21.15.22:0/395765705 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f247c0d27d0 0x7f247c1c5870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f247c0b6da0 tx=0x7f247400ecd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:56.906 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.900 7f246bfff700 1 -- 172.21.15.22:0/395765705 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f247c1b85a0 con 0x7f247c0d27d0 2022-04-28T14:39:56.907 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.900 7f246bfff700 1 -- 172.21.15.22:0/395765705 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247400c830 con 0x7f247c0d27d0 2022-04-28T14:39:56.907 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.900 7f246bfff700 1 -- 172.21.15.22:0/395765705 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f247400f040 con 0x7f247c0d27d0 2022-04-28T14:39:56.907 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.900 7f2481da1700 1 -- 172.21.15.22:0/395765705 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f247c1b7d80 con 0x7f247c0d27d0 2022-04-28T14:39:56.907 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.900 7f2481da1700 1 -- 172.21.15.22:0/395765705 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f247c0b77f0 con 0x7f247c0d27d0 2022-04-28T14:39:56.907 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.900 7f246bfff700 1 -- 172.21.15.22:0/395765705 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f2474022060 con 0x7f247c0d27d0 2022-04-28T14:39:56.907 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.900 7f246bfff700 1 -- 172.21.15.22:0/395765705 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f2474010040 con 0x7f247c0d27d0 2022-04-28T14:39:56.907 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.901 7f2481da1700 1 -- 172.21.15.22:0/395765705 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f247c0f02c0 con 0x7f247c0d27d0 2022-04-28T14:39:56.908 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:56.904 7f246bfff700 1 -- 172.21.15.22:0/395765705 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f247400c620 con 0x7f247c0d27d0 2022-04-28T14:39:57.027 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:57.023 7f2481da1700 1 -- 172.21.15.22:0/395765705 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f247c1c6480 con 0x7f247c0d27d0 2022-04-28T14:39:57.027 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:57.023 7f246bfff700 1 -- 172.21.15.22:0/395765705 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2267 (secure 0 0 0) 0x7f247c0ffa00 con 0x7f247c0d27d0 2022-04-28T14:39:57.027 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:57.028 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.22:6818/2291514211","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6818","nonce":2291514211}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-04-28 14:39:13.928436","modified":"2022-04-28 14:39:39.000957","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4184,"mds_1":4198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4184":{"gid":4184,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6819/356491488","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6819","nonce":356491488}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4198":{"gid":4198,"name":"b","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.22:6817/401565232","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6817","nonce":401565232}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-04-28T14:39:57.029 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:57.024 7f2481da1700 1 -- 172.21.15.22:0/395765705 >> v1:172.21.15.22:6808/86956 conn(0x7f245801c1b0 legacy=0x7f245801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:57.029 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:57.024 7f2481da1700 1 -- 172.21.15.22:0/395765705 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f247c0d27d0 msgr2=0x7f247c1c5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:57.029 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:57.024 7f2481da1700 1 --2- 172.21.15.22:0/395765705 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f247c0d27d0 0x7f247c1c5870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f247c0b6da0 tx=0x7f247400ecd0).stop 2022-04-28T14:39:57.029 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:57.025 7f2481da1700 1 -- 172.21.15.22:0/395765705 shutdown_connections 2022-04-28T14:39:57.029 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:57.025 7f2481da1700 1 --2- 172.21.15.22:0/395765705 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f247c0d27d0 0x7f247c1c5870 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:57.029 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:57.025 7f2481da1700 1 --2- 172.21.15.22:0/395765705 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f247c0b73a0 0x7f247c0d1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:57.029 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:57.025 7f2481da1700 1 --2- 172.21.15.22:0/395765705 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f247c0d2380 0x7f247c1c5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:57.030 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:57.025 7f2481da1700 1 -- 172.21.15.22:0/395765705 >> 172.21.15.22:0/395765705 conn(0x7f247c124f60 msgr2=0x7f247c1239e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:57.030 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:57.025 7f2481da1700 1 -- 172.21.15.22:0/395765705 shutdown_connections 2022-04-28T14:39:57.030 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:57.025 7f2481da1700 1 -- 172.21.15.22:0/395765705 wait complete. 2022-04-28T14:39:57.030 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 12 2022-04-28T14:39:57.341 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-04-28 14:39:13.928436', 'modified': '2022-04-28 14:39:39.000957', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4184, 'mds_1': 4198}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4184': {'gid': 4184, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6819/356491488', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6819', 'nonce': 356491488}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4198': {'gid': 4198, 'name': 'b', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.22:6817/401565232', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6817', 'nonce': 401565232}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-04-28T14:39:57.342 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4198:up:stopping 2022-04-28T14:39:58.342 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-04-28T14:39:58.486 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.483 7f7558a98700 1 Processor -- start 2022-04-28T14:39:58.487 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.483 7f7558a98700 1 -- start start 2022-04-28T14:39:58.489 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.483 7f7558a98700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f75540f6370 0x7f75540f1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:58.489 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.483 7f7558a98700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f75541b77c0 0x7f75541b9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:58.489 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.483 7f7558a98700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75540ab0b0 con 0x7f75540f67c0 2022-04-28T14:39:58.490 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.483 7f7558a98700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75540f20a0 con 0x7f75540f6370 2022-04-28T14:39:58.490 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.483 7f7558a98700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7554111c20 con 0x7f75541b77c0 2022-04-28T14:39:58.490 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.484 7f7552051700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f75541b77c0 0x7f75541b9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:58.490 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.484 7f7551850700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f75540f6370 0x7f75540f1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:58.490 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.484 7f755104f700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f75540f67c0 0x7f75540f18a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38872/0 (socket says 172.21.15.22:38872) 2022-04-28T14:39:58.490 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.484 7f7552051700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f75541b77c0 0x7f75541b9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46832/0 (socket says 172.21.15.22:46832) 2022-04-28T14:39:58.490 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.484 7f755104f700 1 -- 172.21.15.22:0/3434100408 learned_addr learned my addr 172.21.15.22:0/3434100408 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:39:58.490 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.484 7f7552051700 1 -- 172.21.15.22:0/3434100408 >> v2:172.21.15.22:3300/0 conn(0x7f75540f6370 msgr2=0x7f75540f1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:39:58.490 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.484 7f7552051700 1 --2- 172.21.15.22:0/3434100408 >> v2:172.21.15.22:3300/0 conn(0x7f75540f6370 0x7f75540f1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:58.491 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.484 7f7552051700 1 -- 172.21.15.22:0/3434100408 >> v1:172.21.15.22:6789/0 conn(0x7f75540f67c0 legacy=0x7f75540f18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:58.491 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.484 7f7552051700 1 -- 172.21.15.22:0/3434100408 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755410cb00 con 0x7f75541b77c0 2022-04-28T14:39:58.491 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.484 7f7551850700 1 --2- 172.21.15.22:0/3434100408 >> v2:172.21.15.22:3300/0 conn(0x7f75540f6370 0x7f75540f1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:58.491 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.484 7f7552051700 1 --2- 172.21.15.22:0/3434100408 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f75541b77c0 0x7f75541b9c20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f754c0032f0 tx=0x7f754c009c90).ready entity=mon.2 client_cookie=1053ef67abc57cd1 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:58.491 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.484 7f755084e700 1 -- 172.21.15.22:0/3434100408 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f755410cb00 con 0x7f75541b77c0 2022-04-28T14:39:58.491 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.484 7f755084e700 1 -- 172.21.15.22:0/3434100408 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c00b880 con 0x7f75541b77c0 2022-04-28T14:39:58.491 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.484 7f755084e700 1 -- 172.21.15.22:0/3434100408 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f754c00ba60 con 0x7f75541b77c0 2022-04-28T14:39:58.491 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.484 7f7558a98700 1 -- 172.21.15.22:0/3434100408 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f75541b77c0 msgr2=0x7f75541b9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:58.491 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.484 7f7558a98700 1 --2- 172.21.15.22:0/3434100408 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f75541b77c0 0x7f75541b9c20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f754c0032f0 tx=0x7f754c009c90).stop 2022-04-28T14:39:58.492 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.485 7f7558a98700 1 -- 172.21.15.22:0/3434100408 shutdown_connections 2022-04-28T14:39:58.492 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.485 7f7558a98700 1 --2- 172.21.15.22:0/3434100408 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f75541b77c0 0x7f75541b9c20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:58.492 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.485 7f7558a98700 1 --2- 172.21.15.22:0/3434100408 >> v2:172.21.15.22:3300/0 conn(0x7f75540f6370 0x7f75540f1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:58.492 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.485 7f7558a98700 1 -- 172.21.15.22:0/3434100408 >> 172.21.15.22:0/3434100408 conn(0x7f7554117120 msgr2=0x7f75540f2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:58.492 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.485 7f7558a98700 1 -- 172.21.15.22:0/3434100408 shutdown_connections 2022-04-28T14:39:58.492 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.485 7f7558a98700 1 -- 172.21.15.22:0/3434100408 wait complete. 2022-04-28T14:39:58.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.509 7f7558a98700 1 Processor -- start 2022-04-28T14:39:58.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.509 7f7558a98700 1 -- start start 2022-04-28T14:39:58.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.509 7f7558a98700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f75540b2e30 0x7f75541c32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:58.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.509 7f7558a98700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f75541c38f0 0x7f75540b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:58.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.509 7f7558a98700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75541c3d40 0x7f75540b4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:39:58.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.509 7f7558a98700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75540d0d70 con 0x7f75541c3d40 2022-04-28T14:39:58.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.509 7f7558a98700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75540d0fc0 con 0x7f75540b2e30 2022-04-28T14:39:58.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.509 7f7558a98700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75540d08d0 con 0x7f75541c38f0 2022-04-28T14:39:58.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.509 7f7551850700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f75540b2e30 0x7f75541c32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:58.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.509 7f755104f700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f75541c38f0 0x7f75540b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:58.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.509 7f7551850700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f75540b2e30 0x7f75541c32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:47050/0 (socket says 172.21.15.22:47050) 2022-04-28T14:39:58.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.509 7f7551850700 1 -- 172.21.15.22:0/2083314905 learned_addr learned my addr 172.21.15.22:0/2083314905 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:39:58.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.509 7f7552051700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75541c3d40 0x7f75540b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:39:58.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.510 7f7551850700 1 -- 172.21.15.22:0/2083314905 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f75541c38f0 msgr2=0x7f75540b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:58.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.510 7f7551850700 1 --2- 172.21.15.22:0/2083314905 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f75541c38f0 0x7f75540b3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:58.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.510 7f7551850700 1 -- 172.21.15.22:0/2083314905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75541c3d40 msgr2=0x7f75540b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:58.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.510 7f7551850700 1 --2- 172.21.15.22:0/2083314905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75541c3d40 0x7f75540b4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:58.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.510 7f7551850700 1 -- 172.21.15.22:0/2083314905 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75540d0340 con 0x7f75540b2e30 2022-04-28T14:39:58.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.510 7f755104f700 1 --2- 172.21.15.22:0/2083314905 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f75541c38f0 0x7f75540b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:39:58.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.510 7f7551850700 1 --2- 172.21.15.22:0/2083314905 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f75540b2e30 0x7f75541c32c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f75540e04b0 tx=0x7f754400bf70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:39:58.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.510 7f7542ffd700 1 -- 172.21.15.22:0/2083314905 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f75540d0340 con 0x7f75540b2e30 2022-04-28T14:39:58.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.510 7f7542ffd700 1 -- 172.21.15.22:0/2083314905 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754400c9a0 con 0x7f75540b2e30 2022-04-28T14:39:58.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.510 7f7558a98700 1 -- 172.21.15.22:0/2083314905 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75540b3280 con 0x7f75540b2e30 2022-04-28T14:39:58.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.510 7f7542ffd700 1 -- 172.21.15.22:0/2083314905 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f754400f040 con 0x7f75540b2e30 2022-04-28T14:39:58.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.510 7f7558a98700 1 -- 172.21.15.22:0/2083314905 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75540b4670 con 0x7f75540b2e30 2022-04-28T14:39:58.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.511 7f7542ffd700 1 -- 172.21.15.22:0/2083314905 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f7544011070 con 0x7f75540b2e30 2022-04-28T14:39:58.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.511 7f7542ffd700 1 -- 172.21.15.22:0/2083314905 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f7544010040 con 0x7f75540b2e30 2022-04-28T14:39:58.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.511 7f7558a98700 1 -- 172.21.15.22:0/2083314905 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75540f02c0 con 0x7f75540b2e30 2022-04-28T14:39:58.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.514 7f7542ffd700 1 -- 172.21.15.22:0/2083314905 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f754400c5a0 con 0x7f75540b2e30 2022-04-28T14:39:58.639 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.635 7f7558a98700 1 -- 172.21.15.22:0/2083314905 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75540d0b60 con 0x7f75540b2e30 2022-04-28T14:39:58.639 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.636 7f7542ffd700 1 -- 172.21.15.22:0/2083314905 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2267 (secure 0 0 0) 0x7f7544000c30 con 0x7f75540b2e30 2022-04-28T14:39:58.640 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:39:58.640 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.22:6818/2291514211","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6818","nonce":2291514211}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-04-28 14:39:13.928436","modified":"2022-04-28 14:39:39.000957","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4184,"mds_1":4198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4184":{"gid":4184,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6819/356491488","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6819","nonce":356491488}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4198":{"gid":4198,"name":"b","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.22:6817/401565232","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6817","nonce":401565232}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-04-28T14:39:58.641 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.637 7f7558a98700 1 -- 172.21.15.22:0/2083314905 >> v1:172.21.15.22:6808/86956 conn(0x7f753001c1b0 legacy=0x7f753001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:58.641 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.637 7f7558a98700 1 -- 172.21.15.22:0/2083314905 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f75540b2e30 msgr2=0x7f75541c32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:39:58.641 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.637 7f7558a98700 1 --2- 172.21.15.22:0/2083314905 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f75540b2e30 0x7f75541c32c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f75540e04b0 tx=0x7f754400bf70).stop 2022-04-28T14:39:58.641 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.637 7f7558a98700 1 -- 172.21.15.22:0/2083314905 shutdown_connections 2022-04-28T14:39:58.641 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.637 7f7558a98700 1 --2- 172.21.15.22:0/2083314905 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f75541c3d40 0x7f75540b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:58.642 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.637 7f7558a98700 1 --2- 172.21.15.22:0/2083314905 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f75540b2e30 0x7f75541c32c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:58.642 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.637 7f7558a98700 1 --2- 172.21.15.22:0/2083314905 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f75541c38f0 0x7f75540b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:39:58.642 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.637 7f7558a98700 1 -- 172.21.15.22:0/2083314905 >> 172.21.15.22:0/2083314905 conn(0x7f75541218f0 msgr2=0x7f75540adbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:39:58.642 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.637 7f7558a98700 1 -- 172.21.15.22:0/2083314905 shutdown_connections 2022-04-28T14:39:58.642 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:39:58.637 7f7558a98700 1 -- 172.21.15.22:0/2083314905 wait complete. 2022-04-28T14:39:58.642 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 12 2022-04-28T14:39:58.954 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-04-28 14:39:13.928436', 'modified': '2022-04-28 14:39:39.000957', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4184, 'mds_1': 4198}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4184': {'gid': 4184, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6819/356491488', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6819', 'nonce': 356491488}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4198': {'gid': 4198, 'name': 'b', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.22:6817/401565232', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6817', 'nonce': 401565232}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-04-28T14:39:58.954 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4198:up:stopping 2022-04-28T14:39:59.955 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-04-28T14:40:00.100 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.093 7fc4fc574700 1 Processor -- start 2022-04-28T14:40:00.100 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.094 7fc4fc574700 1 -- start start 2022-04-28T14:40:00.100 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.094 7fc4fc574700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc4f40f6390 0x7fc4f40fe970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:40:00.100 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.094 7fc4fc574700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc4f40fefa0 0x7fc4f41b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:40:00.100 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.094 7fc4fc574700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc4f40ff3f0 0x7fc4f41b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:40:00.100 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.094 7fc4fc574700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f4115dd0 con 0x7fc4f40f6390 2022-04-28T14:40:00.100 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.094 7fc4fc574700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f410b7d0 con 0x7fc4f40ff3f0 2022-04-28T14:40:00.101 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.094 7fc4fc574700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f40f67e0 con 0x7fc4f40fefa0 2022-04-28T14:40:00.101 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.094 7fc4f9b74700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc4f40ff3f0 0x7fc4f41b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:40:00.101 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.094 7fc4f9373700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc4f40f6390 0x7fc4f40fe970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:40:00.101 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.094 7fc4f9b74700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc4f40ff3f0 0x7fc4f41b1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:47062/0 (socket says 172.21.15.22:47062) 2022-04-28T14:40:00.101 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.094 7fc4f9b74700 1 -- 172.21.15.22:0/3256878625 learned_addr learned my addr 172.21.15.22:0/3256878625 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:40:00.101 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.094 7fc4f8b72700 1 --2- 172.21.15.22:0/3256878625 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc4f40fefa0 0x7fc4f41b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:40:00.101 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.095 7fc4f9373700 1 -- 172.21.15.22:0/3256878625 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc4f40fefa0 msgr2=0x7fc4f41b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:40:00.101 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.095 7fc4f9373700 1 --2- 172.21.15.22:0/3256878625 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc4f40fefa0 0x7fc4f41b1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:00.101 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.095 7fc4f9373700 1 -- 172.21.15.22:0/3256878625 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc4f40ff3f0 msgr2=0x7fc4f41b1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:40:00.101 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.095 7fc4f9373700 1 --2- 172.21.15.22:0/3256878625 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc4f40ff3f0 0x7fc4f41b1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:00.102 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.095 7fc4f9373700 1 -- 172.21.15.22:0/3256878625 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f4111480 con 0x7fc4f40f6390 2022-04-28T14:40:00.102 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.095 7fc4f8b72700 1 --2- 172.21.15.22:0/3256878625 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc4f40fefa0 0x7fc4f41b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:40:00.102 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.095 7fc4f9b74700 1 --2- 172.21.15.22:0/3256878625 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc4f40ff3f0 0x7fc4f41b1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:40:00.102 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.095 7fc4f9373700 1 --2- 172.21.15.22:0/3256878625 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4f40f6390 0x7fc4f40fe970 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fc4e8002f70 tx=0x7fc4e800b9f0).ready entity=mon.0 client_cookie=c5ef48a6a95b8f26 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:40:00.102 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.095 7fc4e7fff700 1 -- 172.21.15.22:0/3256878625 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc4f4111480 con 0x7fc4f40f6390 2022-04-28T14:40:00.102 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.095 7fc4e7fff700 1 -- 172.21.15.22:0/3256878625 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e800d570 con 0x7fc4f40f6390 2022-04-28T14:40:00.102 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.095 7fc4e7fff700 1 -- 172.21.15.22:0/3256878625 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc4e800d940 con 0x7fc4f40f6390 2022-04-28T14:40:00.102 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.095 7fc4fc574700 1 -- 172.21.15.22:0/3256878625 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4f40f6390 msgr2=0x7fc4f40fe970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:40:00.102 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.095 7fc4fc574700 1 --2- 172.21.15.22:0/3256878625 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4f40f6390 0x7fc4f40fe970 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fc4e8002f70 tx=0x7fc4e800b9f0).stop 2022-04-28T14:40:00.102 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.096 7fc4fc574700 1 -- 172.21.15.22:0/3256878625 shutdown_connections 2022-04-28T14:40:00.103 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.096 7fc4fc574700 1 --2- 172.21.15.22:0/3256878625 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc4f40ff3f0 0x7fc4f41b1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:00.103 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.096 7fc4fc574700 1 --2- 172.21.15.22:0/3256878625 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4f40f6390 0x7fc4f40fe970 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:00.103 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.096 7fc4fc574700 1 --2- 172.21.15.22:0/3256878625 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc4f40fefa0 0x7fc4f41b1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:00.103 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.096 7fc4fc574700 1 -- 172.21.15.22:0/3256878625 >> 172.21.15.22:0/3256878625 conn(0x7fc4f4117120 msgr2=0x7fc4f40f2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:40:00.103 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.096 7fc4fc574700 1 -- 172.21.15.22:0/3256878625 shutdown_connections 2022-04-28T14:40:00.103 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.096 7fc4fc574700 1 -- 172.21.15.22:0/3256878625 wait complete. 2022-04-28T14:40:00.123 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.120 7fc4fc574700 1 Processor -- start 2022-04-28T14:40:00.123 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.120 7fc4fc574700 1 -- start start 2022-04-28T14:40:00.126 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.120 7fc4fc574700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc4f40b8250 0x7fc4f41c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:40:00.126 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.120 7fc4fc574700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4f40b86a0 0x7fc4f41c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:40:00.126 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.120 7fc4fc574700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc4f40b93d0 0x7fc4f40b9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:40:00.126 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.120 7fc4fc574700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f40b7db0 con 0x7fc4f40b86a0 2022-04-28T14:40:00.126 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.120 7fc4fc574700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f40b7a70 con 0x7fc4f40b93d0 2022-04-28T14:40:00.126 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.120 7fc4fc574700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f40cd1d0 con 0x7fc4f40b8250 2022-04-28T14:40:00.126 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.120 7fc4f9373700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc4f40b8250 0x7fc4f41c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:40:00.126 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.120 7fc4f9b74700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc4f40b93d0 0x7fc4f40b9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:40:00.126 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.120 7fc4f8b72700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4f40b86a0 0x7fc4f41c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:40:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.120 7fc4f9373700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc4f40b8250 0x7fc4f41c55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46848/0 (socket says 172.21.15.22:46848) 2022-04-28T14:40:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.120 7fc4f9b74700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc4f40b93d0 0x7fc4f40b9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:47068/0 (socket says 172.21.15.22:47068) 2022-04-28T14:40:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.120 7fc4f9373700 1 -- 172.21.15.22:0/3277974521 learned_addr learned my addr 172.21.15.22:0/3277974521 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:40:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.120 7fc4f8b72700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4f40b86a0 0x7fc4f41c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49498/0 (socket says 172.21.15.22:49498) 2022-04-28T14:40:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.120 7fc4f8b72700 1 -- 172.21.15.22:0/3277974521 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc4f40b8250 msgr2=0x7fc4f41c55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:40:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.120 7fc4f8b72700 1 --2- 172.21.15.22:0/3277974521 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc4f40b8250 0x7fc4f41c55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.120 7fc4f8b72700 1 -- 172.21.15.22:0/3277974521 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc4f40b93d0 msgr2=0x7fc4f40b9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:40:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.120 7fc4f8b72700 1 --2- 172.21.15.22:0/3277974521 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc4f40b93d0 0x7fc4f40b9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:00.127 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.120 7fc4f8b72700 1 -- 172.21.15.22:0/3277974521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f40cd7d0 con 0x7fc4f40b86a0 2022-04-28T14:40:00.128 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.121 7fc4f9b74700 1 --2- 172.21.15.22:0/3277974521 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc4f40b93d0 0x7fc4f40b9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:40:00.128 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.121 7fc4f9373700 1 --2- 172.21.15.22:0/3277974521 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc4f40b8250 0x7fc4f41c55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:40:00.128 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.121 7fc4f8b72700 1 --2- 172.21.15.22:0/3277974521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4f40b86a0 0x7fc4f41c5bf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fc4f40d6a00 tx=0x7fc4f000eca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:40:00.128 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.121 7fc4e67fc700 1 -- 172.21.15.22:0/3277974521 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc4f40cd7d0 con 0x7fc4f40b86a0 2022-04-28T14:40:00.128 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.121 7fc4e67fc700 1 -- 172.21.15.22:0/3277974521 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f000c790 con 0x7fc4f40b86a0 2022-04-28T14:40:00.128 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.121 7fc4fc574700 1 -- 172.21.15.22:0/3277974521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f40b8d90 con 0x7fc4f40b86a0 2022-04-28T14:40:00.128 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.121 7fc4e67fc700 1 -- 172.21.15.22:0/3277974521 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fc4f000f040 con 0x7fc4f40b86a0 2022-04-28T14:40:00.128 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.121 7fc4fc574700 1 -- 172.21.15.22:0/3277974521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f40b9e50 con 0x7fc4f40b86a0 2022-04-28T14:40:00.128 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.121 7fc4e67fc700 1 -- 172.21.15.22:0/3277974521 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fc4f0011070 con 0x7fc4f40b86a0 2022-04-28T14:40:00.129 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.122 7fc4e67fc700 1 -- 172.21.15.22:0/3277974521 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fc4f0010040 con 0x7fc4f40b86a0 2022-04-28T14:40:00.129 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.122 7fc4fc574700 1 -- 172.21.15.22:0/3277974521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f40f02c0 con 0x7fc4f40b86a0 2022-04-28T14:40:00.129 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.125 7fc4e67fc700 1 -- 172.21.15.22:0/3277974521 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fc4f000ede0 con 0x7fc4f40b86a0 2022-04-28T14:40:00.248 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.245 7fc4fc574700 1 -- 172.21.15.22:0/3277974521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4f40ab0b0 con 0x7fc4f40b86a0 2022-04-28T14:40:00.249 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.245 7fc4e67fc700 1 -- 172.21.15.22:0/3277974521 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2267 (secure 0 0 0) 0x7fc4f0000c30 con 0x7fc4f40b86a0 2022-04-28T14:40:00.249 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:40:00.249 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.22:6818/2291514211","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6818","nonce":2291514211}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-04-28 14:39:13.928436","modified":"2022-04-28 14:39:39.000957","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4184,"mds_1":4198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4184":{"gid":4184,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6819/356491488","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6819","nonce":356491488}]},"export_targets":[],"features":4611087854035861503,"flags":0},"gid_4198":{"gid":4198,"name":"b","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.22:6817/401565232","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6817","nonce":401565232}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-04-28T14:40:00.250 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.246 7fc4fc574700 1 -- 172.21.15.22:0/3277974521 >> v1:172.21.15.22:6808/86956 conn(0x7fc4d401c150 legacy=0x7fc4d401e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:40:00.251 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.246 7fc4fc574700 1 -- 172.21.15.22:0/3277974521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4f40b86a0 msgr2=0x7fc4f41c5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:40:00.251 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.246 7fc4fc574700 1 --2- 172.21.15.22:0/3277974521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4f40b86a0 0x7fc4f41c5bf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fc4f40d6a00 tx=0x7fc4f000eca0).stop 2022-04-28T14:40:00.251 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.246 7fc4fc574700 1 -- 172.21.15.22:0/3277974521 shutdown_connections 2022-04-28T14:40:00.251 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.246 7fc4fc574700 1 --2- 172.21.15.22:0/3277974521 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc4f40b93d0 0x7fc4f40b9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:00.251 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.246 7fc4fc574700 1 --2- 172.21.15.22:0/3277974521 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc4f40b8250 0x7fc4f41c55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:00.251 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.246 7fc4fc574700 1 --2- 172.21.15.22:0/3277974521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4f40b86a0 0x7fc4f41c5bf0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:00.251 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.246 7fc4fc574700 1 -- 172.21.15.22:0/3277974521 >> 172.21.15.22:0/3277974521 conn(0x7fc4f40e0970 msgr2=0x7fc4f40bda40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:40:00.251 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.246 7fc4fc574700 1 -- 172.21.15.22:0/3277974521 shutdown_connections 2022-04-28T14:40:00.251 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:00.246 7fc4fc574700 1 -- 172.21.15.22:0/3277974521 wait complete. 2022-04-28T14:40:00.252 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 12 2022-04-28T14:40:00.563 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-04-28 14:39:13.928436', 'modified': '2022-04-28 14:39:39.000957', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4184, 'mds_1': 4198}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4184': {'gid': 4184, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6819/356491488', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6819', 'nonce': 356491488}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}, 'gid_4198': {'gid': 4198, 'name': 'b', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.22:6817/401565232', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6817', 'nonce': 401565232}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-04-28T14:40:00.563 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4198:up:stopping 2022-04-28T14:40:01.338 INFO:tasks.ceph.mds.b.smithi022.stdout:starting mds.b at 2022-04-28T14:40:01.564 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-04-28T14:40:01.708 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.704 7f261e91b700 1 Processor -- start 2022-04-28T14:40:01.708 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.704 7f261e91b700 1 -- start start 2022-04-28T14:40:01.709 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.705 7f261e91b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f26180f6460 0x7f26180fea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:40:01.709 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.705 7f261e91b700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f26180ff4c0 0x7f26181b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:40:01.709 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.705 7f261e91b700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26180ab2b0 con 0x7f26180ff070 2022-04-28T14:40:01.709 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.705 7f261e91b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26181b2360 con 0x7f26180f6460 2022-04-28T14:40:01.709 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.705 7f261e91b700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2618115ea0 con 0x7f26180ff4c0 2022-04-28T14:40:01.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.705 7f2617dec700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f26180ff4c0 0x7f26181b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:40:01.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.705 7f26175eb700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f26180f6460 0x7f26180fea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:40:01.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.705 7f2616dea700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f26180ff070 0x7f26181b1530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38912/0 (socket says 172.21.15.22:38912) 2022-04-28T14:40:01.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.705 7f2616dea700 1 -- 172.21.15.22:0/2262657284 learned_addr learned my addr 172.21.15.22:0/2262657284 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:40:01.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.706 7f26165e9700 1 -- 172.21.15.22:0/2262657284 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3500078786 0 0) 0x7f2600001110 con 0x7f26180ff070 2022-04-28T14:40:01.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.706 7f2617dec700 1 -- 172.21.15.22:0/2262657284 >> v2:172.21.15.22:3300/0 conn(0x7f26180f6460 msgr2=0x7f26180fea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:40:01.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.706 7f2617dec700 1 --2- 172.21.15.22:0/2262657284 >> v2:172.21.15.22:3300/0 conn(0x7f26180f6460 0x7f26180fea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:01.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.706 7f2617dec700 1 -- 172.21.15.22:0/2262657284 >> v1:172.21.15.22:6789/0 conn(0x7f26180ff070 legacy=0x7f26181b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:40:01.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.706 7f2617dec700 1 -- 172.21.15.22:0/2262657284 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261810b8a0 con 0x7f26180ff4c0 2022-04-28T14:40:01.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.706 7f26175eb700 1 --2- 172.21.15.22:0/2262657284 >> v2:172.21.15.22:3300/0 conn(0x7f26180f6460 0x7f26180fea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:40:01.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.706 7f2617dec700 1 --2- 172.21.15.22:0/2262657284 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f26180ff4c0 0x7f26181b1d30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f26100032f0 tx=0x7f2610009c90).ready entity=mon.2 client_cookie=3fa58bf21c78502f server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:40:01.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.706 7f26165e9700 1 -- 172.21.15.22:0/2262657284 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f261810b8a0 con 0x7f26180ff4c0 2022-04-28T14:40:01.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.706 7f26165e9700 1 -- 172.21.15.22:0/2262657284 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261000b880 con 0x7f26180ff4c0 2022-04-28T14:40:01.713 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.706 7f26165e9700 1 -- 172.21.15.22:0/2262657284 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f261000ba60 con 0x7f26180ff4c0 2022-04-28T14:40:01.713 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.706 7f261e91b700 1 -- 172.21.15.22:0/2262657284 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f26180ff4c0 msgr2=0x7f26181b1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:40:01.713 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.706 7f261e91b700 1 --2- 172.21.15.22:0/2262657284 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f26180ff4c0 0x7f26181b1d30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f26100032f0 tx=0x7f2610009c90).stop 2022-04-28T14:40:01.713 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.706 7f261e91b700 1 -- 172.21.15.22:0/2262657284 shutdown_connections 2022-04-28T14:40:01.713 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.706 7f261e91b700 1 --2- 172.21.15.22:0/2262657284 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f26180ff4c0 0x7f26181b1d30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:01.713 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.706 7f261e91b700 1 --2- 172.21.15.22:0/2262657284 >> v2:172.21.15.22:3300/0 conn(0x7f26180f6460 0x7f26180fea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:01.713 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.706 7f261e91b700 1 -- 172.21.15.22:0/2262657284 >> 172.21.15.22:0/2262657284 conn(0x7f26181171f0 msgr2=0x7f26180f2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:40:01.713 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.706 7f261e91b700 1 -- 172.21.15.22:0/2262657284 shutdown_connections 2022-04-28T14:40:01.713 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.707 7f261e91b700 1 -- 172.21.15.22:0/2262657284 wait complete. 2022-04-28T14:40:01.734 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.730 7f261e91b700 1 Processor -- start 2022-04-28T14:40:01.779 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.731 7f261e91b700 1 -- start start 2022-04-28T14:40:01.782 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.731 7f261e91b700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f26180af650 0x7f26181b6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:40:01.782 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.731 7f261e91b700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f26180f1340 0x7f26180f1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:40:01.782 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.731 7f261e91b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26180f1dc0 0x7f26180d0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:40:01.782 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.731 7f261e91b700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26180b24a0 con 0x7f26180f1dc0 2022-04-28T14:40:01.782 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.731 7f261e91b700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26180afe70 con 0x7f26180af650 2022-04-28T14:40:01.783 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.731 7f261e91b700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26180afb30 con 0x7f26180f1340 2022-04-28T14:40:01.783 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.731 7f2616dea700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f26180f1340 0x7f26180f1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:40:01.783 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.731 7f2617dec700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26180f1dc0 0x7f26180d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:40:01.783 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.731 7f2616dea700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f26180f1340 0x7f26180f1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46876/0 (socket says 172.21.15.22:46876) 2022-04-28T14:40:01.783 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.731 7f2617dec700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26180f1dc0 0x7f26180d0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49526/0 (socket says 172.21.15.22:49526) 2022-04-28T14:40:01.783 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.731 7f2616dea700 1 -- 172.21.15.22:0/3778881822 learned_addr learned my addr 172.21.15.22:0/3778881822 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:40:01.783 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.731 7f26175eb700 1 --2- 172.21.15.22:0/3778881822 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f26180af650 0x7f26181b6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:40:01.783 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.732 7f2617dec700 1 -- 172.21.15.22:0/3778881822 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f26180f1340 msgr2=0x7f26180f1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:40:01.784 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.732 7f2617dec700 1 --2- 172.21.15.22:0/3778881822 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f26180f1340 0x7f26180f1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:01.784 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.732 7f2617dec700 1 -- 172.21.15.22:0/3778881822 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f26180af650 msgr2=0x7f26181b6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:40:01.784 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.732 7f2617dec700 1 --2- 172.21.15.22:0/3778881822 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f26180af650 0x7f26181b6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:01.784 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.732 7f2617dec700 1 -- 172.21.15.22:0/3778881822 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26180b0e50 con 0x7f26180f1dc0 2022-04-28T14:40:01.784 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.732 7f2616dea700 1 --2- 172.21.15.22:0/3778881822 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f26180f1340 0x7f26180f1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:40:01.784 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.732 7f26175eb700 1 --2- 172.21.15.22:0/3778881822 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f26180af650 0x7f26181b6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:40:01.784 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.732 7f2617dec700 1 --2- 172.21.15.22:0/3778881822 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26180f1dc0 0x7f26180d0030 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f26180b0360 tx=0x7f2610006c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:40:01.784 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.732 7f2614de6700 1 -- 172.21.15.22:0/3778881822 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f26180b0e50 con 0x7f26180f1dc0 2022-04-28T14:40:01.785 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.732 7f2614de6700 1 -- 172.21.15.22:0/3778881822 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26100119f0 con 0x7f26180f1dc0 2022-04-28T14:40:01.785 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.732 7f261e91b700 1 -- 172.21.15.22:0/3778881822 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26181b7170 con 0x7f26180f1dc0 2022-04-28T14:40:01.785 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.732 7f2614de6700 1 -- 172.21.15.22:0/3778881822 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f2610017040 con 0x7f26180f1dc0 2022-04-28T14:40:01.785 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.732 7f261e91b700 1 -- 172.21.15.22:0/3778881822 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26180d0840 con 0x7f26180f1dc0 2022-04-28T14:40:01.785 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.733 7f2614de6700 1 -- 172.21.15.22:0/3778881822 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f261001c470 con 0x7f26180f1dc0 2022-04-28T14:40:01.785 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.733 7f2614de6700 1 -- 172.21.15.22:0/3778881822 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f2610018030 con 0x7f26180f1dc0 2022-04-28T14:40:01.785 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.733 7f261e91b700 1 -- 172.21.15.22:0/3778881822 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26180f2210 con 0x7f26180f1dc0 2022-04-28T14:40:01.785 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.736 7f2614de6700 1 -- 172.21.15.22:0/3778881822 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7f261000b670 con 0x7f26180f1dc0 2022-04-28T14:40:01.859 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.855 7f261e91b700 1 -- 172.21.15.22:0/3778881822 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26180f0390 con 0x7f26180f1dc0 2022-04-28T14:40:01.859 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.856 7f2614de6700 1 -- 172.21.15.22:0/3778881822 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+1978 (secure 0 0 0) 0x7f26100117e0 con 0x7f26180f1dc0 2022-04-28T14:40:01.860 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:40:01.860 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.22:6818/2291514211","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6818","nonce":2291514211}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-04-28 14:39:13.928436","modified":"2022-04-28 14:40:01.257396","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4184},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4184":{"gid":4184,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6819/356491488","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6819","nonce":356491488}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-04-28T14:40:01.861 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.857 7f261e91b700 1 -- 172.21.15.22:0/3778881822 >> v1:172.21.15.22:6808/86956 conn(0x7f25fc01c1b0 legacy=0x7f25fc01e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:40:01.861 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.857 7f261e91b700 1 -- 172.21.15.22:0/3778881822 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26180f1dc0 msgr2=0x7f26180d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:40:01.861 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.857 7f261e91b700 1 --2- 172.21.15.22:0/3778881822 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26180f1dc0 0x7f26180d0030 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f26180b0360 tx=0x7f2610006c40).stop 2022-04-28T14:40:01.862 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.857 7f261e91b700 1 -- 172.21.15.22:0/3778881822 shutdown_connections 2022-04-28T14:40:01.862 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.857 7f261e91b700 1 --2- 172.21.15.22:0/3778881822 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26180f1dc0 0x7f26180d0030 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:01.862 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.857 7f261e91b700 1 --2- 172.21.15.22:0/3778881822 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f26180af650 0x7f26181b6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:01.862 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.857 7f261e91b700 1 --2- 172.21.15.22:0/3778881822 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f26180f1340 0x7f26180f1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:01.862 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.857 7f261e91b700 1 -- 172.21.15.22:0/3778881822 >> 172.21.15.22:0/3778881822 conn(0x7f26180ace80 msgr2=0x7f26180add10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:40:01.862 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.857 7f261e91b700 1 -- 172.21.15.22:0/3778881822 shutdown_connections 2022-04-28T14:40:01.862 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:01.857 7f261e91b700 1 -- 172.21.15.22:0/3778881822 wait complete. 2022-04-28T14:40:01.863 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 13 2022-04-28T14:40:02.174 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-04-28 14:39:13.928436', 'modified': '2022-04-28 14:40:01.257396', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4184}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_4184': {'gid': 4184, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6819/356491488', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6819', 'nonce': 356491488}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-04-28T14:40:02.174 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-04-28T14:40:02.174 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: skipping max_mds check 2022-04-28T14:40:02.174 DEBUG:tasks.cephfs.filesystem:deactivating rank 0 2022-04-28T14:40:02.175 INFO:tasks.cephfs.filesystem:Error: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_4fa079ba14503defa8dc257d7c2d506ebefcfe6d/qa/tasks/cephfs/filesystem.py", line 575, in reach_max_mds self.deactivate(target['rank']) File "/home/teuthworker/src/github.com_ceph_ceph-c_4fa079ba14503defa8dc257d7c2d506ebefcfe6d/qa/tasks/cephfs/filesystem.py", line 557, in deactivate raise RuntimeError("cannot deactivate rank 0") RuntimeError: cannot deactivate rank 0 2022-04-28T14:40:02.175 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-04-28T14:40:02.313 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.307 7fd94091a700 1 Processor -- start 2022-04-28T14:40:02.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.307 7fd94091a700 1 -- start start 2022-04-28T14:40:02.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.307 7fd94091a700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd93c0f6460 0x7fd93c0fea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:40:02.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.307 7fd94091a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd93c0ff070 0x7fd93c1b1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:40:02.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.307 7fd94091a700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd93c0ab2b0 con 0x7fd93c0ff4c0 2022-04-28T14:40:02.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.307 7fd94091a700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd93c1b2360 con 0x7fd93c0ff070 2022-04-28T14:40:02.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.307 7fd94091a700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c115ea0 con 0x7fd93c0f6460 2022-04-28T14:40:02.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.307 7fd9395ff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd93c0f6460 0x7fd93c0fea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:40:02.314 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.307 7fd938dfe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd93c0ff070 0x7fd93c1b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:40:02.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.307 7fd9395ff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd93c0f6460 0x7fd93c0fea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:46882/0 (socket says 172.21.15.22:46882) 2022-04-28T14:40:02.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.307 7fd939e00700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd93c0ff4c0 0x7fd93c1b1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38928/0 (socket says 172.21.15.22:38928) 2022-04-28T14:40:02.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.307 7fd9395ff700 1 -- 172.21.15.22:0/4290479154 learned_addr learned my addr 172.21.15.22:0/4290479154 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:40:02.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.308 7fd938dfe700 1 -- 172.21.15.22:0/4290479154 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd93c0f6460 msgr2=0x7fd93c0fea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:40:02.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.308 7fd938dfe700 1 --2- 172.21.15.22:0/4290479154 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd93c0f6460 0x7fd93c0fea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:02.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.308 7fd938dfe700 1 -- 172.21.15.22:0/4290479154 >> v1:172.21.15.22:6789/0 conn(0x7fd93c0ff4c0 legacy=0x7fd93c1b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:40:02.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.308 7fd938dfe700 1 -- 172.21.15.22:0/4290479154 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93c10b8a0 con 0x7fd93c0ff070 2022-04-28T14:40:02.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.308 7fd92bfff700 1 -- 172.21.15.22:0/4290479154 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 269308023 0 0) 0x7fd934001490 con 0x7fd93c0ff4c0 2022-04-28T14:40:02.315 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.308 7fd9395ff700 1 --2- 172.21.15.22:0/4290479154 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd93c0f6460 0x7fd93c0fea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:40:02.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.308 7fd938dfe700 1 --2- 172.21.15.22:0/4290479154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd93c0ff070 0x7fd93c1b1530 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fd92c002f70 tx=0x7fd92c00dc50).ready entity=mon.0 client_cookie=bcb9b0ef133a8282 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:40:02.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.308 7fd92bfff700 1 -- 172.21.15.22:0/4290479154 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd93c10b8a0 con 0x7fd93c0ff070 2022-04-28T14:40:02.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.308 7fd92bfff700 1 -- 172.21.15.22:0/4290479154 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92c00bbe0 con 0x7fd93c0ff070 2022-04-28T14:40:02.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.308 7fd92bfff700 1 -- 172.21.15.22:0/4290479154 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd92c015070 con 0x7fd93c0ff070 2022-04-28T14:40:02.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.308 7fd94091a700 1 -- 172.21.15.22:0/4290479154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd93c0ff070 msgr2=0x7fd93c1b1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:40:02.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.308 7fd94091a700 1 --2- 172.21.15.22:0/4290479154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd93c0ff070 0x7fd93c1b1530 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fd92c002f70 tx=0x7fd92c00dc50).stop 2022-04-28T14:40:02.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.309 7fd94091a700 1 -- 172.21.15.22:0/4290479154 shutdown_connections 2022-04-28T14:40:02.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.309 7fd94091a700 1 --2- 172.21.15.22:0/4290479154 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd93c0f6460 0x7fd93c0fea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:02.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.309 7fd94091a700 1 --2- 172.21.15.22:0/4290479154 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd93c0ff070 0x7fd93c1b1530 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:02.316 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.309 7fd94091a700 1 -- 172.21.15.22:0/4290479154 >> 172.21.15.22:0/4290479154 conn(0x7fd93c1171f0 msgr2=0x7fd93c0f2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:40:02.317 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.309 7fd94091a700 1 -- 172.21.15.22:0/4290479154 shutdown_connections 2022-04-28T14:40:02.317 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.309 7fd94091a700 1 -- 172.21.15.22:0/4290479154 wait complete. 2022-04-28T14:40:02.339 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.333 7fd94091a700 1 Processor -- start 2022-04-28T14:40:02.339 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.333 7fd94091a700 1 -- start start 2022-04-28T14:40:02.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.333 7fd94091a700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd93c0b2990 0x7fd93c1c1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:40:02.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.333 7fd94091a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd93c1c1f90 0x7fd93c0b3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:40:02.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.333 7fd94091a700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd93c1c23e0 0x7fd93c0b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:40:02.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.333 7fd94091a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c0dde10 con 0x7fd93c1c1f90 2022-04-28T14:40:02.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.333 7fd94091a700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c0dd880 con 0x7fd93c0b2990 2022-04-28T14:40:02.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.333 7fd94091a700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c0b21b0 con 0x7fd93c1c23e0 2022-04-28T14:40:02.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.333 7fd9395ff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd93c0b2990 0x7fd93c1c1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:40:02.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.333 7fd939e00700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd93c1c23e0 0x7fd93c0b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:40:02.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.333 7fd938dfe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd93c1c1f90 0x7fd93c0b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:40:02.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.333 7fd9395ff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd93c0b2990 0x7fd93c1c1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:47104/0 (socket says 172.21.15.22:47104) 2022-04-28T14:40:02.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.333 7fd9395ff700 1 -- 172.21.15.22:0/3235876240 learned_addr learned my addr 172.21.15.22:0/3235876240 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:40:02.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.334 7fd938dfe700 1 -- 172.21.15.22:0/3235876240 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd93c1c23e0 msgr2=0x7fd93c0b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:40:02.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.334 7fd938dfe700 1 --2- 172.21.15.22:0/3235876240 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd93c1c23e0 0x7fd93c0b3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:02.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.334 7fd938dfe700 1 -- 172.21.15.22:0/3235876240 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd93c0b2990 msgr2=0x7fd93c1c1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:40:02.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.334 7fd938dfe700 1 --2- 172.21.15.22:0/3235876240 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd93c0b2990 0x7fd93c1c1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:02.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.334 7fd938dfe700 1 -- 172.21.15.22:0/3235876240 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93c0de3c0 con 0x7fd93c1c1f90 2022-04-28T14:40:02.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.334 7fd9395ff700 1 --2- 172.21.15.22:0/3235876240 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd93c0b2990 0x7fd93c1c1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:40:02.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.334 7fd939e00700 1 --2- 172.21.15.22:0/3235876240 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd93c1c23e0 0x7fd93c0b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:40:02.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.334 7fd938dfe700 1 --2- 172.21.15.22:0/3235876240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd93c1c1f90 0x7fd93c0b3870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fd93c0b2880 tx=0x7fd92c0068c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:40:02.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.334 7fd92a7fc700 1 -- 172.21.15.22:0/3235876240 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd93c0de3c0 con 0x7fd93c1c1f90 2022-04-28T14:40:02.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.334 7fd92a7fc700 1 -- 172.21.15.22:0/3235876240 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92c01a480 con 0x7fd93c1c1f90 2022-04-28T14:40:02.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.334 7fd94091a700 1 -- 172.21.15.22:0/3235876240 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd93c0b3280 con 0x7fd93c1c1f90 2022-04-28T14:40:02.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.334 7fd92a7fc700 1 -- 172.21.15.22:0/3235876240 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7fd92c021070 con 0x7fd93c1c1f90 2022-04-28T14:40:02.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.334 7fd94091a700 1 -- 172.21.15.22:0/3235876240 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd93c0b2fc0 con 0x7fd93c1c1f90 2022-04-28T14:40:02.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.335 7fd92a7fc700 1 -- 172.21.15.22:0/3235876240 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7fd92c025460 con 0x7fd93c1c1f90 2022-04-28T14:40:02.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.335 7fd92a7fc700 1 -- 172.21.15.22:0/3235876240 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fd92c01c040 con 0x7fd93c1c1f90 2022-04-28T14:40:02.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.335 7fd94091a700 1 -- 172.21.15.22:0/3235876240 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd93c0f0390 con 0x7fd93c1c1f90 2022-04-28T14:40:02.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.338 7fd92a7fc700 1 -- 172.21.15.22:0/3235876240 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+94076 (secure 0 0 0) 0x7fd92c010bd0 con 0x7fd93c1c1f90 2022-04-28T14:40:02.462 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.457 7fd94091a700 1 -- 172.21.15.22:0/3235876240 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd93c0efa60 con 0x7fd93c1c1f90 2022-04-28T14:40:02.463 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.458 7fd92a7fc700 1 -- 172.21.15.22:0/3235876240 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+1978 (secure 0 0 0) 0x7fd92c00b7e0 con 0x7fd93c1c1f90 2022-04-28T14:40:02.463 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:40:02.463 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.22:6818/2291514211","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6818","nonce":2291514211}]},"export_targets":[],"features":4611087854035861503,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-04-28 14:39:13.928436","modified":"2022-04-28 14:40:01.257396","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"-1 (unspecified)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4184},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4184":{"gid":4184,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6819/356491488","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6819","nonce":356491488}]},"export_targets":[],"features":4611087854035861503,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-04-28T14:40:02.464 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.459 7fd94091a700 1 -- 172.21.15.22:0/3235876240 >> v1:172.21.15.22:6808/86956 conn(0x7fd91801c1b0 legacy=0x7fd91801e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:40:02.464 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.459 7fd94091a700 1 -- 172.21.15.22:0/3235876240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd93c1c1f90 msgr2=0x7fd93c0b3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:40:02.464 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.459 7fd94091a700 1 --2- 172.21.15.22:0/3235876240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd93c1c1f90 0x7fd93c0b3870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fd93c0b2880 tx=0x7fd92c0068c0).stop 2022-04-28T14:40:02.465 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.459 7fd94091a700 1 -- 172.21.15.22:0/3235876240 shutdown_connections 2022-04-28T14:40:02.465 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.459 7fd94091a700 1 --2- 172.21.15.22:0/3235876240 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd93c1c23e0 0x7fd93c0b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:02.465 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.459 7fd94091a700 1 --2- 172.21.15.22:0/3235876240 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd93c0b2990 0x7fd93c1c1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:02.465 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.459 7fd94091a700 1 --2- 172.21.15.22:0/3235876240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd93c1c1f90 0x7fd93c0b3870 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:02.465 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.459 7fd94091a700 1 -- 172.21.15.22:0/3235876240 >> 172.21.15.22:0/3235876240 conn(0x7fd93c0e0d60 msgr2=0x7fd93c0ad850 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:40:02.465 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.459 7fd94091a700 1 -- 172.21.15.22:0/3235876240 shutdown_connections 2022-04-28T14:40:02.465 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.459 7fd94091a700 1 -- 172.21.15.22:0/3235876240 wait complete. 2022-04-28T14:40:02.466 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 13 2022-04-28T14:40:02.777 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-04-28 14:39:13.928436', 'modified': '2022-04-28 14:40:01.257396', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '-1 (unspecified)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4184}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_4184': {'gid': 4184, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6819/356491488', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6819', 'nonce': 356491488}]}, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-04-28T14:40:02.777 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-04-28T14:40:02.777 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2022-04-28T14:40:02.916 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.909 7f8fb2718700 1 Processor -- start 2022-04-28T14:40:02.916 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.909 7f8fb2718700 1 -- start start 2022-04-28T14:40:02.916 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.909 7f8fb2718700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8fac10ea50 0x7f8fac0f7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:40:02.916 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.909 7f8fb2718700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8fac0f0b30 0x7f8fac0f0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:40:02.916 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.909 7f8fb2718700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fac0ab0e0 con 0x7f8fac0f15b0 2022-04-28T14:40:02.916 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.909 7f8fb2718700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac10efc0 con 0x7f8fac0f0b30 2022-04-28T14:40:02.916 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.909 7f8fb2718700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac0f1fe0 con 0x7f8fac10ea50 2022-04-28T14:40:02.916 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.909 7f8fab3b0700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8fac10ea50 0x7f8fac0f7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:40:02.917 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.909 7f8fabbb1700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f8fac0f15b0 0x7f8fac1b4be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:38944/0 (socket says 172.21.15.22:38944) 2022-04-28T14:40:02.917 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.909 7f8faabaf700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8fac0f0b30 0x7f8fac0f0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:40:02.917 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.909 7f8fabbb1700 1 -- 172.21.15.22:0/1539400108 learned_addr learned my addr 172.21.15.22:0/1539400108 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:40:02.917 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.910 7f8faa3ae700 1 -- 172.21.15.22:0/1539400108 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1142485692 0 0) 0x7f8fa4001490 con 0x7f8fac0f15b0 2022-04-28T14:40:02.917 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.910 7f8faa3ae700 1 -- 172.21.15.22:0/1539400108 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f8c003270 con 0x7f8fac0f15b0 2022-04-28T14:40:02.917 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.910 7f8faabaf700 1 -- 172.21.15.22:0/1539400108 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8fac10ea50 msgr2=0x7f8fac0f7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:40:02.917 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.910 7f8faabaf700 1 --2- 172.21.15.22:0/1539400108 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8fac10ea50 0x7f8fac0f7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:02.917 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.910 7f8faabaf700 1 -- 172.21.15.22:0/1539400108 >> v1:172.21.15.22:6789/0 conn(0x7f8fac0f15b0 legacy=0x7f8fac1b4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:40:02.917 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.910 7f8faabaf700 1 -- 172.21.15.22:0/1539400108 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fac0f83a0 con 0x7f8fac0f0b30 2022-04-28T14:40:02.917 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.910 7f8fab3b0700 1 --2- 172.21.15.22:0/1539400108 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8fac10ea50 0x7f8fac0f7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:40:02.918 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.910 7f8faabaf700 1 --2- 172.21.15.22:0/1539400108 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8fac0f0b30 0x7f8fac0f0f80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f8fac10f170 tx=0x7f8f9400ba50).ready entity=mon.1 client_cookie=bed55599d47b5d74 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:40:02.918 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.910 7f8faa3ae700 1 -- 172.21.15.22:0/1539400108 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8fac0f83a0 con 0x7f8fac0f0b30 2022-04-28T14:40:02.918 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.910 7f8faa3ae700 1 -- 172.21.15.22:0/1539400108 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9400d570 con 0x7f8fac0f0b30 2022-04-28T14:40:02.918 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.910 7f8faa3ae700 1 -- 172.21.15.22:0/1539400108 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8f9400d940 con 0x7f8fac0f0b30 2022-04-28T14:40:02.918 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.910 7f8fb2718700 1 -- 172.21.15.22:0/1539400108 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8fac0f0b30 msgr2=0x7f8fac0f0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:40:02.918 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.910 7f8fb2718700 1 --2- 172.21.15.22:0/1539400108 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8fac0f0b30 0x7f8fac0f0f80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f8fac10f170 tx=0x7f8f9400ba50).stop 2022-04-28T14:40:02.918 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.911 7f8fb2718700 1 -- 172.21.15.22:0/1539400108 shutdown_connections 2022-04-28T14:40:02.918 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.911 7f8fb2718700 1 --2- 172.21.15.22:0/1539400108 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8fac10ea50 0x7f8fac0f7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:02.918 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.911 7f8fb2718700 1 --2- 172.21.15.22:0/1539400108 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8fac0f0b30 0x7f8fac0f0f80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:02.918 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.911 7f8fb2718700 1 -- 172.21.15.22:0/1539400108 >> 172.21.15.22:0/1539400108 conn(0x7f8fac1259c0 msgr2=0x7f8fac125e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:40:02.918 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.911 7f8fb2718700 1 -- 172.21.15.22:0/1539400108 shutdown_connections 2022-04-28T14:40:02.919 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.911 7f8fb2718700 1 -- 172.21.15.22:0/1539400108 wait complete. 2022-04-28T14:40:02.939 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.934 7f8fb2718700 1 Processor -- start 2022-04-28T14:40:02.939 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.935 7f8fb2718700 1 -- start start 2022-04-28T14:40:02.941 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.935 7f8fb2718700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8fac1b7200 0x7f8fac0dc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:40:02.941 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.935 7f8fb2718700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8fac0dcdd0 0x7f8fac1c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:40:02.941 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.935 7f8fb2718700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fac1c5ab0 0x7f8fac1c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:40:02.941 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.935 7f8fb2718700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac0f3a80 con 0x7f8fac1c5ab0 2022-04-28T14:40:02.941 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.935 7f8fb2718700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac1b7a60 con 0x7f8fac1b7200 2022-04-28T14:40:02.942 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.935 7f8fb2718700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac0e0320 con 0x7f8fac0dcdd0 2022-04-28T14:40:02.942 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.935 7f8fab3b0700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8fac1b7200 0x7f8fac0dc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:40:02.942 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.935 7f8fabbb1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fac1c5ab0 0x7f8fac1c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:40:02.942 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.935 7f8faabaf700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8fac0dcdd0 0x7f8fac1c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:40:02.942 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.935 7f8fab3b0700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8fac1b7200 0x7f8fac0dc7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:47118/0 (socket says 172.21.15.22:47118) 2022-04-28T14:40:02.942 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.935 7f8fab3b0700 1 -- 172.21.15.22:0/2177407627 learned_addr learned my addr 172.21.15.22:0/2177407627 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:40:02.942 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.935 7f8fab3b0700 1 -- 172.21.15.22:0/2177407627 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8fac0dcdd0 msgr2=0x7f8fac1c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:40:02.942 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.935 7f8fab3b0700 1 --2- 172.21.15.22:0/2177407627 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8fac0dcdd0 0x7f8fac1c5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:02.942 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.935 7f8fab3b0700 1 -- 172.21.15.22:0/2177407627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fac1c5ab0 msgr2=0x7f8fac1c5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:40:02.942 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.935 7f8fab3b0700 1 --2- 172.21.15.22:0/2177407627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fac1c5ab0 0x7f8fac1c5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:02.942 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.935 7f8fab3b0700 1 -- 172.21.15.22:0/2177407627 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fac0ce360 con 0x7f8fac1b7200 2022-04-28T14:40:02.943 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.935 7f8fabbb1700 1 --2- 172.21.15.22:0/2177407627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fac1c5ab0 0x7f8fac1c5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:40:02.943 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.936 7f8fab3b0700 1 --2- 172.21.15.22:0/2177407627 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8fac1b7200 0x7f8fac0dc7a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f8fac1b5c30 tx=0x7f8f9c00bf70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:40:02.943 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.936 7f8fa8bab700 1 -- 172.21.15.22:0/2177407627 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8fac0ce360 con 0x7f8fac1b7200 2022-04-28T14:40:02.943 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.936 7f8fa8bab700 1 -- 172.21.15.22:0/2177407627 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9c00c9a0 con 0x7f8fac1b7200 2022-04-28T14:40:02.943 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.936 7f8fb2718700 1 -- 172.21.15.22:0/2177407627 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fac0ce680 con 0x7f8fac1b7200 2022-04-28T14:40:02.943 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.936 7f8fa8bab700 1 -- 172.21.15.22:0/2177407627 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8f9c00f040 con 0x7f8fac1b7200 2022-04-28T14:40:02.943 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.936 7f8fb2718700 1 -- 172.21.15.22:0/2177407627 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fac0dfd60 con 0x7f8fac1b7200 2022-04-28T14:40:02.943 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.936 7f8fa8bab700 1 -- 172.21.15.22:0/2177407627 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 3) v1 ==== 22625+0+0 (secure 0 0 0) 0x7f8f9c011070 con 0x7f8fac1b7200 2022-04-28T14:40:02.943 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.937 7f8fa8bab700 1 -- 172.21.15.22:0/2177407627 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f8f9c010040 con 0x7f8fac1b7200 2022-04-28T14:40:02.945 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.939 7f8fc4f77b80 1 Processor -- start 2022-04-28T14:40:02.945 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.939 7f8fc4f77b80 1 -- start start 2022-04-28T14:40:02.945 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.940 7f8fc4f77b80 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x5559d8bf5430 0x5559d8c18610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:40:02.945 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.940 7f8fc4f77b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559d8c18c40 0x5559d8c24e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:40:02.945 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.940 7f8fc4f77b80 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x5559d8c19090 0x5559d8c25470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:40:02.946 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.940 7f8fc4f77b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559d8b35480 con 0x5559d8c18c40 2022-04-28T14:40:02.946 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.940 7f8fc4f77b80 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x5559d896a1e0 con 0x5559d8bf5430 2022-04-28T14:40:02.946 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.940 7f8fc4f77b80 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x5559d8b20360 con 0x5559d8c19090 2022-04-28T14:40:02.946 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.940 7f8fab3b0700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x5559d8bf5430 0x5559d8c18610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:40:02.946 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.940 7f8fab3b0700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x5559d8bf5430 0x5559d8c18610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:47126/0 (socket says 172.21.15.22:47126) 2022-04-28T14:40:02.946 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.940 7f8fab3b0700 1 -- 172.21.15.22:0/774953104 learned_addr learned my addr 172.21.15.22:0/774953104 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:40:02.946 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.940 7f8fabbb1700 1 --2- 172.21.15.22:0/774953104 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x5559d8c19090 0x5559d8c25470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:40:02.946 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.940 7f8faabaf700 1 --2- 172.21.15.22:0/774953104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559d8c18c40 0x5559d8c24e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:40:02.946 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.940 7f8fab3b0700 1 -- 172.21.15.22:0/774953104 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x5559d8c19090 msgr2=0x5559d8c25470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:40:02.946 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.940 7f8fab3b0700 1 --2- 172.21.15.22:0/774953104 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x5559d8c19090 0x5559d8c25470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:02.947 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.940 7f8fab3b0700 1 -- 172.21.15.22:0/774953104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559d8c18c40 msgr2=0x5559d8c24e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:40:02.947 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.940 7f8fab3b0700 1 --2- 172.21.15.22:0/774953104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559d8c18c40 0x5559d8c24e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:02.947 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.940 7f8fab3b0700 1 -- 172.21.15.22:0/774953104 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559d8a2cf30 con 0x5559d8bf5430 2022-04-28T14:40:02.947 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.940 7f8fab3b0700 1 --2- 172.21.15.22:0/774953104 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x5559d8bf5430 0x5559d8c18610 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x5559d8b4af70 tx=0x7f8f9c0086a0).ready entity=mon.1 client_cookie=ed8e0a645a64345c server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:40:02.947 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.940 7f8fb2718700 1 -- 172.21.15.22:0/774953104 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x5559d8a2cf30 con 0x5559d8bf5430 2022-04-28T14:40:02.947 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.940 7f8fb2718700 1 -- 172.21.15.22:0/774953104 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9c017d40 con 0x5559d8bf5430 2022-04-28T14:40:02.947 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.940 7f8fb2718700 1 -- 172.21.15.22:0/774953104 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x7f8fac0dfd60 con 0x5559d8bf5430 2022-04-28T14:40:02.947 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.940 7f8fc4f77b80 1 -- 172.21.15.22:0/774953104 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x5559d8bf5430 msgr2=0x5559d8c18610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:40:02.947 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.940 7f8fc4f77b80 1 --2- 172.21.15.22:0/774953104 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x5559d8bf5430 0x5559d8c18610 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x5559d8b4af70 tx=0x7f8f9c0086a0).stop 2022-04-28T14:40:02.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.941 7f8fc4f77b80 1 -- 172.21.15.22:0/774953104 shutdown_connections 2022-04-28T14:40:02.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.941 7f8fc4f77b80 1 --2- 172.21.15.22:0/774953104 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x5559d8c19090 0x5559d8c25470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:02.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.941 7f8fc4f77b80 1 --2- 172.21.15.22:0/774953104 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x5559d8bf5430 0x5559d8c18610 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:02.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.941 7f8fc4f77b80 1 --2- 172.21.15.22:0/774953104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559d8c18c40 0x5559d8c24e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:02.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.941 7f8fc4f77b80 1 -- 172.21.15.22:0/774953104 >> 172.21.15.22:0/774953104 conn(0x5559d8c1ab20 msgr2=0x5559d8bf63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:40:02.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.941 7f8fc4f77b80 1 -- 172.21.15.22:0/774953104 shutdown_connections 2022-04-28T14:40:02.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.941 7f8fc4f77b80 1 -- 172.21.15.22:0/774953104 wait complete. 2022-04-28T14:40:02.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.941 7f8fc4f77b80 1 -- start start 2022-04-28T14:40:02.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.942 7f8fc4f77b80 1 Processor -- start 2022-04-28T14:40:02.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.942 7f8fc4f77b80 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x5559d8bfe070 0x5559d8c0bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:40:02.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.942 7f8fc4f77b80 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x5559d8bfe4c0 0x5559d8c1b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:40:02.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.942 7f8fc4f77b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559d8c1bca0 0x5559d8c1c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:40:02.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.942 7f8fc4f77b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x5559d8b1cf10 con 0x5559d8c1bca0 2022-04-28T14:40:02.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.942 7f8fc4f77b80 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x5559d8bfd890 con 0x5559d8bfe4c0 2022-04-28T14:40:02.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.942 7f8fc4f77b80 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x5559d8c0df30 con 0x5559d8bfe070 2022-04-28T14:40:02.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.942 7f8fc4f77b80 10 client.0 ll_register_callbacks cb 0x5559d8b78d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-04-28T14:40:02.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.942 7f8faabaf700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x5559d8bfe4c0 0x5559d8c1b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:40:02.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.942 7f8faabaf700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x5559d8bfe4c0 0x5559d8c1b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:47134/0 (socket says 172.21.15.22:47134) 2022-04-28T14:40:02.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.942 7f8fabbb1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559d8c1bca0 0x5559d8c1c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:40:02.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.942 7f8faabaf700 1 -- 172.21.15.22:0/2267602035 learned_addr learned my addr 172.21.15.22:0/2267602035 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:40:02.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.942 7f8fab3b0700 1 --2- 172.21.15.22:0/2267602035 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x5559d8bfe070 0x5559d8c0bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:40:02.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.943 7f8fabbb1700 1 -- 172.21.15.22:0/2267602035 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x5559d8bfe070 msgr2=0x5559d8c0bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:40:02.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.943 7f8fabbb1700 1 --2- 172.21.15.22:0/2267602035 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x5559d8bfe070 0x5559d8c0bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:02.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.943 7f8fabbb1700 1 -- 172.21.15.22:0/2267602035 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x5559d8bfe4c0 msgr2=0x5559d8c1b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:40:02.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.943 7f8fabbb1700 1 --2- 172.21.15.22:0/2267602035 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x5559d8bfe4c0 0x5559d8c1b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:02.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.943 7f8fabbb1700 1 -- 172.21.15.22:0/2267602035 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5559d8c0dc10 con 0x5559d8c1bca0 2022-04-28T14:40:02.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.943 7f8fab3b0700 1 --2- 172.21.15.22:0/2267602035 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x5559d8bfe070 0x5559d8c0bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:40:02.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.943 7f8faabaf700 1 --2- 172.21.15.22:0/2267602035 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x5559d8bfe4c0 0x5559d8c1b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:40:02.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.943 7f8fabbb1700 1 --2- 172.21.15.22:0/2267602035 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559d8c1bca0 0x5559d8c1c0f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x5559d8c176c0 tx=0x7f8fa40073a0).ready entity=mon.0 client_cookie=a7c4b663a8345c8a server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:40:02.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.943 7f8f8a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2022-04-28T14:40:02.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.943 7f8f8a7fc700 1 -- 172.21.15.22:0/2267602035 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 377+0+0 (secure 0 0 0) 0x5559d8c0dc10 con 0x5559d8c1bca0 2022-04-28T14:40:02.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.943 7f8f8a7fc700 1 -- 172.21.15.22:0/2267602035 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f8fa4011040 con 0x5559d8c1bca0 2022-04-28T14:40:02.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.943 7f8fc4f77b80 1 -- 172.21.15.22:0/2267602035 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5559d8b49630 con 0x5559d8c1bca0 2022-04-28T14:40:02.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.943 7f8f8a7fc700 1 -- 172.21.15.22:0/2267602035 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fa4014750 con 0x5559d8c1bca0 2022-04-28T14:40:02.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.943 7f8fc4f77b80 10 client.4749 fetch_fsmap learned FSMap version 13 2022-04-28T14:40:02.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.943 7f8fc4f77b80 1 -- 172.21.15.22:0/2267602035 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x5559d8c1c720 con 0x5559d8c1bca0 2022-04-28T14:40:02.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.943 7f8f8a7fc700 1 -- 172.21.15.22:0/2267602035 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5559d8b49630 con 0x5559d8c1bca0 2022-04-28T14:40:02.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.943 7f8f8a7fc700 1 -- 172.21.15.22:0/2267602035 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 13) v1 ==== 1181+0+0 (secure 0 0 0) 0x7f8fa401e3d0 con 0x5559d8c1bca0 2022-04-28T14:40:02.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.943 7f8fc4f77b80 10 client.4749 fetch_fsmap finished waiting for FSMap version 13 2022-04-28T14:40:02.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.943 7f8fc4f77b80 10 client.4749 resolve_mds: resolved ID 'c' to GID 4184 2022-04-28T14:40:02.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.943 7f8fc4f77b80 20 client.4749 populate_metadata read hostname 'smithi022' 2022-04-28T14:40:02.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.943 7f8fc4f77b80 4 client.4749 mds_command: new command op to 4184 tid=0[{"prefix": "get_command_descriptions"}] 2022-04-28T14:40:02.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.943 7f8fc4f77b80 1 -- 172.21.15.22:0/2267602035 --> v1:172.21.15.22:6819/356491488 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5559d8a55d50 con 0x5559d8c3cf70 2022-04-28T14:40:02.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.944 7f8f8a7fc700 10 client.4749 ms_handle_connect on v1:172.21.15.22:6819/356491488 2022-04-28T14:40:02.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.944 7f8f8a7fc700 1 -- 172.21.15.22:0/2267602035 <== mds.0 v1:172.21.15.22:6819/356491488 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3729 (unknown 0 0 338808096) 0x5559d8a55d50 con 0x5559d8c3cf70 2022-04-28T14:40:02.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.944 7f8f8a7fc700 10 client.4749 handle_command_reply: tid=0 2022-04-28T14:40:02.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.944 7f8fc4f77b80 1 client.4749 shutdown 2022-04-28T14:40:02.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.944 7f8fc4f77b80 1 -- 172.21.15.22:0/2267602035 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559d8c1bca0 msgr2=0x5559d8c1c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:40:02.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.944 7f8fc4f77b80 1 --2- 172.21.15.22:0/2267602035 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559d8c1bca0 0x5559d8c1c0f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x5559d8c176c0 tx=0x7f8fa40073a0).stop 2022-04-28T14:40:02.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.944 7f8fc4f77b80 1 -- 172.21.15.22:0/2267602035 shutdown_connections 2022-04-28T14:40:02.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.944 7f8fc4f77b80 1 --2- 172.21.15.22:0/2267602035 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5559d8c1bca0 0x5559d8c1c0f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:02.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.944 7f8fc4f77b80 1 --2- 172.21.15.22:0/2267602035 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x5559d8bfe070 0x5559d8c0bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:02.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.944 7f8f8a7fc700 0 client.4749 ms_handle_reset on v1:172.21.15.22:6819/356491488 2022-04-28T14:40:02.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.944 7f8fc4f77b80 1 --2- 172.21.15.22:0/2267602035 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x5559d8bfe4c0 0x5559d8c1b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:02.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.944 7f8fc4f77b80 1 -- 172.21.15.22:0/2267602035 >> 172.21.15.22:0/2267602035 conn(0x5559d8bf6f40 msgr2=0x5559d8c1aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:40:02.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.944 7f8fc4f77b80 1 -- 172.21.15.22:0/2267602035 shutdown_connections 2022-04-28T14:40:02.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.944 7f8fc4f77b80 1 -- 172.21.15.22:0/2267602035 wait complete. 2022-04-28T14:40:02.958 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.944 7f8fc4f77b80 20 client.4749 trim_cache size 0 max 16384 2022-04-28T14:40:02.959 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.954 7f8fa0ca4700 1 -- 172.21.15.22:0/2177407627 >> v1:172.21.15.22:6808/86956 conn(0x7f8f9001c1b0 legacy=0x7f8f9001e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:40:02.959 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.954 7f8fa0ca4700 1 -- 172.21.15.22:0/2177407627 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8fac1b7200 msgr2=0x7f8fac0dc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:40:02.960 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.954 7f8fa0ca4700 1 --2- 172.21.15.22:0/2177407627 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8fac1b7200 0x7f8fac0dc7a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f8fac1b5c30 tx=0x7f8f9c00bf70).stop 2022-04-28T14:40:02.960 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.954 7f8fa0ca4700 1 -- 172.21.15.22:0/2177407627 shutdown_connections 2022-04-28T14:40:02.960 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.954 7f8fa0ca4700 1 --2- 172.21.15.22:0/2177407627 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fac1c5ab0 0x7f8fac1c5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:02.960 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.954 7f8fa0ca4700 1 --2- 172.21.15.22:0/2177407627 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8fac1b7200 0x7f8fac0dc7a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:02.960 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.954 7f8fa0ca4700 1 --2- 172.21.15.22:0/2177407627 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8fac0dcdd0 0x7f8fac1c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:40:02.960 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.954 7f8fa0ca4700 1 -- 172.21.15.22:0/2177407627 >> 172.21.15.22:0/2177407627 conn(0x7f8fac0d14d0 msgr2=0x7f8fac0ddb00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:40:02.960 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.954 7f8fa0ca4700 1 -- 172.21.15.22:0/2177407627 shutdown_connections 2022-04-28T14:40:02.960 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28 14:40:02.954 7f8fa0ca4700 1 -- 172.21.15.22:0/2177407627 wait complete. 2022-04-28T14:40:02.961 INFO:teuthology.orchestra.run.smithi022.stderr:no valid command found; 10 closest matches: 2022-04-28T14:40:02.961 INFO:teuthology.orchestra.run.smithi022.stderr:injectargs [...] 2022-04-28T14:40:02.961 INFO:teuthology.orchestra.run.smithi022.stderr:config set 2022-04-28T14:40:02.961 INFO:teuthology.orchestra.run.smithi022.stderr:config unset 2022-04-28T14:40:02.961 INFO:teuthology.orchestra.run.smithi022.stderr:exit 2022-04-28T14:40:02.961 INFO:teuthology.orchestra.run.smithi022.stderr:respawn 2022-04-28T14:40:02.961 INFO:teuthology.orchestra.run.smithi022.stderr:session kill 2022-04-28T14:40:02.961 INFO:teuthology.orchestra.run.smithi022.stderr:cpu_profiler status|flush 2022-04-28T14:40:02.961 INFO:teuthology.orchestra.run.smithi022.stderr:session ls { [...]} 2022-04-28T14:40:02.961 INFO:teuthology.orchestra.run.smithi022.stderr:client ls { [...]} 2022-04-28T14:40:02.962 INFO:teuthology.orchestra.run.smithi022.stderr:session evict { [...]} 2022-04-28T14:40:02.962 INFO:teuthology.orchestra.run.smithi022.stderr:Error EINVAL: invalid command 2022-04-28T14:40:02.969 DEBUG:teuthology.orchestra.run:got remote process result: 22 2022-04-28T14:40:02.970 INFO:teuthology.run_tasks:Running task print... 2022-04-28T14:40:02.982 INFO:teuthology.task.print:**** done mds pre-upgrade sequence 2022-04-28T14:40:02.982 INFO:teuthology.run_tasks:Running task install.upgrade... 2022-04-28T14:40:03.011 INFO:teuthology.task.install:project ceph config {'mon.a': None, 'mon.b': None} overrides {'flavor': 'default', 'sha1': '4fa079ba14503defa8dc257d7c2d506ebefcfe6d'} 2022-04-28T14:40:03.011 WARNING:teuthology.task.install:remote ubuntu@smithi022.front.sepia.ceph.com came up twice (role mon.b) 2022-04-28T14:40:03.011 INFO:teuthology.task.install:remote ubuntu@smithi022.front.sepia.ceph.com config {'flavor': 'default', 'sha1': '4fa079ba14503defa8dc257d7c2d506ebefcfe6d'} 2022-04-28T14:40:03.011 INFO:teuthology.task.install:extra packages: [] 2022-04-28T14:40:03.012 DEBUG:teuthology.orchestra.run.smithi022:> sudo lsb_release -is 2022-04-28T14:40:03.047 INFO:teuthology.orchestra.run.smithi022.stdout:CentOSStream 2022-04-28T14:40:03.049 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-04-28T14:40:03.055 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2022-04-28T14:40:03.055 INFO:teuthology.task.install:Upgrading ceph rpm packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd 2022-04-28T14:40:03.055 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q ceph-common --qf '%{VERSION}-%{RELEASE}' 2022-04-28T14:40:03.111 INFO:teuthology.orchestra.run.smithi022.stdout:14.2.22-0.el8 2022-04-28T14:40:03.111 INFO:teuthology.packaging:The installed version of ceph-common is 14.2.22-0.el8 2022-04-28T14:40:03.111 DEBUG:teuthology.orchestra.run.smithi022:> sudo lsb_release -is 2022-04-28T14:40:03.187 INFO:teuthology.orchestra.run.smithi022.stdout:CentOSStream 2022-04-28T14:40:03.189 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-04-28T14:40:03.189 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4fa079ba14503defa8dc257d7c2d506ebefcfe6d 2022-04-28T14:40:03.341 INFO:teuthology.task.install:Ceph rpm upgrade from 14.2.22-0.el8 to 16.2.7-969.g4fa079ba 2022-04-28T14:40:03.341 DEBUG:teuthology.orchestra.run.smithi022:> sudo lsb_release -is 2022-04-28T14:40:03.378 INFO:teuthology.orchestra.run.smithi022.stdout:CentOSStream 2022-04-28T14:40:03.379 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-04-28T14:40:03.379 INFO:teuthology.task.install.rpm:Host smithi022 is: centos 8 x86_64 2022-04-28T14:40:03.380 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4fa079ba14503defa8dc257d7c2d506ebefcfe6d 2022-04-28T14:40:03.543 INFO:teuthology.task.install.rpm:Repo base URL: https://1.chacra.ceph.com/r/ceph/pacific/4fa079ba14503defa8dc257d7c2d506ebefcfe6d/centos/8/flavors/default/ 2022-04-28T14:40:03.543 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f /etc/yum.repos.d/ceph.repo 2022-04-28T14:40:03.688 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/pacific/4fa079ba14503defa8dc257d7c2d506ebefcfe6d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/pacific/4fa079ba14503defa8dc257d7c2d506ebefcfe6d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/pacific/4fa079ba14503defa8dc257d7c2d506ebefcfe6d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-04-28T14:40:03.688 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2022-04-28T14:40:03.688 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-04-28T14:40:03.716 DEBUG:teuthology.orchestra.run.smithi022:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4fa079ba14503defa8dc257d7c2d506ebefcfe6d/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-04-28T14:40:03.786 DEBUG:teuthology.orchestra.run.smithi022:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-04-28T14:40:03.854 DEBUG:teuthology.orchestra.run.smithi022:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-04-28T14:40:03.911 INFO:teuthology.orchestra.run.smithi022.stdout:check_obsoletes = 1 2022-04-28T14:40:03.923 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum clean all 2022-04-28T14:40:04.172 INFO:teuthology.orchestra.run.smithi022.stdout:65 files removed 2022-04-28T14:40:04.192 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd 2022-04-28T14:40:04.832 INFO:teuthology.orchestra.run.smithi022.stdout:ceph packages for x86_64 268 kB/s | 76 kB 00:00 2022-04-28T14:40:05.125 INFO:teuthology.orchestra.run.smithi022.stdout:ceph noarch packages 59 kB/s | 15 kB 00:00 2022-04-28T14:40:05.409 INFO:teuthology.orchestra.run.smithi022.stdout:ceph source packages 5.6 kB/s | 1.4 kB 00:00 2022-04-28T14:40:06.036 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-8 - AppStream 36 MB/s | 21 MB 00:00 2022-04-28T14:40:10.595 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-8 - Base 36 MB/s | 22 MB 00:00 2022-04-28T14:40:14.044 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-8 - Extras 154 kB/s | 18 kB 00:00 2022-04-28T14:40:14.421 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-8 - PowerTools 18 MB/s | 4.5 MB 00:00 2022-04-28T14:40:15.487 INFO:teuthology.orchestra.run.smithi022.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2022-04-28T14:40:16.821 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 9.1 MB/s | 11 MB 00:01 2022-04-28T14:40:19.571 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 552 kB/s | 24 kB 00:00 2022-04-28T14:40:22.375 INFO:teuthology.orchestra.run.smithi022.stderr:Package cephadm available, but not installed. 2022-04-28T14:40:22.376 INFO:teuthology.orchestra.run.smithi022.stdout:No match for argument: cephadm 2022-04-28T14:40:22.376 INFO:teuthology.orchestra.run.smithi022.stderr:Package ceph-immutable-object-cache available, but not installed. 2022-04-28T14:40:22.376 INFO:teuthology.orchestra.run.smithi022.stdout:No match for argument: ceph-immutable-object-cache 2022-04-28T14:40:22.379 INFO:teuthology.orchestra.run.smithi022.stderr:Package ceph-mgr-dashboard available, but not installed. 2022-04-28T14:40:22.379 INFO:teuthology.orchestra.run.smithi022.stdout:No match for argument: ceph-mgr-dashboard 2022-04-28T14:40:22.379 INFO:teuthology.orchestra.run.smithi022.stderr:Package ceph-mgr-diskprediction-local available, but not installed. 2022-04-28T14:40:22.380 INFO:teuthology.orchestra.run.smithi022.stdout:No match for argument: ceph-mgr-diskprediction-local 2022-04-28T14:40:22.380 INFO:teuthology.orchestra.run.smithi022.stderr:Package ceph-mgr-rook available, but not installed. 2022-04-28T14:40:22.380 INFO:teuthology.orchestra.run.smithi022.stdout:No match for argument: ceph-mgr-rook 2022-04-28T14:40:22.381 INFO:teuthology.orchestra.run.smithi022.stderr:Package ceph-mgr-cephadm available, but not installed. 2022-04-28T14:40:22.381 INFO:teuthology.orchestra.run.smithi022.stdout:No match for argument: ceph-mgr-cephadm 2022-04-28T14:40:22.499 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2022-04-28T14:40:22.503 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:40:22.504 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2022-04-28T14:40:22.504 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:40:22.504 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrading: 2022-04-28T14:40:22.504 INFO:teuthology.orchestra.run.smithi022.stdout: ceph x86_64 2:16.2.7-969.g4fa079ba.el8 ceph 6.4 k 2022-04-28T14:40:22.504 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base x86_64 2:16.2.7-969.g4fa079ba.el8 ceph 6.0 M 2022-04-28T14:40:22.504 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common x86_64 2:16.2.7-969.g4fa079ba.el8 ceph 24 M 2022-04-28T14:40:22.504 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse x86_64 2:16.2.7-969.g4fa079ba.el8 ceph 901 k 2022-04-28T14:40:22.504 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds x86_64 2:16.2.7-969.g4fa079ba.el8 ceph 2.4 M 2022-04-28T14:40:22.505 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr x86_64 2:16.2.7-969.g4fa079ba.el8 ceph 1.6 M 2022-04-28T14:40:22.505 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon x86_64 2:16.2.7-969.g4fa079ba.el8 ceph 5.0 M 2022-04-28T14:40:22.505 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd x86_64 2:16.2.7-969.g4fa079ba.el8 ceph 18 M 2022-04-28T14:40:22.505 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw x86_64 2:16.2.7-969.g4fa079ba.el8 ceph 12 M 2022-04-28T14:40:22.505 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux x86_64 2:16.2.7-969.g4fa079ba.el8 ceph 26 k 2022-04-28T14:40:22.505 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test x86_64 2:16.2.7-969.g4fa079ba.el8 ceph 52 M 2022-04-28T14:40:22.505 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel x86_64 2:16.2.7-969.g4fa079ba.el8 ceph 25 k 2022-04-28T14:40:22.505 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2 x86_64 2:16.2.7-969.g4fa079ba.el8 ceph 816 k 2022-04-28T14:40:22.505 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel x86_64 2:16.2.7-969.g4fa079ba.el8 ceph 131 k 2022-04-28T14:40:22.505 INFO:teuthology.orchestra.run.smithi022.stdout: librados2 x86_64 2:16.2.7-969.g4fa079ba.el8 ceph 3.7 M 2022-04-28T14:40:22.506 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1 x86_64 2:16.2.7-969.g4fa079ba.el8 ceph 492 k 2022-04-28T14:40:22.506 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1 x86_64 2:16.2.7-969.g4fa079ba.el8 ceph 4.2 M 2022-04-28T14:40:22.506 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2 x86_64 2:16.2.7-969.g4fa079ba.el8 ceph 3.8 M 2022-04-28T14:40:22.506 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse x86_64 2:16.2.7-969.g4fa079ba.el8 ceph 45 k 2022-04-28T14:40:22.506 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs x86_64 2:16.2.7-969.g4fa079ba.el8 ceph 214 k 2022-04-28T14:40:22.506 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados x86_64 2:16.2.7-969.g4fa079ba.el8 ceph 387 k 2022-04-28T14:40:22.506 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd x86_64 2:16.2.7-969.g4fa079ba.el8 ceph 368 k 2022-04-28T14:40:22.506 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw x86_64 2:16.2.7-969.g4fa079ba.el8 ceph 114 k 2022-04-28T14:40:22.506 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse x86_64 2:16.2.7-969.g4fa079ba.el8 ceph 88 k 2022-04-28T14:40:22.506 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror x86_64 2:16.2.7-969.g4fa079ba.el8 ceph 3.7 M 2022-04-28T14:40:22.507 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd x86_64 2:16.2.7-969.g4fa079ba.el8 ceph 173 k 2022-04-28T14:40:22.507 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2022-04-28T14:40:22.507 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core noarch 2:16.2.7-969.g4fa079ba.el8 ceph-noarch 237 k 2022-04-28T14:40:22.507 INFO:teuthology.orchestra.run.smithi022.stdout: libcephsqlite x86_64 2:16.2.7-969.g4fa079ba.el8 ceph 173 k 2022-04-28T14:40:22.507 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common x86_64 2:16.2.7-969.g4fa079ba.el8 ceph 93 k 2022-04-28T14:40:22.507 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:40:22.507 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2022-04-28T14:40:22.507 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2022-04-28T14:40:22.507 INFO:teuthology.orchestra.run.smithi022.stdout:Install 3 Packages 2022-04-28T14:40:22.508 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrade 26 Packages 2022-04-28T14:40:22.508 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:40:22.508 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 140 M 2022-04-28T14:40:22.508 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2022-04-28T14:40:22.697 INFO:teuthology.orchestra.run.smithi022.stdout:(1/29): python3-ceph-common-16.2.7-969.g4fa079b 498 kB/s | 93 kB 00:00 2022-04-28T14:40:22.723 INFO:teuthology.orchestra.run.smithi022.stdout:(2/29): libcephsqlite-16.2.7-969.g4fa079ba.el8. 813 kB/s | 173 kB 00:00 2022-04-28T14:40:22.748 INFO:teuthology.orchestra.run.smithi022.stdout:(3/29): ceph-16.2.7-969.g4fa079ba.el8.x86_64.rp 128 kB/s | 6.4 kB 00:00 2022-04-28T14:40:22.773 INFO:teuthology.orchestra.run.smithi022.stdout:(4/29): ceph-mgr-modules-core-16.2.7-969.g4fa07 899 kB/s | 237 kB 00:00 2022-04-28T14:40:22.923 INFO:teuthology.orchestra.run.smithi022.stdout:(5/29): ceph-fuse-16.2.7-969.g4fa079ba.el8.x86_ 5.9 MB/s | 901 kB 00:00 2022-04-28T14:40:23.282 INFO:teuthology.orchestra.run.smithi022.stdout:(6/29): ceph-mds-16.2.7-969.g4fa079ba.el8.x86_6 6.8 MB/s | 2.4 MB 00:00 2022-04-28T14:40:23.374 INFO:teuthology.orchestra.run.smithi022.stdout:(7/29): ceph-base-16.2.7-969.g4fa079ba.el8.x86_ 9.3 MB/s | 6.0 MB 00:00 2022-04-28T14:40:23.541 INFO:teuthology.orchestra.run.smithi022.stdout:(8/29): ceph-mgr-16.2.7-969.g4fa079ba.el8.x86_6 6.2 MB/s | 1.6 MB 00:00 2022-04-28T14:40:23.941 INFO:teuthology.orchestra.run.smithi022.stdout:(9/29): ceph-mon-16.2.7-969.g4fa079ba.el8.x86_6 8.8 MB/s | 5.0 MB 00:00 2022-04-28T14:40:25.008 INFO:teuthology.orchestra.run.smithi022.stdout:(10/29): ceph-common-16.2.7-969.g4fa079ba.el8.x 11 MB/s | 24 MB 00:02 2022-04-28T14:40:25.067 INFO:teuthology.orchestra.run.smithi022.stdout:(11/29): ceph-selinux-16.2.7-969.g4fa079ba.el8. 440 kB/s | 26 kB 00:00 2022-04-28T14:40:25.250 INFO:teuthology.orchestra.run.smithi022.stdout:(12/29): ceph-radosgw-16.2.7-969.g4fa079ba.el8. 8.8 MB/s | 12 MB 00:01 2022-04-28T14:40:25.334 INFO:teuthology.orchestra.run.smithi022.stdout:(13/29): libcephfs-devel-16.2.7-969.g4fa079ba.e 301 kB/s | 25 kB 00:00 2022-04-28T14:40:25.484 INFO:teuthology.orchestra.run.smithi022.stdout:(14/29): libcephfs2-16.2.7-969.g4fa079ba.el8.x8 5.3 MB/s | 816 kB 00:00 2022-04-28T14:40:25.659 INFO:teuthology.orchestra.run.smithi022.stdout:(15/29): ceph-osd-16.2.7-969.g4fa079ba.el8.x86_ 8.6 MB/s | 18 MB 00:02 2022-04-28T14:40:25.684 INFO:teuthology.orchestra.run.smithi022.stdout:(16/29): librados-devel-16.2.7-969.g4fa079ba.el 655 kB/s | 131 kB 00:00 2022-04-28T14:40:25.751 INFO:teuthology.orchestra.run.smithi022.stdout:(17/29): libradosstriper1-16.2.7-969.g4fa079ba. 7.2 MB/s | 492 kB 00:00 2022-04-28T14:40:26.127 INFO:teuthology.orchestra.run.smithi022.stdout:(18/29): librados2-16.2.7-969.g4fa079ba.el8.x86 8.0 MB/s | 3.7 MB 00:00 2022-04-28T14:40:26.302 INFO:teuthology.orchestra.run.smithi022.stdout:(19/29): librbd1-16.2.7-969.g4fa079ba.el8.x86_6 7.6 MB/s | 4.2 MB 00:00 2022-04-28T14:40:26.386 INFO:teuthology.orchestra.run.smithi022.stdout:(20/29): python3-ceph-argparse-16.2.7-969.g4fa0 540 kB/s | 45 kB 00:00 2022-04-28T14:40:26.469 INFO:teuthology.orchestra.run.smithi022.stdout:(21/29): python3-cephfs-16.2.7-969.g4fa079ba.el 2.5 MB/s | 214 kB 00:00 2022-04-28T14:40:26.553 INFO:teuthology.orchestra.run.smithi022.stdout:(22/29): librgw2-16.2.7-969.g4fa079ba.el8.x86_6 8.8 MB/s | 3.8 MB 00:00 2022-04-28T14:40:26.578 INFO:teuthology.orchestra.run.smithi022.stdout:(23/29): python3-rados-16.2.7-969.g4fa079ba.el8 3.5 MB/s | 387 kB 00:00 2022-04-28T14:40:26.637 INFO:teuthology.orchestra.run.smithi022.stdout:(24/29): python3-rbd-16.2.7-969.g4fa079ba.el8.x 4.3 MB/s | 368 kB 00:00 2022-04-28T14:40:26.662 INFO:teuthology.orchestra.run.smithi022.stdout:(25/29): python3-rgw-16.2.7-969.g4fa079ba.el8.x 1.3 MB/s | 114 kB 00:00 2022-04-28T14:40:26.704 INFO:teuthology.orchestra.run.smithi022.stdout:(26/29): rbd-fuse-16.2.7-969.g4fa079ba.el8.x86_ 1.3 MB/s | 88 kB 00:00 2022-04-28T14:40:26.796 INFO:teuthology.orchestra.run.smithi022.stdout:(27/29): rbd-nbd-16.2.7-969.g4fa079ba.el8.x86_6 1.8 MB/s | 173 kB 00:00 2022-04-28T14:40:27.063 INFO:teuthology.orchestra.run.smithi022.stdout:(28/29): rbd-mirror-16.2.7-969.g4fa079ba.el8.x8 9.2 MB/s | 3.7 MB 00:00 2022-04-28T14:40:28.221 INFO:teuthology.orchestra.run.smithi022.stdout:(29/29): ceph-test-16.2.7-969.g4fa079ba.el8.x86 16 MB/s | 52 MB 00:03 2022-04-28T14:40:28.224 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2022-04-28T14:40:28.224 INFO:teuthology.orchestra.run.smithi022.stdout:Total 24 MB/s | 140 MB 00:05 2022-04-28T14:40:28.225 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2022-04-28T14:40:28.292 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2022-04-28T14:40:28.292 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2022-04-28T14:40:28.944 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2022-04-28T14:40:28.947 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2022-04-28T14:40:30.860 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2022-04-28T14:40:31.231 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:16.2.7-969.g4fa079ba.el8.x86_64 1/1 2022-04-28T14:40:31.404 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librados2-2:16.2.7-969.g4fa079ba.el8.x86_64 1/55 2022-04-28T14:40:31.851 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:16.2.7-969.g4fa079ba.el8.x86_64 1/55 2022-04-28T14:40:32.061 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librbd1-2:16.2.7-969.g4fa079ba.el8.x86_64 2/55 2022-04-28T14:40:32.178 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:16.2.7-969.g4fa079ba.el8.x86_64 2/55 2022-04-28T14:40:32.378 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : libcephfs2-2:16.2.7-969.g4fa079ba.el8.x86_64 3/55 2022-04-28T14:40:32.809 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephfs2-2:16.2.7-969.g4fa079ba.el8.x86_64 3/55 2022-04-28T14:40:33.037 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librgw2-2:16.2.7-969.g4fa079ba.el8.x86_64 4/55 2022-04-28T14:40:33.133 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librgw2-2:16.2.7-969.g4fa079ba.el8.x86_64 4/55 2022-04-28T14:40:33.336 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : python3-rados-2:16.2.7-969.g4fa079ba.el8.x86_64 5/55 2022-04-28T14:40:33.495 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephsqlite-2:16.2.7-969.g4fa079ba.el8.x86_64 6/55 2022-04-28T14:40:33.601 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephsqlite-2:16.2.7-969.g4fa079ba.el8.x86_64 6/55 2022-04-28T14:40:33.794 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : libradosstriper1-2:16.2.7-969.g4fa079ba.el8.x86_64 7/55 2022-04-28T14:40:33.863 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libradosstriper1-2:16.2.7-969.g4fa079ba.el8.x86_64 7/55 2022-04-28T14:40:34.045 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : python3-ceph-argparse-2:16.2.7-969.g4fa079ba.el8.x 8/55 2022-04-28T14:40:34.244 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-common-2:16.2.7-969.g4fa079ba.el8.x86 9/55 2022-04-28T14:40:34.475 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : python3-cephfs-2:16.2.7-969.g4fa079ba.el8.x86_64 10/55 2022-04-28T14:40:34.700 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : python3-rbd-2:16.2.7-969.g4fa079ba.el8.x86_64 11/55 2022-04-28T14:40:34.879 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : python3-rgw-2:16.2.7-969.g4fa079ba.el8.x86_64 12/55 2022-04-28T14:40:37.231 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:16.2.7-969.g4fa079ba.el8.x86_64 13/55 2022-04-28T14:40:37.593 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : ceph-common-2:16.2.7-969.g4fa079ba.el8.x86_64 13/55 2022-04-28T14:40:38.378 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:16.2.7-969.g4fa079ba.el8.x86_64 13/55 2022-04-28T14:40:38.689 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : ceph-base-2:16.2.7-969.g4fa079ba.el8.x86_64 14/55 2022-04-28T14:40:38.738 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-base-2:16.2.7-969.g4fa079ba.el8.x86_64 14/55 2022-04-28T14:40:38.894 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : ceph-selinux-2:16.2.7-969.g4fa079ba.el8.x86_64 15/55 2022-04-28T14:40:56.866 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-selinux-2:16.2.7-969.g4fa079ba.el8.x86_64 15/55 2022-04-28T14:40:57.050 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : ceph-mds-2:16.2.7-969.g4fa079ba.el8.x86_64 16/55 2022-04-28T14:40:57.564 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mds-2:16.2.7-969.g4fa079ba.el8.x86_64 16/55 2022-04-28T14:40:57.766 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : ceph-mon-2:16.2.7-969.g4fa079ba.el8.x86_64 17/55 2022-04-28T14:40:59.607 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mon-2:16.2.7-969.g4fa079ba.el8.x86_64 17/55 2022-04-28T14:40:59.849 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : ceph-osd-2:16.2.7-969.g4fa079ba.el8.x86_64 18/55 2022-04-28T14:40:59.875 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-osd-2:16.2.7-969.g4fa079ba.el8.x86_64 18/55 2022-04-28T14:41:00.159 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librados-devel-2:16.2.7-969.g4fa079ba.el8.x86_64 19/55 2022-04-28T14:41:00.535 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-modules-core-2:16.2.7-969.g4fa079ba.el8.n 20/55 2022-04-28T14:41:00.819 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : ceph-mgr-2:16.2.7-969.g4fa079ba.el8.x86_64 21/55 2022-04-28T14:41:00.824 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-2:16.2.7-969.g4fa079ba.el8.x86_64 21/55 2022-04-28T14:41:00.944 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : ceph-2:16.2.7-969.g4fa079ba.el8.x86_64 22/55 2022-04-28T14:41:02.167 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : libcephfs-devel-2:16.2.7-969.g4fa079ba.el8.x86_64 23/55 2022-04-28T14:41:02.385 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : ceph-radosgw-2:16.2.7-969.g4fa079ba.el8.x86_64 24/55 2022-04-28T14:41:02.867 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-radosgw-2:16.2.7-969.g4fa079ba.el8.x86_64 24/55 2022-04-28T14:41:03.099 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : rbd-mirror-2:16.2.7-969.g4fa079ba.el8.x86_64 25/55 2022-04-28T14:41:08.235 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-mirror-2:16.2.7-969.g4fa079ba.el8.x86_64 25/55 2022-04-28T14:41:08.556 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : ceph-test-2:16.2.7-969.g4fa079ba.el8.x86_64 26/55 2022-04-28T14:41:08.731 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : rbd-fuse-2:16.2.7-969.g4fa079ba.el8.x86_64 27/55 2022-04-28T14:41:08.994 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : rbd-nbd-2:16.2.7-969.g4fa079ba.el8.x86_64 28/55 2022-04-28T14:41:09.224 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : ceph-fuse-2:16.2.7-969.g4fa079ba.el8.x86_64 29/55 2022-04-28T14:41:09.323 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : ceph-2:14.2.22-0.el8.x86_64 30/55 2022-04-28T14:41:09.507 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : ceph-test-2:14.2.22-0.el8.x86_64 31/55 2022-04-28T14:41:09.514 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-radosgw-2:14.2.22-0.el8.x86_64 32/55 2022-04-28T14:41:09.515 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : ceph-radosgw-2:14.2.22-0.el8.x86_64 32/55 2022-04-28T14:41:09.685 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-radosgw-2:14.2.22-0.el8.x86_64 32/55 2022-04-28T14:41:09.807 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : libcephfs-devel-2:14.2.22-0.el8.x86_64 33/55 2022-04-28T14:41:09.998 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : rbd-nbd-2:14.2.22-0.el8.x86_64 34/55 2022-04-28T14:41:10.005 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-mirror-2:14.2.22-0.el8.x86_64 35/55 2022-04-28T14:41:10.006 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : rbd-mirror-2:14.2.22-0.el8.x86_64 35/55 2022-04-28T14:41:10.157 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-mirror-2:14.2.22-0.el8.x86_64 35/55 2022-04-28T14:41:10.315 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : rbd-fuse-2:14.2.22-0.el8.x86_64 36/55 2022-04-28T14:41:10.440 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librados-devel-2:14.2.22-0.el8.x86_64 37/55 2022-04-28T14:41:10.447 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mds-2:14.2.22-0.el8.x86_64 38/55 2022-04-28T14:41:10.447 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : ceph-mds-2:14.2.22-0.el8.x86_64 38/55 2022-04-28T14:41:10.608 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mds-2:14.2.22-0.el8.x86_64 38/55 2022-04-28T14:41:10.619 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-2:14.2.22-0.el8.x86_64 39/55 2022-04-28T14:41:10.620 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : ceph-mgr-2:14.2.22-0.el8.x86_64 39/55 2022-04-28T14:41:10.827 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-2:14.2.22-0.el8.x86_64 39/55 2022-04-28T14:41:10.833 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mon-2:14.2.22-0.el8.x86_64 40/55 2022-04-28T14:41:10.834 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : ceph-mon-2:14.2.22-0.el8.x86_64 40/55 2022-04-28T14:41:10.990 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mon-2:14.2.22-0.el8.x86_64 40/55 2022-04-28T14:41:10.997 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-osd-2:14.2.22-0.el8.x86_64 41/55 2022-04-28T14:41:10.998 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : ceph-osd-2:14.2.22-0.el8.x86_64 41/55 2022-04-28T14:41:11.168 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-osd-2:14.2.22-0.el8.x86_64 41/55 2022-04-28T14:41:11.168 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : ceph-selinux-2:14.2.22-0.el8.x86_64 42/55 2022-04-28T14:41:11.283 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-selinux-2:14.2.22-0.el8.x86_64 42/55 2022-04-28T14:41:11.303 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-base-2:14.2.22-0.el8.x86_64 43/55 2022-04-28T14:41:11.303 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : ceph-base-2:14.2.22-0.el8.x86_64 43/55 2022-04-28T14:41:11.588 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-base-2:14.2.22-0.el8.x86_64 43/55 2022-04-28T14:41:11.610 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : ceph-common-2:14.2.22-0.el8.x86_64 44/55 2022-04-28T14:41:11.757 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:14.2.22-0.el8.x86_64 44/55 2022-04-28T14:41:11.757 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : libradosstriper1-2:14.2.22-0.el8.x86_64 45/55 2022-04-28T14:41:11.973 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libradosstriper1-2:14.2.22-0.el8.x86_64 45/55 2022-04-28T14:41:12.123 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : python3-cephfs-2:14.2.22-0.el8.x86_64 46/55 2022-04-28T14:41:12.298 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : python3-rbd-2:14.2.22-0.el8.x86_64 47/55 2022-04-28T14:41:12.298 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librbd1-2:14.2.22-0.el8.x86_64 48/55 2022-04-28T14:41:12.498 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:14.2.22-0.el8.x86_64 48/55 2022-04-28T14:41:12.641 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : python3-rgw-2:14.2.22-0.el8.x86_64 49/55 2022-04-28T14:41:12.641 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librgw2-2:14.2.22-0.el8.x86_64 50/55 2022-04-28T14:41:12.815 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librgw2-2:14.2.22-0.el8.x86_64 50/55 2022-04-28T14:41:12.964 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : python3-rados-2:14.2.22-0.el8.x86_64 51/55 2022-04-28T14:41:12.964 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : libcephfs2-2:14.2.22-0.el8.x86_64 52/55 2022-04-28T14:41:13.174 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephfs2-2:14.2.22-0.el8.x86_64 52/55 2022-04-28T14:41:13.306 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : ceph-fuse-2:14.2.22-0.el8.x86_64 53/55 2022-04-28T14:41:13.423 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 54/55 2022-04-28T14:41:13.423 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librados2-2:14.2.22-0.el8.x86_64 55/55 2022-04-28T14:41:14.101 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:14.2.22-0.el8.x86_64 55/55 2022-04-28T14:41:14.101 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephsqlite-2:16.2.7-969.g4fa079ba.el8.x86_64 1/55 2022-04-28T14:41:14.101 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-common-2:16.2.7-969.g4fa079ba.el8.x86 2/55 2022-04-28T14:41:14.102 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-modules-core-2:16.2.7-969.g4fa079ba.el8.n 3/55 2022-04-28T14:41:14.102 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-2:16.2.7-969.g4fa079ba.el8.x86_64 4/55 2022-04-28T14:41:14.102 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-2:14.2.22-0.el8.x86_64 5/55 2022-04-28T14:41:14.102 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-base-2:16.2.7-969.g4fa079ba.el8.x86_64 6/55 2022-04-28T14:41:14.102 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-base-2:14.2.22-0.el8.x86_64 7/55 2022-04-28T14:41:14.102 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-common-2:16.2.7-969.g4fa079ba.el8.x86_64 8/55 2022-04-28T14:41:14.102 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-common-2:14.2.22-0.el8.x86_64 9/55 2022-04-28T14:41:14.102 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-fuse-2:16.2.7-969.g4fa079ba.el8.x86_64 10/55 2022-04-28T14:41:14.102 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-fuse-2:14.2.22-0.el8.x86_64 11/55 2022-04-28T14:41:14.103 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mds-2:16.2.7-969.g4fa079ba.el8.x86_64 12/55 2022-04-28T14:41:14.103 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mds-2:14.2.22-0.el8.x86_64 13/55 2022-04-28T14:41:14.103 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-2:16.2.7-969.g4fa079ba.el8.x86_64 14/55 2022-04-28T14:41:14.103 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-2:14.2.22-0.el8.x86_64 15/55 2022-04-28T14:41:14.103 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mon-2:16.2.7-969.g4fa079ba.el8.x86_64 16/55 2022-04-28T14:41:14.103 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mon-2:14.2.22-0.el8.x86_64 17/55 2022-04-28T14:41:14.103 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-osd-2:16.2.7-969.g4fa079ba.el8.x86_64 18/55 2022-04-28T14:41:14.103 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-osd-2:14.2.22-0.el8.x86_64 19/55 2022-04-28T14:41:14.103 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-radosgw-2:16.2.7-969.g4fa079ba.el8.x86_64 20/55 2022-04-28T14:41:14.104 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-radosgw-2:14.2.22-0.el8.x86_64 21/55 2022-04-28T14:41:14.104 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-selinux-2:16.2.7-969.g4fa079ba.el8.x86_64 22/55 2022-04-28T14:41:14.104 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-selinux-2:14.2.22-0.el8.x86_64 23/55 2022-04-28T14:41:14.104 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-test-2:16.2.7-969.g4fa079ba.el8.x86_64 24/55 2022-04-28T14:41:14.104 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-test-2:14.2.22-0.el8.x86_64 25/55 2022-04-28T14:41:14.104 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs-devel-2:16.2.7-969.g4fa079ba.el8.x86_64 26/55 2022-04-28T14:41:14.105 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs-devel-2:14.2.22-0.el8.x86_64 27/55 2022-04-28T14:41:14.105 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs2-2:16.2.7-969.g4fa079ba.el8.x86_64 28/55 2022-04-28T14:41:14.105 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs2-2:14.2.22-0.el8.x86_64 29/55 2022-04-28T14:41:14.105 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados-devel-2:16.2.7-969.g4fa079ba.el8.x86_64 30/55 2022-04-28T14:41:14.105 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados-devel-2:14.2.22-0.el8.x86_64 31/55 2022-04-28T14:41:14.105 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:16.2.7-969.g4fa079ba.el8.x86_64 32/55 2022-04-28T14:41:14.105 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:14.2.22-0.el8.x86_64 33/55 2022-04-28T14:41:14.105 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libradosstriper1-2:16.2.7-969.g4fa079ba.el8.x86_64 34/55 2022-04-28T14:41:14.105 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libradosstriper1-2:14.2.22-0.el8.x86_64 35/55 2022-04-28T14:41:14.105 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:16.2.7-969.g4fa079ba.el8.x86_64 36/55 2022-04-28T14:41:14.106 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:14.2.22-0.el8.x86_64 37/55 2022-04-28T14:41:14.106 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librgw2-2:16.2.7-969.g4fa079ba.el8.x86_64 38/55 2022-04-28T14:41:14.106 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librgw2-2:14.2.22-0.el8.x86_64 39/55 2022-04-28T14:41:14.106 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-argparse-2:16.2.7-969.g4fa079ba.el8.x 40/55 2022-04-28T14:41:14.106 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-argparse-2:14.2.22-0.el8.x86_64 41/55 2022-04-28T14:41:14.106 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cephfs-2:16.2.7-969.g4fa079ba.el8.x86_64 42/55 2022-04-28T14:41:14.106 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cephfs-2:14.2.22-0.el8.x86_64 43/55 2022-04-28T14:41:14.106 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rados-2:16.2.7-969.g4fa079ba.el8.x86_64 44/55 2022-04-28T14:41:14.106 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rados-2:14.2.22-0.el8.x86_64 45/55 2022-04-28T14:41:14.107 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rbd-2:16.2.7-969.g4fa079ba.el8.x86_64 46/55 2022-04-28T14:41:14.107 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rbd-2:14.2.22-0.el8.x86_64 47/55 2022-04-28T14:41:14.107 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rgw-2:16.2.7-969.g4fa079ba.el8.x86_64 48/55 2022-04-28T14:41:14.107 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rgw-2:14.2.22-0.el8.x86_64 49/55 2022-04-28T14:41:14.107 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-fuse-2:16.2.7-969.g4fa079ba.el8.x86_64 50/55 2022-04-28T14:41:14.107 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-fuse-2:14.2.22-0.el8.x86_64 51/55 2022-04-28T14:41:14.107 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-mirror-2:16.2.7-969.g4fa079ba.el8.x86_64 52/55 2022-04-28T14:41:14.107 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-mirror-2:14.2.22-0.el8.x86_64 53/55 2022-04-28T14:41:14.107 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-nbd-2:16.2.7-969.g4fa079ba.el8.x86_64 54/55 2022-04-28T14:41:15.172 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-nbd-2:14.2.22-0.el8.x86_64 55/55 2022-04-28T14:41:15.172 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:41:15.173 INFO:teuthology.orchestra.run.smithi022.stdout:Upgraded: 2022-04-28T14:41:15.173 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-2:16.2.7-969.g4fa079ba.el8.x86_64 2022-04-28T14:41:15.173 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base-2:16.2.7-969.g4fa079ba.el8.x86_64 2022-04-28T14:41:15.173 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common-2:16.2.7-969.g4fa079ba.el8.x86_64 2022-04-28T14:41:15.174 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse-2:16.2.7-969.g4fa079ba.el8.x86_64 2022-04-28T14:41:15.174 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds-2:16.2.7-969.g4fa079ba.el8.x86_64 2022-04-28T14:41:15.175 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-2:16.2.7-969.g4fa079ba.el8.x86_64 2022-04-28T14:41:15.175 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon-2:16.2.7-969.g4fa079ba.el8.x86_64 2022-04-28T14:41:15.175 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd-2:16.2.7-969.g4fa079ba.el8.x86_64 2022-04-28T14:41:15.175 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw-2:16.2.7-969.g4fa079ba.el8.x86_64 2022-04-28T14:41:15.176 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux-2:16.2.7-969.g4fa079ba.el8.x86_64 2022-04-28T14:41:15.176 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test-2:16.2.7-969.g4fa079ba.el8.x86_64 2022-04-28T14:41:15.177 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel-2:16.2.7-969.g4fa079ba.el8.x86_64 2022-04-28T14:41:15.177 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2-2:16.2.7-969.g4fa079ba.el8.x86_64 2022-04-28T14:41:15.177 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel-2:16.2.7-969.g4fa079ba.el8.x86_64 2022-04-28T14:41:15.177 INFO:teuthology.orchestra.run.smithi022.stdout: librados2-2:16.2.7-969.g4fa079ba.el8.x86_64 2022-04-28T14:41:15.177 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1-2:16.2.7-969.g4fa079ba.el8.x86_64 2022-04-28T14:41:15.178 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1-2:16.2.7-969.g4fa079ba.el8.x86_64 2022-04-28T14:41:15.178 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2-2:16.2.7-969.g4fa079ba.el8.x86_64 2022-04-28T14:41:15.178 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse-2:16.2.7-969.g4fa079ba.el8.x86_64 2022-04-28T14:41:15.178 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs-2:16.2.7-969.g4fa079ba.el8.x86_64 2022-04-28T14:41:15.179 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados-2:16.2.7-969.g4fa079ba.el8.x86_64 2022-04-28T14:41:15.179 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd-2:16.2.7-969.g4fa079ba.el8.x86_64 2022-04-28T14:41:15.179 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw-2:16.2.7-969.g4fa079ba.el8.x86_64 2022-04-28T14:41:15.179 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse-2:16.2.7-969.g4fa079ba.el8.x86_64 2022-04-28T14:41:15.179 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror-2:16.2.7-969.g4fa079ba.el8.x86_64 2022-04-28T14:41:15.180 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd-2:16.2.7-969.g4fa079ba.el8.x86_64 2022-04-28T14:41:15.180 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2022-04-28T14:41:15.180 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core-2:16.2.7-969.g4fa079ba.el8.noarch 2022-04-28T14:41:15.180 INFO:teuthology.orchestra.run.smithi022.stdout: libcephsqlite-2:16.2.7-969.g4fa079ba.el8.x86_64 2022-04-28T14:41:15.180 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common-2:16.2.7-969.g4fa079ba.el8.x86_64 2022-04-28T14:41:15.181 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:41:15.181 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2022-04-28T14:41:15.327 DEBUG:teuthology.orchestra.run.smithi022:> sudo lsb_release -is 2022-04-28T14:41:15.367 INFO:teuthology.orchestra.run.smithi022.stdout:CentOSStream 2022-04-28T14:41:15.368 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-04-28T14:41:15.369 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4fa079ba14503defa8dc257d7c2d506ebefcfe6d 2022-04-28T14:41:15.616 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-04-28T14:41:15.640 INFO:teuthology.orchestra.run.smithi022.stdout:16.2.7-969.g4fa079ba.el8 2022-04-28T14:41:15.640 INFO:teuthology.packaging:The installed version of ceph is 16.2.7-969.g4fa079ba.el8 2022-04-28T14:41:15.640 INFO:teuthology.task.install:The correct ceph version 16.2.7-969.g4fa079ba is installed. 2022-04-28T14:41:15.640 INFO:teuthology.run_tasks:Running task print... 2022-04-28T14:41:15.651 INFO:teuthology.task.print:**** done install.upgrade both hosts 2022-04-28T14:41:15.651 INFO:teuthology.run_tasks:Running task ceph.restart... 2022-04-28T14:41:15.696 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2022-04-28T14:41:15.696 INFO:teuthology.orchestra.run:waiting for 300 2022-04-28T14:41:15.707 INFO:tasks.ceph.mon.a:Stopped 2022-04-28T14:41:15.707 INFO:tasks.ceph.mon.a:Restarting daemon 2022-04-28T14:41:15.707 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2022-04-28T14:41:15.750 INFO:tasks.ceph.mon.a:Started 2022-04-28T14:41:15.751 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2022-04-28T14:41:15.751 INFO:teuthology.orchestra.run:waiting for 300 2022-04-28T14:41:15.763 INFO:tasks.ceph.mon.b:Stopped 2022-04-28T14:41:15.764 INFO:tasks.ceph.mon.b:Restarting daemon 2022-04-28T14:41:15.764 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2022-04-28T14:41:15.807 INFO:tasks.ceph.mon.b:Started 2022-04-28T14:41:15.808 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2022-04-28T14:41:15.808 INFO:teuthology.orchestra.run:waiting for 300 2022-04-28T14:41:15.820 INFO:tasks.ceph.mon.c:Stopped 2022-04-28T14:41:15.820 INFO:tasks.ceph.mon.c:Restarting daemon 2022-04-28T14:41:15.820 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2022-04-28T14:41:15.862 INFO:tasks.ceph.mon.c:Started 2022-04-28T14:41:15.863 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2022-04-28T14:41:15.863 INFO:teuthology.orchestra.run:waiting for 300 2022-04-28T14:41:15.880 INFO:tasks.ceph.mgr.x:Stopped 2022-04-28T14:41:15.880 INFO:tasks.ceph.mgr.x:Restarting daemon 2022-04-28T14:41:15.880 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2022-04-28T14:41:15.922 INFO:tasks.ceph.mgr.x:Started 2022-04-28T14:41:15.923 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2022-04-28T14:41:15.923 INFO:teuthology.orchestra.run:waiting for 300 2022-04-28T14:41:15.942 INFO:tasks.ceph.mgr.y:Stopped 2022-04-28T14:41:15.942 INFO:tasks.ceph.mgr.y:Restarting daemon 2022-04-28T14:41:15.943 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2022-04-28T14:41:15.986 INFO:tasks.ceph.mgr.y:Started 2022-04-28T14:41:15.986 INFO:teuthology.run_tasks:Running task ceph.healthy... 2022-04-28T14:41:15.999 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2022-04-28T14:41:15.999 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2022-04-28T14:41:16.000 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2022-04-28T14:41:16.127 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.123+0000 7fc6cc945700 1 Processor -- start 2022-04-28T14:41:16.127 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.124+0000 7fc6cc945700 1 -- start start 2022-04-28T14:41:16.129 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.124+0000 7fc6cc945700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 0x7fc6c8069200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:16.129 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.124+0000 7fc6cc945700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 0x7fc6c8067710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:16.129 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.124+0000 7fc6cc945700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c80696f0 con 0x7fc6c8138680 2022-04-28T14:41:16.129 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.124+0000 7fc6cc945700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c80624d0 con 0x7fc6c80672d0 2022-04-28T14:41:16.130 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.124+0000 7fc6cc945700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c8067ca0 con 0x7fc6c80620f0 2022-04-28T14:41:16.130 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.124+0000 7fc6c659c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 0x7fc6c8069200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:16.130 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.124+0000 7fc6c5d9b700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 0x7fc6c8067710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:16.130 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.124+0000 7fc6c5d9b700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 0x7fc6c8067710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:47416/0 (socket says 172.21.15.22:47416) 2022-04-28T14:41:16.130 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.124+0000 7fc6c659c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 0x7fc6c8069200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:47200/0 (socket says 172.21.15.22:47200) 2022-04-28T14:41:16.130 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.124+0000 7fc6c6d9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc6c8138680 0x7fc6c8138b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39246/0 (socket says 172.21.15.22:39246) 2022-04-28T14:41:16.130 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.124+0000 7fc6c5d9b700 1 -- 172.21.15.22:0/3742438616 learned_addr learned my addr 172.21.15.22:0/3742438616 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:16.130 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.125+0000 7fc6c659c700 1 -- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 msgr2=0x7fc6c8069200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-04-28T14:41:16.130 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.125+0000 7fc6c5d9b700 1 -- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 msgr2=0x7fc6c8067710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-04-28T14:41:16.131 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.125+0000 7fc6c659c700 1 -- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 msgr2=0x7fc6c8069200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-04-28T14:41:16.131 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.125+0000 7fc6c5d9b700 1 -- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 msgr2=0x7fc6c8067710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-04-28T14:41:16.131 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.125+0000 7fc6c5d9b700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 0x7fc6c8067710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-04-28T14:41:16.131 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.125+0000 7fc6c659c700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 0x7fc6c8069200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-04-28T14:41:16.131 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.125+0000 7fc6c5d9b700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 0x7fc6c8067710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-04-28T14:41:16.131 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.125+0000 7fc6c659c700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 0x7fc6c8069200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-04-28T14:41:16.330 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.326+0000 7fc6c5d9b700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 0x7fc6c8067710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:16.330 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.326+0000 7fc6c659c700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 0x7fc6c8069200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:16.330 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.326+0000 7fc6c5d9b700 1 -- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 msgr2=0x7fc6c8067710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-04-28T14:41:16.330 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.326+0000 7fc6c5d9b700 1 -- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 msgr2=0x7fc6c8067710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-04-28T14:41:16.331 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.326+0000 7fc6c659c700 1 -- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 msgr2=0x7fc6c8069200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-04-28T14:41:16.331 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.326+0000 7fc6c659c700 1 -- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 msgr2=0x7fc6c8069200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-04-28T14:41:16.331 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.326+0000 7fc6c5d9b700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 0x7fc6c8067710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-04-28T14:41:16.331 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.326+0000 7fc6c659c700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 0x7fc6c8069200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-04-28T14:41:16.331 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.326+0000 7fc6c659c700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 0x7fc6c8069200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2022-04-28T14:41:16.331 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.326+0000 7fc6c5d9b700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 0x7fc6c8067710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2022-04-28T14:41:16.731 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.727+0000 7fc6c659c700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 0x7fc6c8069200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:16.731 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.727+0000 7fc6c5d9b700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 0x7fc6c8067710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:16.731 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.727+0000 7fc6c659c700 1 -- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 msgr2=0x7fc6c8069200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-04-28T14:41:16.731 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.727+0000 7fc6c659c700 1 -- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 msgr2=0x7fc6c8069200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-04-28T14:41:16.731 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.727+0000 7fc6c659c700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 0x7fc6c8069200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-04-28T14:41:16.731 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.727+0000 7fc6c5d9b700 1 -- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 msgr2=0x7fc6c8067710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-04-28T14:41:16.731 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.727+0000 7fc6c5d9b700 1 -- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 msgr2=0x7fc6c8067710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-04-28T14:41:16.732 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.727+0000 7fc6c5d9b700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 0x7fc6c8067710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-04-28T14:41:16.732 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.727+0000 7fc6c659c700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 0x7fc6c8069200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2022-04-28T14:41:16.732 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:16.727+0000 7fc6c5d9b700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 0x7fc6c8067710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2022-04-28T14:41:17.532 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:17.528+0000 7fc6c659c700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 0x7fc6c8069200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:17.532 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:17.528+0000 7fc6c5d9b700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 0x7fc6c8067710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:17.533 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:17.528+0000 7fc6c659c700 1 -- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 msgr2=0x7fc6c8069200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-04-28T14:41:17.533 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:17.528+0000 7fc6c659c700 1 -- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 msgr2=0x7fc6c8069200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-04-28T14:41:17.533 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:17.528+0000 7fc6c659c700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 0x7fc6c8069200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-04-28T14:41:17.533 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:17.528+0000 7fc6c659c700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 0x7fc6c8069200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2022-04-28T14:41:17.533 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:17.528+0000 7fc6c5d9b700 1 -- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 msgr2=0x7fc6c8067710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-04-28T14:41:17.533 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:17.528+0000 7fc6c5d9b700 1 -- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 msgr2=0x7fc6c8067710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-04-28T14:41:17.533 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:17.528+0000 7fc6c5d9b700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 0x7fc6c8067710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-04-28T14:41:17.533 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:17.528+0000 7fc6c5d9b700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 0x7fc6c8067710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2022-04-28T14:41:19.129 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:19.123+0000 7fc6bffff700 1 -- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 msgr2=0x7fc6c8069200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-04-28T14:41:19.129 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:19.123+0000 7fc6bffff700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 0x7fc6c8069200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:19.129 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:19.123+0000 7fc6bffff700 1 -- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 msgr2=0x7fc6c8067710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-04-28T14:41:19.130 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:19.123+0000 7fc6bffff700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 0x7fc6c8067710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:19.130 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:19.123+0000 7fc6bffff700 1 -- 172.21.15.22:0/3742438616 >> v1:172.21.15.22:6789/0 conn(0x7fc6c8138680 legacy=0x7fc6c8138b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:19.130 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:19.123+0000 7fc6bffff700 1 --2- 172.21.15.22:0/3742438616 >> v2:172.21.15.22:3300/0 conn(0x7fc6ac0035b0 0x7fc6ac005a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:19.130 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:19.123+0000 7fc6bffff700 1 -- 172.21.15.22:0/3742438616 --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c80624d0 con 0x7fc6ac0035b0 2022-04-28T14:41:19.130 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:19.124+0000 7fc6c659c700 1 --2- 172.21.15.22:0/3742438616 >> v2:172.21.15.22:3300/0 conn(0x7fc6ac0035b0 0x7fc6ac005a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:19.131 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:19.124+0000 7fc6c659c700 1 -- 172.21.15.22:0/3742438616 >> v2:172.21.15.22:3300/0 conn(0x7fc6ac0035b0 msgr2=0x7fc6ac005a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-04-28T14:41:19.131 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:19.124+0000 7fc6c659c700 1 -- 172.21.15.22:0/3742438616 >> v2:172.21.15.22:3300/0 conn(0x7fc6ac0035b0 msgr2=0x7fc6ac005a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-04-28T14:41:19.131 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:19.124+0000 7fc6c659c700 1 --2- 172.21.15.22:0/3742438616 >> v2:172.21.15.22:3300/0 conn(0x7fc6ac0035b0 0x7fc6ac005a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-04-28T14:41:19.131 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:19.124+0000 7fc6c659c700 1 --2- 172.21.15.22:0/3742438616 >> v2:172.21.15.22:3300/0 conn(0x7fc6ac0035b0 0x7fc6ac005a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-04-28T14:41:19.330 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:19.325+0000 7fc6c659c700 1 --2- 172.21.15.22:0/3742438616 >> v2:172.21.15.22:3300/0 conn(0x7fc6ac0035b0 0x7fc6ac005a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:19.330 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:19.325+0000 7fc6c659c700 1 -- 172.21.15.22:0/3742438616 >> v2:172.21.15.22:3300/0 conn(0x7fc6ac0035b0 msgr2=0x7fc6ac005a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-04-28T14:41:19.331 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:19.325+0000 7fc6c659c700 1 -- 172.21.15.22:0/3742438616 >> v2:172.21.15.22:3300/0 conn(0x7fc6ac0035b0 msgr2=0x7fc6ac005a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-04-28T14:41:19.331 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:19.325+0000 7fc6c659c700 1 --2- 172.21.15.22:0/3742438616 >> v2:172.21.15.22:3300/0 conn(0x7fc6ac0035b0 0x7fc6ac005a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-04-28T14:41:19.331 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:19.325+0000 7fc6c659c700 1 --2- 172.21.15.22:0/3742438616 >> v2:172.21.15.22:3300/0 conn(0x7fc6ac0035b0 0x7fc6ac005a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2022-04-28T14:41:19.731 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:19.726+0000 7fc6c659c700 1 --2- 172.21.15.22:0/3742438616 >> v2:172.21.15.22:3300/0 conn(0x7fc6ac0035b0 0x7fc6ac005a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:19.731 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:19.726+0000 7fc6c659c700 1 -- 172.21.15.22:0/3742438616 >> v2:172.21.15.22:3300/0 conn(0x7fc6ac0035b0 msgr2=0x7fc6ac005a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-04-28T14:41:19.731 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:19.726+0000 7fc6c659c700 1 -- 172.21.15.22:0/3742438616 >> v2:172.21.15.22:3300/0 conn(0x7fc6ac0035b0 msgr2=0x7fc6ac005a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-04-28T14:41:19.731 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:19.726+0000 7fc6c659c700 1 --2- 172.21.15.22:0/3742438616 >> v2:172.21.15.22:3300/0 conn(0x7fc6ac0035b0 0x7fc6ac005a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-04-28T14:41:19.732 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:19.726+0000 7fc6c659c700 1 --2- 172.21.15.22:0/3742438616 >> v2:172.21.15.22:3300/0 conn(0x7fc6ac0035b0 0x7fc6ac005a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2022-04-28T14:41:20.532 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:20.527+0000 7fc6c659c700 1 --2- 172.21.15.22:0/3742438616 >> v2:172.21.15.22:3300/0 conn(0x7fc6ac0035b0 0x7fc6ac005a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:20.532 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:20.527+0000 7fc6c659c700 1 -- 172.21.15.22:0/3742438616 >> v2:172.21.15.22:3300/0 conn(0x7fc6ac0035b0 msgr2=0x7fc6ac005a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-04-28T14:41:20.532 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:20.527+0000 7fc6c659c700 1 -- 172.21.15.22:0/3742438616 >> v2:172.21.15.22:3300/0 conn(0x7fc6ac0035b0 msgr2=0x7fc6ac005a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-04-28T14:41:20.532 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:20.527+0000 7fc6c659c700 1 --2- 172.21.15.22:0/3742438616 >> v2:172.21.15.22:3300/0 conn(0x7fc6ac0035b0 0x7fc6ac005a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-04-28T14:41:20.532 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:20.527+0000 7fc6c659c700 1 --2- 172.21.15.22:0/3742438616 >> v2:172.21.15.22:3300/0 conn(0x7fc6ac0035b0 0x7fc6ac005a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2022-04-28T14:41:21.218 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:21.213+0000 7fd9ecf21680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-04-28T14:41:21.291 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:21.286+0000 7fd9ecf21680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-04-28T14:41:21.365 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:21.361+0000 7fd9ecf21680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-04-28T14:41:21.514 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:21.510+0000 7fd9ecf21680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-04-28T14:41:21.678 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:21.673+0000 7fd9ecf21680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-04-28T14:41:22.106 INFO:tasks.ceph.mgr.x.smithi022.stderr:2022-04-28T14:41:22.102+0000 7f45dcff7680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-04-28T14:41:22.114 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:22.110+0000 7fd9ecf21680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-04-28T14:41:22.129 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.124+0000 7fc6bffff700 1 -- 172.21.15.22:0/3742438616 >> v2:172.21.15.22:3300/0 conn(0x7fc6ac0035b0 msgr2=0x7fc6ac005a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-04-28T14:41:22.129 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.124+0000 7fc6bffff700 1 --2- 172.21.15.22:0/3742438616 >> v2:172.21.15.22:3300/0 conn(0x7fc6ac0035b0 0x7fc6ac005a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:22.129 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.124+0000 7fc6bffff700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 0x7fc6ac008210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:22.130 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.124+0000 7fc6bffff700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 0x7fc6ac00a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:22.130 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.124+0000 7fc6bffff700 1 --2- 172.21.15.22:0/3742438616 >> v2:172.21.15.22:3300/0 conn(0x7fc6ac00aca0 0x7fc6ac00d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:22.130 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.124+0000 7fc6bffff700 1 -- 172.21.15.22:0/3742438616 --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c80624d0 con 0x7fc6ac00aca0 2022-04-28T14:41:22.130 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.124+0000 7fc6bffff700 1 -- 172.21.15.22:0/3742438616 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c8067ca0 con 0x7fc6c80672d0 2022-04-28T14:41:22.130 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.124+0000 7fc6bffff700 1 -- 172.21.15.22:0/3742438616 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac00d6f0 con 0x7fc6c80620f0 2022-04-28T14:41:22.130 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.124+0000 7fc6c5d9b700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 0x7fc6ac00a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:22.130 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.124+0000 7fc6c659c700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 0x7fc6ac008210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:22.130 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.124+0000 7fc6c6d9d700 1 --2- 172.21.15.22:0/3742438616 >> v2:172.21.15.22:3300/0 conn(0x7fc6ac00aca0 0x7fc6ac00d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:22.130 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.124+0000 7fc6c5d9b700 1 -- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 msgr2=0x7fc6ac008210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:22.131 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.124+0000 7fc6c5d9b700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 0x7fc6ac008210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:22.131 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.124+0000 7fc6c5d9b700 1 -- 172.21.15.22:0/3742438616 >> v2:172.21.15.22:3300/0 conn(0x7fc6ac00aca0 msgr2=0x7fc6ac00d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:22.131 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.124+0000 7fc6c5d9b700 1 --2- 172.21.15.22:0/3742438616 >> v2:172.21.15.22:3300/0 conn(0x7fc6ac00aca0 0x7fc6ac00d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:22.131 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.124+0000 7fc6c5d9b700 1 -- 172.21.15.22:0/3742438616 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c8068a20 con 0x7fc6c80620f0 2022-04-28T14:41:22.131 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.124+0000 7fc6c659c700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 0x7fc6ac008210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:22.131 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.124+0000 7fc6c5d9b700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 0x7fc6ac00a790 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fc6b0006fd0 tx=0x7fc6b000f6d0).ready entity=mon.2 client_cookie=d1934e00f58276c0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:22.131 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.124+0000 7fc6c559a700 1 -- 172.21.15.22:0/3742438616 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0017070 con 0x7fc6c80620f0 2022-04-28T14:41:22.131 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.124+0000 7fc6c559a700 1 -- 172.21.15.22:0/3742438616 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b0012cb0 con 0x7fc6c80620f0 2022-04-28T14:41:22.131 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.124+0000 7fc6c559a700 1 -- 172.21.15.22:0/3742438616 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b001c650 con 0x7fc6c80620f0 2022-04-28T14:41:22.133 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.125+0000 7fc6cc945700 1 -- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 msgr2=0x7fc6ac00a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:22.133 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.125+0000 7fc6cc945700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 0x7fc6ac00a790 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fc6b0006fd0 tx=0x7fc6b000f6d0).stop 2022-04-28T14:41:22.133 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.125+0000 7fc6cc945700 1 -- 172.21.15.22:0/3742438616 shutdown_connections 2022-04-28T14:41:22.133 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.125+0000 7fc6cc945700 1 --2- 172.21.15.22:0/3742438616 >> v2:172.21.15.22:3300/0 conn(0x7fc6ac00aca0 0x7fc6ac00d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:22.133 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.125+0000 7fc6cc945700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 0x7fc6ac00a790 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:22.134 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.125+0000 7fc6cc945700 1 --2- 172.21.15.22:0/3742438616 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 0x7fc6ac008210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:22.134 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.125+0000 7fc6cc945700 1 -- 172.21.15.22:0/3742438616 >> 172.21.15.22:0/3742438616 conn(0x7fc6c80aa5c0 msgr2=0x7fc6c80aa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:22.134 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.125+0000 7fc6cc945700 1 -- 172.21.15.22:0/3742438616 shutdown_connections 2022-04-28T14:41:22.134 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.125+0000 7fc6cc945700 1 -- 172.21.15.22:0/3742438616 wait complete. 2022-04-28T14:41:22.134 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.126+0000 7fc6cc945700 1 Processor -- start 2022-04-28T14:41:22.134 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.126+0000 7fc6cc945700 1 -- start start 2022-04-28T14:41:22.134 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.127+0000 7fc6cc945700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6ac00aca0 0x7fc6c80a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:22.134 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.127+0000 7fc6cc945700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 0x7fc6c80916b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:22.134 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.127+0000 7fc6cc945700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 0x7fc6c814f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:22.135 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.127+0000 7fc6cc945700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c814c000 con 0x7fc6ac00aca0 2022-04-28T14:41:22.135 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.127+0000 7fc6cc945700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c814f6e0 con 0x7fc6c80672d0 2022-04-28T14:41:22.135 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.127+0000 7fc6cc945700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c8091260 con 0x7fc6c80620f0 2022-04-28T14:41:22.135 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.127+0000 7fc6c659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6ac00aca0 0x7fc6c80a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:22.135 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.127+0000 7fc6c659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6ac00aca0 0x7fc6c80a4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50068/0 (socket says 172.21.15.22:50068) 2022-04-28T14:41:22.135 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.127+0000 7fc6c659c700 1 -- 172.21.15.22:0/143194865 learned_addr learned my addr 172.21.15.22:0/143194865 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:22.135 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.127+0000 7fc6c6d9d700 1 --2- 172.21.15.22:0/143194865 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 0x7fc6c814f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:22.135 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.128+0000 7fc6c659c700 1 -- 172.21.15.22:0/143194865 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 msgr2=0x7fc6c80916b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:22.135 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.128+0000 7fc6c659c700 1 --2- 172.21.15.22:0/143194865 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 0x7fc6c80916b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-04-28T14:41:22.135 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.128+0000 7fc6c659c700 1 -- 172.21.15.22:0/143194865 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 msgr2=0x7fc6c814f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:22.136 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.128+0000 7fc6c659c700 1 --2- 172.21.15.22:0/143194865 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 0x7fc6c814f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:22.136 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.128+0000 7fc6c659c700 1 -- 172.21.15.22:0/143194865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b800e040 con 0x7fc6ac00aca0 2022-04-28T14:41:22.136 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.128+0000 7fc6c659c700 1 --2- 172.21.15.22:0/143194865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6ac00aca0 0x7fc6c80a4240 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fc6b8017b40 tx=0x7fc6b801b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:22.136 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.129+0000 7fc6be7fc700 1 -- 172.21.15.22:0/143194865 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8027070 con 0x7fc6ac00aca0 2022-04-28T14:41:22.137 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.129+0000 7fc6cc945700 1 -- 172.21.15.22:0/143194865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b000f970 con 0x7fc6ac00aca0 2022-04-28T14:41:22.137 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.129+0000 7fc6cc945700 1 -- 172.21.15.22:0/143194865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c80931d0 con 0x7fc6ac00aca0 2022-04-28T14:41:22.137 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.129+0000 7fc6be7fc700 1 -- 172.21.15.22:0/143194865 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b801f040 con 0x7fc6ac00aca0 2022-04-28T14:41:22.137 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.129+0000 7fc6be7fc700 1 -- 172.21.15.22:0/143194865 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b801e030 con 0x7fc6ac00aca0 2022-04-28T14:41:22.137 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.130+0000 7fc6be7fc700 1 -- 172.21.15.22:0/143194865 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 22927+0+0 (secure 0 0 0) 0x7fc6b8012040 con 0x7fc6ac00aca0 2022-04-28T14:41:22.137 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.130+0000 7fc6be7fc700 1 -- 172.21.15.22:0/143194865 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fc6b800ae00 con 0x7fc6ac00aca0 2022-04-28T14:41:22.137 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.130+0000 7fc6c5d9b700 1 -- 172.21.15.22:0/143194865 >> v1:172.21.15.22:6808/86956 conn(0x7fc6ac01d610 legacy=0x7fc6ac01fad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.22:6808/86956 2022-04-28T14:41:22.137 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.131+0000 7fc6cc945700 1 -- 172.21.15.22:0/143194865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c81505d0 con 0x7fc6ac00aca0 2022-04-28T14:41:22.138 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.134+0000 7fc6be7fc700 1 -- 172.21.15.22:0/143194865 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+101097 (secure 0 0 0) 0x7fc6b800da50 con 0x7fc6ac00aca0 2022-04-28T14:41:22.179 INFO:tasks.ceph.mgr.x.smithi022.stderr:2022-04-28T14:41:22.174+0000 7f45dcff7680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-04-28T14:41:22.228 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:22.223+0000 7fd9ecf21680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-04-28T14:41:22.252 INFO:tasks.ceph.mgr.x.smithi022.stderr:2022-04-28T14:41:22.247+0000 7f45dcff7680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-04-28T14:41:22.257 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.253+0000 7fc6cc945700 1 -- 172.21.15.22:0/143194865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fc6c80913a0 con 0x7fc6ac00aca0 2022-04-28T14:41:22.258 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.254+0000 7fc6be7fc700 1 -- 172.21.15.22:0/143194865 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+47750 (secure 0 0 0) 0x7fc6b803b090 con 0x7fc6ac00aca0 2022-04-28T14:41:22.259 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:41:22.260 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.255+0000 7fc6cc945700 1 -- 172.21.15.22:0/143194865 >> v1:172.21.15.22:6808/86956 conn(0x7fc6ac01d610 legacy=0x7fc6ac01fad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-04-28T14:41:22.260 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.255+0000 7fc6cc945700 1 -- 172.21.15.22:0/143194865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6ac00aca0 msgr2=0x7fc6c80a4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:22.261 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.255+0000 7fc6cc945700 1 --2- 172.21.15.22:0/143194865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6ac00aca0 0x7fc6c80a4240 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fc6b8017b40 tx=0x7fc6b801b040).stop 2022-04-28T14:41:22.261 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.255+0000 7fc6cc945700 1 -- 172.21.15.22:0/143194865 shutdown_connections 2022-04-28T14:41:22.261 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.255+0000 7fc6cc945700 1 --2- 172.21.15.22:0/143194865 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6c80672d0 0x7fc6c814f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:22.261 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.255+0000 7fc6cc945700 1 --2- 172.21.15.22:0/143194865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6ac00aca0 0x7fc6c80a4240 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:22.261 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.255+0000 7fc6cc945700 1 --2- 172.21.15.22:0/143194865 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6c80620f0 0x7fc6c80916b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-04-28T14:41:22.261 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.255+0000 7fc6cc945700 1 -- 172.21.15.22:0/143194865 >> 172.21.15.22:0/143194865 conn(0x7fc6c80aa5c0 msgr2=0x7fc6c80a62a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:22.261 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.255+0000 7fc6cc945700 1 -- 172.21.15.22:0/143194865 shutdown_connections 2022-04-28T14:41:22.261 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.255+0000 7fc6cc945700 1 -- 172.21.15.22:0/143194865 wait complete. 2022-04-28T14:41:22.274 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":4,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6808","nonce":86956}]},"active_addr":"172.21.15.22:6808/86956","active_change":"2022-04-28T14:38:56.256627+0000","active_mgr_features":0,"available":true,"standbys":[{"gid":4109,"name":"x","mgr_features":0,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_url":{"name":"server_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_iterations":{"name":"upmap_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimization iterations","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_url":{"name":"server_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_iterations":{"name":"upmap_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimization iterations","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[]}} 2022-04-28T14:41:22.280 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2022-04-28T14:41:22.280 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2022-04-28T14:41:22.280 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-28T14:41:22.297 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:22.293+0000 7fd9ecf21680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-04-28T14:41:22.404 INFO:tasks.ceph.mgr.x.smithi022.stderr:2022-04-28T14:41:22.399+0000 7f45dcff7680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-04-28T14:41:22.410 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.406+0000 7f0fd2275700 1 Processor -- start 2022-04-28T14:41:22.411 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.406+0000 7f0fd2275700 1 -- start start 2022-04-28T14:41:22.412 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.406+0000 7f0fd2275700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0fcc063e20 0x7f0fcc09cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:22.412 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.406+0000 7f0fd2275700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0fcc099600 0x7f0fcc09b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:22.413 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.407+0000 7f0fd2275700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fcc0639d0 con 0x7f0fcc098180 2022-04-28T14:41:22.413 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.407+0000 7f0fd2275700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fcc099d00 con 0x7f0fcc063e20 2022-04-28T14:41:22.413 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.407+0000 7f0fd2275700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc064200 con 0x7f0fcc099600 2022-04-28T14:41:22.413 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.407+0000 7f0fcb7fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0fcc099600 0x7f0fcc09b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:22.413 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.407+0000 7f0fcbfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0fcc063e20 0x7f0fcc09cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:22.413 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.407+0000 7f0fcb7fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0fcc099600 0x7f0fcc09b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:47674/0 (socket says 172.21.15.22:47674) 2022-04-28T14:41:22.413 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.407+0000 7f0fcb7fe700 1 -- 172.21.15.22:0/678175524 learned_addr learned my addr 172.21.15.22:0/678175524 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:22.413 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.407+0000 7f0fcb7fe700 1 -- 172.21.15.22:0/678175524 >> v2:172.21.15.22:3300/0 conn(0x7f0fcc063e20 msgr2=0x7f0fcc09cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:22.413 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.407+0000 7f0fcb7fe700 1 --2- 172.21.15.22:0/678175524 >> v2:172.21.15.22:3300/0 conn(0x7f0fcc063e20 0x7f0fcc09cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:22.414 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.407+0000 7f0fcb7fe700 1 -- 172.21.15.22:0/678175524 >> v1:172.21.15.22:6789/0 conn(0x7f0fcc098180 legacy=0x7f0fcc13b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:22.414 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.407+0000 7f0fcaffd700 1 -- 172.21.15.22:0/678175524 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831631480 0 0) 0x7f0fcc0639d0 con 0x7f0fcc098180 2022-04-28T14:41:22.414 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.407+0000 7f0fcb7fe700 1 -- 172.21.15.22:0/678175524 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fcc09b9c0 con 0x7f0fcc099600 2022-04-28T14:41:22.414 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.407+0000 7f0fcbfff700 1 --2- 172.21.15.22:0/678175524 >> v2:172.21.15.22:3300/0 conn(0x7f0fcc063e20 0x7f0fcc09cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:22.414 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.407+0000 7f0fcb7fe700 1 --2- 172.21.15.22:0/678175524 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0fcc099600 0x7f0fcc09b4d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f0fc0006fd0 tx=0x7f0fc00090f0).ready entity=mon.1 client_cookie=5879384e1adb91e5 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:22.414 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.407+0000 7f0fcaffd700 1 -- 172.21.15.22:0/678175524 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc000b610 con 0x7f0fcc099600 2022-04-28T14:41:22.414 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.408+0000 7f0fcaffd700 1 -- 172.21.15.22:0/678175524 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc000b770 con 0x7f0fcc099600 2022-04-28T14:41:22.414 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.408+0000 7f0fcaffd700 1 -- 172.21.15.22:0/678175524 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc000baf0 con 0x7f0fcc099600 2022-04-28T14:41:22.418 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.408+0000 7f0fd2275700 1 -- 172.21.15.22:0/678175524 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0fcc099600 msgr2=0x7f0fcc09b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:22.418 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.408+0000 7f0fd2275700 1 --2- 172.21.15.22:0/678175524 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0fcc099600 0x7f0fcc09b4d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f0fc0006fd0 tx=0x7f0fc00090f0).stop 2022-04-28T14:41:22.418 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.408+0000 7f0fd2275700 1 -- 172.21.15.22:0/678175524 shutdown_connections 2022-04-28T14:41:22.418 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.408+0000 7f0fd2275700 1 --2- 172.21.15.22:0/678175524 >> v2:172.21.15.22:3300/0 conn(0x7f0fcc063e20 0x7f0fcc09cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:22.418 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.408+0000 7f0fd2275700 1 --2- 172.21.15.22:0/678175524 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0fcc099600 0x7f0fcc09b4d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:22.418 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.408+0000 7f0fd2275700 1 -- 172.21.15.22:0/678175524 >> 172.21.15.22:0/678175524 conn(0x7f0fcc0aaf80 msgr2=0x7f0fcc0ab390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:22.418 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.409+0000 7f0fd2275700 1 -- 172.21.15.22:0/678175524 shutdown_connections 2022-04-28T14:41:22.418 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.409+0000 7f0fd2275700 1 -- 172.21.15.22:0/678175524 wait complete. 2022-04-28T14:41:22.419 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.410+0000 7f0fd2275700 1 Processor -- start 2022-04-28T14:41:22.419 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.410+0000 7f0fd2275700 1 -- start start 2022-04-28T14:41:22.419 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.411+0000 7f0fd2275700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fcc063e20 0x7f0fcc0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:22.419 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.411+0000 7f0fd2275700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0fcc098180 0x7f0fcc0a1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:22.419 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.411+0000 7f0fd2275700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0fcc099600 0x7f0fcc14b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:22.419 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.411+0000 7f0fd2275700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc0a2130 con 0x7f0fcc063e20 2022-04-28T14:41:22.419 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.411+0000 7f0fd2275700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc0a2de0 con 0x7f0fcc099600 2022-04-28T14:41:22.419 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.411+0000 7f0fd2275700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc0a0220 con 0x7f0fcc098180 2022-04-28T14:41:22.419 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.411+0000 7f0fcbfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fcc063e20 0x7f0fcc0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:22.419 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.411+0000 7f0fcbfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fcc063e20 0x7f0fcc0a37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50112/0 (socket says 172.21.15.22:50112) 2022-04-28T14:41:22.420 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.411+0000 7f0fcbfff700 1 -- 172.21.15.22:0/1444525513 learned_addr learned my addr 172.21.15.22:0/1444525513 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:22.420 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.411+0000 7f0fd0812700 1 --2- 172.21.15.22:0/1444525513 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0fcc099600 0x7f0fcc14b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:22.420 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.411+0000 7f0fcb7fe700 1 --2- 172.21.15.22:0/1444525513 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0fcc098180 0x7f0fcc0a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:22.420 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.412+0000 7f0fcbfff700 1 -- 172.21.15.22:0/1444525513 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0fcc098180 msgr2=0x7f0fcc0a1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:22.420 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.412+0000 7f0fcbfff700 1 --2- 172.21.15.22:0/1444525513 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0fcc098180 0x7f0fcc0a1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:22.420 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.412+0000 7f0fcbfff700 1 -- 172.21.15.22:0/1444525513 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0fcc099600 msgr2=0x7f0fcc14b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:22.420 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.412+0000 7f0fcbfff700 1 --2- 172.21.15.22:0/1444525513 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0fcc099600 0x7f0fcc14b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:22.420 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.412+0000 7f0fcbfff700 1 -- 172.21.15.22:0/1444525513 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fbc0092a0 con 0x7f0fcc063e20 2022-04-28T14:41:22.420 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.412+0000 7f0fcbfff700 1 --2- 172.21.15.22:0/1444525513 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fcc063e20 0x7f0fcc0a37a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f0fbc00ea20 tx=0x7f0fbc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:22.420 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.412+0000 7f0fb3fff700 1 -- 172.21.15.22:0/1444525513 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc00ee60 con 0x7f0fcc063e20 2022-04-28T14:41:22.421 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.412+0000 7f0fb3fff700 1 -- 172.21.15.22:0/1444525513 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fbc00c850 con 0x7f0fcc063e20 2022-04-28T14:41:22.421 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.412+0000 7f0fd2275700 1 -- 172.21.15.22:0/1444525513 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc0009370 con 0x7f0fcc063e20 2022-04-28T14:41:22.421 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.412+0000 7f0fb3fff700 1 -- 172.21.15.22:0/1444525513 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc00cbd0 con 0x7f0fcc063e20 2022-04-28T14:41:22.421 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.412+0000 7f0fd2275700 1 -- 172.21.15.22:0/1444525513 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fcc0a1130 con 0x7f0fcc063e20 2022-04-28T14:41:22.421 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.413+0000 7f0fb3fff700 1 -- 172.21.15.22:0/1444525513 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) v1 ==== 22927+0+0 (secure 0 0 0) 0x7f0fbc022070 con 0x7f0fcc063e20 2022-04-28T14:41:22.421 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.413+0000 7f0fb3fff700 1 -- 172.21.15.22:0/1444525513 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f0fbc02aab0 con 0x7f0fcc063e20 2022-04-28T14:41:22.421 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.413+0000 7f0fcb7fe700 1 -- 172.21.15.22:0/1444525513 >> v1:172.21.15.22:6808/86956 conn(0x7f0fac01c910 legacy=0x7f0fac01edd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.22:6808/86956 2022-04-28T14:41:22.421 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.413+0000 7f0fd2275700 1 -- 172.21.15.22:0/1444525513 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fcc0a03e0 con 0x7f0fcc063e20 2022-04-28T14:41:22.422 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.416+0000 7f0fb3fff700 1 -- 172.21.15.22:0/1444525513 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+101097 (secure 0 0 0) 0x7f0fbc00be20 con 0x7f0fcc063e20 2022-04-28T14:41:22.464 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:22.460+0000 7fd9ecf21680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-04-28T14:41:22.526 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.522+0000 7f0fd2275700 1 -- 172.21.15.22:0/1444525513 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fcc066da0 con 0x7f0fcc063e20 2022-04-28T14:41:22.527 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.523+0000 7f0fb3fff700 1 -- 172.21.15.22:0/1444525513 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+9651 (secure 0 0 0) 0x7f0fbc01e120 con 0x7f0fcc063e20 2022-04-28T14:41:22.528 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:41:22.528 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":17,"fsid":"3047163a-0285-4058-8e05-ce74c6fbb9c5","created":"2022-04-28T14:38:54.232890+0000","modified":"2022-04-28T14:39:26.606234+0000","last_up_change":"2022-04-28T14:39:00.269721+0000","last_in_change":"2022-04-28T14:39:00.269721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-04-28T14:39:03.639717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-04-28T14:39:12.000229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-04-28T14:39:12.915097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782ee638-1ada-48d9-9454-f9e0ca8a3135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6800","nonce":87556}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":87556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":87556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":87556}]},"public_addr":"172.21.15.22:6800/87556","cluster_addr":"172.21.15.22:6801/87556","heartbeat_back_addr":"172.21.15.22:6803/87556","heartbeat_front_addr":"172.21.15.22:6802/87556","state":["exists","up"]},{"osd":1,"uuid":"61ca6f96-fb4f-4c0f-b68b-edf1e7011f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":87557}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":87557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":87557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":87557}]},"public_addr":"172.21.15.22:6804/87557","cluster_addr":"172.21.15.22:6805/87557","heartbeat_back_addr":"172.21.15.22:6807/87557","heartbeat_front_addr":"172.21.15.22:6806/87557","state":["exists","up"]},{"osd":2,"uuid":"4b3043b9-50df-4b7f-a55a-ac8e6148c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":87558}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":87558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":87558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":87558}]},"public_addr":"172.21.15.22:6813/87558","cluster_addr":"172.21.15.22:6814/87558","heartbeat_back_addr":"172.21.15.22:6816/87558","heartbeat_front_addr":"172.21.15.22:6815/87558","state":["exists","up"]},{"osd":3,"uuid":"7807bcd1-53f8-44b5-9992-57c328e5b299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":87561}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":87561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":87561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":87561}]},"public_addr":"172.21.15.22:6809/87561","cluster_addr":"172.21.15.22:6810/87561","heartbeat_back_addr":"172.21.15.22:6812/87561","heartbeat_front_addr":"172.21.15.22:6811/87561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-04-28T14:41:22.529 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.524+0000 7f0fd2275700 1 -- 172.21.15.22:0/1444525513 >> v1:172.21.15.22:6808/86956 conn(0x7f0fac01c910 legacy=0x7f0fac01edd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-04-28T14:41:22.529 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.524+0000 7f0fd2275700 1 -- 172.21.15.22:0/1444525513 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fcc063e20 msgr2=0x7f0fcc0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:22.529 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.524+0000 7f0fd2275700 1 --2- 172.21.15.22:0/1444525513 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fcc063e20 0x7f0fcc0a37a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f0fbc00ea20 tx=0x7f0fbc009060).stop 2022-04-28T14:41:22.529 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.524+0000 7f0fd2275700 1 -- 172.21.15.22:0/1444525513 shutdown_connections 2022-04-28T14:41:22.530 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.524+0000 7f0fd2275700 1 --2- 172.21.15.22:0/1444525513 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0fcc099600 0x7f0fcc14b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:22.530 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.524+0000 7f0fd2275700 1 --2- 172.21.15.22:0/1444525513 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fcc063e20 0x7f0fcc0a37a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:22.530 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.524+0000 7f0fd2275700 1 --2- 172.21.15.22:0/1444525513 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0fcc098180 0x7f0fcc0a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:22.530 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.524+0000 7f0fd2275700 1 -- 172.21.15.22:0/1444525513 >> 172.21.15.22:0/1444525513 conn(0x7f0fcc0aaf80 msgr2=0x7f0fcc063050 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:22.530 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.524+0000 7f0fd2275700 1 -- 172.21.15.22:0/1444525513 shutdown_connections 2022-04-28T14:41:22.530 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.524+0000 7f0fd2275700 1 -- 172.21.15.22:0/1444525513 wait complete. 2022-04-28T14:41:22.539 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:22.534+0000 7fd9ecf21680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-04-28T14:41:22.542 INFO:tasks.ceph.ceph_manager.ceph:all up! 2022-04-28T14:41:22.542 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-28T14:41:22.587 INFO:tasks.ceph.mgr.x.smithi022.stderr:2022-04-28T14:41:22.582+0000 7f45dcff7680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-04-28T14:41:22.702 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.697+0000 7fd0e7950700 1 Processor -- start 2022-04-28T14:41:22.702 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.697+0000 7fd0e7950700 1 -- start start 2022-04-28T14:41:22.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.698+0000 7fd0e7950700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd0e00a5450 0x7fd0e0067010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:22.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.698+0000 7fd0e7950700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd0e0140b80 0x7fd0e0142f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:22.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.698+0000 7fd0e7950700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e00a5cd0 con 0x7fd0e0135740 2022-04-28T14:41:22.706 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.698+0000 7fd0e7950700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e00a5830 con 0x7fd0e00a5450 2022-04-28T14:41:22.706 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.698+0000 7fd0e7950700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e013c350 con 0x7fd0e0140b80 2022-04-28T14:41:22.706 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.698+0000 7fd0e56ec700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd0e00a5450 0x7fd0e0067010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:22.706 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.698+0000 7fd0e4eeb700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd0e0135740 0x7fd0e013b980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39518/0 (socket says 172.21.15.22:39518) 2022-04-28T14:41:22.706 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.698+0000 7fd0e4eeb700 1 -- 172.21.15.22:0/511130487 learned_addr learned my addr 172.21.15.22:0/511130487 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:41:22.706 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.698+0000 7fd0e5eed700 1 --2- 172.21.15.22:0/511130487 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd0e0140b80 0x7fd0e0142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:22.706 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.698+0000 7fd0cffff700 1 -- 172.21.15.22:0/511130487 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2607395269 0 0) 0x7fd0e00a5cd0 con 0x7fd0e0135740 2022-04-28T14:41:22.706 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.699+0000 7fd0cffff700 1 -- 172.21.15.22:0/511130487 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0c80033f0 con 0x7fd0e0135740 2022-04-28T14:41:22.706 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.699+0000 7fd0e5eed700 1 -- 172.21.15.22:0/511130487 >> v2:172.21.15.22:3300/0 conn(0x7fd0e00a5450 msgr2=0x7fd0e0067010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:22.707 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.699+0000 7fd0e5eed700 1 --2- 172.21.15.22:0/511130487 >> v2:172.21.15.22:3300/0 conn(0x7fd0e00a5450 0x7fd0e0067010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:22.707 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.699+0000 7fd0e5eed700 1 -- 172.21.15.22:0/511130487 >> v1:172.21.15.22:6789/0 conn(0x7fd0e0135740 legacy=0x7fd0e013b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:22.707 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.699+0000 7fd0e5eed700 1 -- 172.21.15.22:0/511130487 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e013c5f0 con 0x7fd0e0140b80 2022-04-28T14:41:22.707 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.699+0000 7fd0e56ec700 1 --2- 172.21.15.22:0/511130487 >> v2:172.21.15.22:3300/0 conn(0x7fd0e00a5450 0x7fd0e0067010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:22.707 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.699+0000 7fd0e5eed700 1 --2- 172.21.15.22:0/511130487 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd0e0140b80 0x7fd0e0142f70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fd0d8009e60 tx=0x7fd0d8009780).ready entity=mon.2 client_cookie=e19fb4cb71b1dd3f server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:22.707 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.699+0000 7fd0cffff700 1 -- 172.21.15.22:0/511130487 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d800e070 con 0x7fd0e0140b80 2022-04-28T14:41:22.707 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.699+0000 7fd0cffff700 1 -- 172.21.15.22:0/511130487 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d800bab0 con 0x7fd0e0140b80 2022-04-28T14:41:22.707 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.699+0000 7fd0cffff700 1 -- 172.21.15.22:0/511130487 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d800be30 con 0x7fd0e0140b80 2022-04-28T14:41:22.707 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.700+0000 7fd0e7950700 1 -- 172.21.15.22:0/511130487 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd0e0140b80 msgr2=0x7fd0e0142f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:22.707 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.700+0000 7fd0e7950700 1 --2- 172.21.15.22:0/511130487 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd0e0140b80 0x7fd0e0142f70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fd0d8009e60 tx=0x7fd0d8009780).stop 2022-04-28T14:41:22.708 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.700+0000 7fd0e7950700 1 -- 172.21.15.22:0/511130487 shutdown_connections 2022-04-28T14:41:22.708 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.700+0000 7fd0e7950700 1 --2- 172.21.15.22:0/511130487 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd0e0140b80 0x7fd0e0142f70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:22.708 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.700+0000 7fd0e7950700 1 --2- 172.21.15.22:0/511130487 >> v2:172.21.15.22:3300/0 conn(0x7fd0e00a5450 0x7fd0e0067010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:22.708 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.700+0000 7fd0e7950700 1 -- 172.21.15.22:0/511130487 >> 172.21.15.22:0/511130487 conn(0x7fd0e0069860 msgr2=0x7fd0e0069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:22.708 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.700+0000 7fd0e7950700 1 -- 172.21.15.22:0/511130487 shutdown_connections 2022-04-28T14:41:22.708 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.700+0000 7fd0e7950700 1 -- 172.21.15.22:0/511130487 wait complete. 2022-04-28T14:41:22.708 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.701+0000 7fd0e7950700 1 Processor -- start 2022-04-28T14:41:22.708 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.701+0000 7fd0e7950700 1 -- start start 2022-04-28T14:41:22.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.702+0000 7fd0e7950700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd0e00a5450 0x7fd0e01384b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:22.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.702+0000 7fd0e7950700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0e0135740 0x7fd0e0136150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:22.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.702+0000 7fd0e7950700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd0e0140b80 0x7fd0e0130ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:22.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.702+0000 7fd0e7950700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e0137af0 con 0x7fd0e0135740 2022-04-28T14:41:22.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.702+0000 7fd0e7950700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e0137dd0 con 0x7fd0e00a5450 2022-04-28T14:41:22.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.702+0000 7fd0e7950700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e0136b20 con 0x7fd0e0140b80 2022-04-28T14:41:22.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.702+0000 7fd0e4eeb700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0e0135740 0x7fd0e0136150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:22.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.702+0000 7fd0e4eeb700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0e0135740 0x7fd0e0136150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50128/0 (socket says 172.21.15.22:50128) 2022-04-28T14:41:22.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.702+0000 7fd0e4eeb700 1 -- 172.21.15.22:0/686170957 learned_addr learned my addr 172.21.15.22:0/686170957 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:22.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.702+0000 7fd0e5eed700 1 --2- 172.21.15.22:0/686170957 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd0e0140b80 0x7fd0e0130ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:22.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.702+0000 7fd0e56ec700 1 --2- 172.21.15.22:0/686170957 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd0e00a5450 0x7fd0e01384b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:22.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.702+0000 7fd0e5eed700 1 -- 172.21.15.22:0/686170957 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd0e00a5450 msgr2=0x7fd0e01384b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:22.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.702+0000 7fd0e5eed700 1 --2- 172.21.15.22:0/686170957 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd0e00a5450 0x7fd0e01384b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:22.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.702+0000 7fd0e5eed700 1 -- 172.21.15.22:0/686170957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0e0135740 msgr2=0x7fd0e0136150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:22.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.702+0000 7fd0e5eed700 1 --2- 172.21.15.22:0/686170957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0e0135740 0x7fd0e0136150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:22.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.702+0000 7fd0e5eed700 1 -- 172.21.15.22:0/686170957 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0dc0092a0 con 0x7fd0e0140b80 2022-04-28T14:41:22.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.702+0000 7fd0e56ec700 1 --2- 172.21.15.22:0/686170957 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd0e00a5450 0x7fd0e01384b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:22.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.702+0000 7fd0e5eed700 1 --2- 172.21.15.22:0/686170957 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd0e0140b80 0x7fd0e0130ae0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fd0d8014000 tx=0x7fd0d8009780).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:22.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.702+0000 7fd0cd7fa700 1 -- 172.21.15.22:0/686170957 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d8013e40 con 0x7fd0e0140b80 2022-04-28T14:41:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.702+0000 7fd0e7950700 1 -- 172.21.15.22:0/686170957 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d8009a20 con 0x7fd0e0140b80 2022-04-28T14:41:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.703+0000 7fd0cd7fa700 1 -- 172.21.15.22:0/686170957 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d801d630 con 0x7fd0e0140b80 2022-04-28T14:41:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.703+0000 7fd0cd7fa700 1 -- 172.21.15.22:0/686170957 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d801d9f0 con 0x7fd0e0140b80 2022-04-28T14:41:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.703+0000 7fd0e7950700 1 -- 172.21.15.22:0/686170957 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e013efa0 con 0x7fd0e0140b80 2022-04-28T14:41:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.703+0000 7fd0cd7fa700 1 -- 172.21.15.22:0/686170957 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 4) v1 ==== 22927+0+0 (secure 0 0 0) 0x7fd0d8026410 con 0x7fd0e0140b80 2022-04-28T14:41:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.703+0000 7fd0cd7fa700 1 -- 172.21.15.22:0/686170957 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fd0d8028e30 con 0x7fd0e0140b80 2022-04-28T14:41:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.703+0000 7fd0e56ec700 1 -- 172.21.15.22:0/686170957 >> v1:172.21.15.22:6808/86956 conn(0x7fd0c001c940 legacy=0x7fd0c001ee00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.22:6808/86956 2022-04-28T14:41:22.713 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.704+0000 7fd0e7950700 1 -- 172.21.15.22:0/686170957 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0e0137f10 con 0x7fd0e0140b80 2022-04-28T14:41:22.714 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.707+0000 7fd0cd7fa700 1 -- 172.21.15.22:0/686170957 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+101097 (secure 0 0 0) 0x7fd0e0137f10 con 0x7fd0e0140b80 2022-04-28T14:41:22.818 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.813+0000 7fd0e7950700 1 -- 172.21.15.22:0/686170957 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0e0137f10 con 0x7fd0e0140b80 2022-04-28T14:41:22.818 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.814+0000 7fd0cd7fa700 1 -- 172.21.15.22:0/686170957 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+9651 (secure 0 0 0) 0x7fd0e0137f10 con 0x7fd0e0140b80 2022-04-28T14:41:22.818 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:41:22.819 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":17,"fsid":"3047163a-0285-4058-8e05-ce74c6fbb9c5","created":"2022-04-28T14:38:54.232890+0000","modified":"2022-04-28T14:39:26.606234+0000","last_up_change":"2022-04-28T14:39:00.269721+0000","last_in_change":"2022-04-28T14:39:00.269721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-04-28T14:39:03.639717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-04-28T14:39:12.000229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-04-28T14:39:12.915097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"782ee638-1ada-48d9-9454-f9e0ca8a3135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6800","nonce":87556}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":87556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":87556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":87556}]},"public_addr":"172.21.15.22:6800/87556","cluster_addr":"172.21.15.22:6801/87556","heartbeat_back_addr":"172.21.15.22:6803/87556","heartbeat_front_addr":"172.21.15.22:6802/87556","state":["exists","up"]},{"osd":1,"uuid":"61ca6f96-fb4f-4c0f-b68b-edf1e7011f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":87557}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":87557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":87557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":87557}]},"public_addr":"172.21.15.22:6804/87557","cluster_addr":"172.21.15.22:6805/87557","heartbeat_back_addr":"172.21.15.22:6807/87557","heartbeat_front_addr":"172.21.15.22:6806/87557","state":["exists","up"]},{"osd":2,"uuid":"4b3043b9-50df-4b7f-a55a-ac8e6148c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":87558}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":87558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":87558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":87558}]},"public_addr":"172.21.15.22:6813/87558","cluster_addr":"172.21.15.22:6814/87558","heartbeat_back_addr":"172.21.15.22:6816/87558","heartbeat_front_addr":"172.21.15.22:6815/87558","state":["exists","up"]},{"osd":3,"uuid":"7807bcd1-53f8-44b5-9992-57c328e5b299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":87561}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":87561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":87561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":87561}]},"public_addr":"172.21.15.22:6809/87561","cluster_addr":"172.21.15.22:6810/87561","heartbeat_back_addr":"172.21.15.22:6812/87561","heartbeat_front_addr":"172.21.15.22:6811/87561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-04-28T14:41:22.820 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.815+0000 7fd0e7950700 1 -- 172.21.15.22:0/686170957 >> v1:172.21.15.22:6808/86956 conn(0x7fd0c001c940 legacy=0x7fd0c001ee00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-04-28T14:41:22.820 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.815+0000 7fd0e7950700 1 -- 172.21.15.22:0/686170957 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd0e0140b80 msgr2=0x7fd0e0130ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:22.820 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.815+0000 7fd0e7950700 1 --2- 172.21.15.22:0/686170957 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd0e0140b80 0x7fd0e0130ae0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fd0d8014000 tx=0x7fd0d8009780).stop 2022-04-28T14:41:22.820 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.815+0000 7fd0e7950700 1 -- 172.21.15.22:0/686170957 shutdown_connections 2022-04-28T14:41:22.820 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.815+0000 7fd0e7950700 1 --2- 172.21.15.22:0/686170957 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd0e0140b80 0x7fd0e0130ae0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:22.820 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.815+0000 7fd0e7950700 1 --2- 172.21.15.22:0/686170957 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd0e00a5450 0x7fd0e01384b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:22.821 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.815+0000 7fd0e7950700 1 --2- 172.21.15.22:0/686170957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0e0135740 0x7fd0e0136150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:22.821 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.815+0000 7fd0e7950700 1 -- 172.21.15.22:0/686170957 >> 172.21.15.22:0/686170957 conn(0x7fd0e0069860 msgr2=0x7fd0e0066b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:22.821 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.815+0000 7fd0e7950700 1 -- 172.21.15.22:0/686170957 shutdown_connections 2022-04-28T14:41:22.821 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.815+0000 7fd0e7950700 1 -- 172.21.15.22:0/686170957 wait complete. 2022-04-28T14:41:22.832 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2022-04-28T14:41:22.897 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:22.892+0000 7fd9ecf21680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-04-28T14:41:22.989 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:22.985+0000 7fd9ecf21680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-04-28T14:41:23.003 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.999+0000 7ff7d46f9700 1 Processor -- start 2022-04-28T14:41:23.003 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.999+0000 7ff7d46f9700 1 -- start start 2022-04-28T14:41:23.006 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.999+0000 7ff7d46f9700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff7cc063e20 0x7ff7cc09a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:23.006 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:22.999+0000 7ff7d46f9700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff7cc099420 0x7ff7cc097ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:23.006 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.000+0000 7ff7d46f9700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7cc064200 con 0x7ff7cc09c6b0 2022-04-28T14:41:23.006 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.000+0000 7ff7d46f9700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7cc0988b0 con 0x7ff7cc063e20 2022-04-28T14:41:23.006 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.000+0000 7ff7d46f9700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc098b50 con 0x7ff7cc099420 2022-04-28T14:41:23.006 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.000+0000 7ff7d1c94700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff7cc099420 0x7ff7cc097ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:23.006 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.000+0000 7ff7d2495700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff7cc063e20 0x7ff7cc09a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:23.006 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.000+0000 7ff7d2c96700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff7cc09c6b0 0x7ff7cc09cb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39532/0 (socket says 172.21.15.22:39532) 2022-04-28T14:41:23.007 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.000+0000 7ff7d1c94700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff7cc099420 0x7ff7cc097ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:47486/0 (socket says 172.21.15.22:47486) 2022-04-28T14:41:23.007 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.000+0000 7ff7d2c96700 1 -- 172.21.15.22:0/934699009 learned_addr learned my addr 172.21.15.22:0/934699009 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:41:23.007 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.000+0000 7ff7d1493700 1 -- 172.21.15.22:0/934699009 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1996832448 0 0) 0x7ff7cc064200 con 0x7ff7cc09c6b0 2022-04-28T14:41:23.007 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.000+0000 7ff7d1493700 1 -- 172.21.15.22:0/934699009 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7b40033f0 con 0x7ff7cc09c6b0 2022-04-28T14:41:23.007 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.000+0000 7ff7d1c94700 1 -- 172.21.15.22:0/934699009 >> v2:172.21.15.22:3300/0 conn(0x7ff7cc063e20 msgr2=0x7ff7cc09a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:23.007 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.000+0000 7ff7d1c94700 1 --2- 172.21.15.22:0/934699009 >> v2:172.21.15.22:3300/0 conn(0x7ff7cc063e20 0x7ff7cc09a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:23.007 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.000+0000 7ff7d1c94700 1 -- 172.21.15.22:0/934699009 >> v1:172.21.15.22:6789/0 conn(0x7ff7cc09c6b0 legacy=0x7ff7cc09cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.007 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.000+0000 7ff7d1c94700 1 -- 172.21.15.22:0/934699009 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc099840 con 0x7ff7cc099420 2022-04-28T14:41:23.007 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.000+0000 7ff7d2495700 1 --2- 172.21.15.22:0/934699009 >> v2:172.21.15.22:3300/0 conn(0x7ff7cc063e20 0x7ff7cc09a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:23.007 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.000+0000 7ff7d1c94700 1 --2- 172.21.15.22:0/934699009 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff7cc099420 0x7ff7cc097ff0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7ff7bc009760 tx=0x7ff7bc009060).ready entity=mon.2 client_cookie=c153794b1935c779 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:23.008 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.000+0000 7ff7d1493700 1 -- 172.21.15.22:0/934699009 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc00d4a0 con 0x7ff7cc099420 2022-04-28T14:41:23.008 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.000+0000 7ff7d1493700 1 -- 172.21.15.22:0/934699009 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc00d600 con 0x7ff7cc099420 2022-04-28T14:41:23.008 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.000+0000 7ff7d1493700 1 -- 172.21.15.22:0/934699009 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc00d980 con 0x7ff7cc099420 2022-04-28T14:41:23.008 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.001+0000 7ff7d46f9700 1 -- 172.21.15.22:0/934699009 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff7cc099420 msgr2=0x7ff7cc097ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.008 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.001+0000 7ff7d46f9700 1 --2- 172.21.15.22:0/934699009 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff7cc099420 0x7ff7cc097ff0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7ff7bc009760 tx=0x7ff7bc009060).stop 2022-04-28T14:41:23.008 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.001+0000 7ff7d46f9700 1 -- 172.21.15.22:0/934699009 shutdown_connections 2022-04-28T14:41:23.008 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.001+0000 7ff7d46f9700 1 --2- 172.21.15.22:0/934699009 >> v2:172.21.15.22:3300/0 conn(0x7ff7cc063e20 0x7ff7cc09a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:23.008 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.001+0000 7ff7d46f9700 1 --2- 172.21.15.22:0/934699009 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff7cc099420 0x7ff7cc097ff0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:23.008 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.001+0000 7ff7d46f9700 1 -- 172.21.15.22:0/934699009 >> 172.21.15.22:0/934699009 conn(0x7ff7cc0aaf80 msgr2=0x7ff7cc0ab390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:23.009 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.001+0000 7ff7d46f9700 1 -- 172.21.15.22:0/934699009 shutdown_connections 2022-04-28T14:41:23.009 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.001+0000 7ff7d46f9700 1 -- 172.21.15.22:0/934699009 wait complete. 2022-04-28T14:41:23.011 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.003+0000 7ff7d46f9700 1 Processor -- start 2022-04-28T14:41:23.011 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.003+0000 7ff7d46f9700 1 -- start start 2022-04-28T14:41:23.011 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.003+0000 7ff7d46f9700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff7cc063e20 0x7ff7cc09f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:23.012 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.003+0000 7ff7d46f9700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff7cc099420 0x7ff7cc094b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:23.012 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.003+0000 7ff7d46f9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7cc09c6b0 0x7ff7cc1456b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:23.012 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.003+0000 7ff7d46f9700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc09f120 con 0x7ff7cc09c6b0 2022-04-28T14:41:23.012 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.003+0000 7ff7d46f9700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc146110 con 0x7ff7cc063e20 2022-04-28T14:41:23.012 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.003+0000 7ff7d46f9700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc1463d0 con 0x7ff7cc099420 2022-04-28T14:41:23.012 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.004+0000 7ff7d1c94700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff7cc099420 0x7ff7cc094b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:23.012 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.004+0000 7ff7d1c94700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff7cc099420 0x7ff7cc094b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:47492/0 (socket says 172.21.15.22:47492) 2022-04-28T14:41:23.012 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.004+0000 7ff7d1c94700 1 -- 172.21.15.22:0/729312557 learned_addr learned my addr 172.21.15.22:0/729312557 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:23.012 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.004+0000 7ff7d2495700 1 --2- 172.21.15.22:0/729312557 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff7cc063e20 0x7ff7cc09f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:23.012 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.004+0000 7ff7d2c96700 1 --2- 172.21.15.22:0/729312557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7cc09c6b0 0x7ff7cc1456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:23.013 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.004+0000 7ff7d2495700 1 -- 172.21.15.22:0/729312557 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff7cc099420 msgr2=0x7ff7cc094b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.013 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.004+0000 7ff7d2495700 1 --2- 172.21.15.22:0/729312557 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff7cc099420 0x7ff7cc094b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:23.013 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.004+0000 7ff7d2495700 1 -- 172.21.15.22:0/729312557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7cc09c6b0 msgr2=0x7ff7cc1456b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.013 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.004+0000 7ff7d2495700 1 --2- 172.21.15.22:0/729312557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7cc09c6b0 0x7ff7cc1456b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:23.013 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.004+0000 7ff7d2495700 1 -- 172.21.15.22:0/729312557 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c80092a0 con 0x7ff7cc063e20 2022-04-28T14:41:23.013 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.004+0000 7ff7d1c94700 1 --2- 172.21.15.22:0/729312557 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff7cc099420 0x7ff7cc094b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:23.013 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.004+0000 7ff7d2c96700 1 --2- 172.21.15.22:0/729312557 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7cc09c6b0 0x7ff7cc1456b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:23.013 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.004+0000 7ff7d2495700 1 --2- 172.21.15.22:0/729312557 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff7cc063e20 0x7ff7cc09f900 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7ff7c800e980 tx=0x7ff7c8009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:23.013 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.004+0000 7ff7ba7fc700 1 -- 172.21.15.22:0/729312557 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c8009580 con 0x7ff7cc063e20 2022-04-28T14:41:23.013 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.004+0000 7ff7ba7fc700 1 -- 172.21.15.22:0/729312557 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c8012600 con 0x7ff7cc063e20 2022-04-28T14:41:23.014 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.004+0000 7ff7d46f9700 1 -- 172.21.15.22:0/729312557 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7bc0092a0 con 0x7ff7cc063e20 2022-04-28T14:41:23.014 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.004+0000 7ff7ba7fc700 1 -- 172.21.15.22:0/729312557 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c8012980 con 0x7ff7cc063e20 2022-04-28T14:41:23.014 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.004+0000 7ff7d46f9700 1 -- 172.21.15.22:0/729312557 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7cc096860 con 0x7ff7cc063e20 2022-04-28T14:41:23.014 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.005+0000 7ff7ba7fc700 1 -- 172.21.15.22:0/729312557 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 4) v1 ==== 22927+0+0 (secure 0 0 0) 0x7ff7c8022070 con 0x7ff7cc063e20 2022-04-28T14:41:23.014 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.005+0000 7ff7ba7fc700 1 -- 172.21.15.22:0/729312557 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7ff7c802aab0 con 0x7ff7cc063e20 2022-04-28T14:41:23.014 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.005+0000 7ff7d1c94700 1 -- 172.21.15.22:0/729312557 >> v1:172.21.15.22:6808/86956 conn(0x7ff7ac01c940 legacy=0x7ff7ac01ee00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.22:6808/86956 2022-04-28T14:41:23.014 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.005+0000 7ff7d46f9700 1 -- 172.21.15.22:0/729312557 --> v1:172.21.15.22:6800/87556 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff7cc059990 con 0x7ff7cc145ba0 2022-04-28T14:41:23.014 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.006+0000 7ff7ba7fc700 1 -- 172.21.15.22:0/729312557 <== osd.0 v1:172.21.15.22:6800/87556 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7ff7cc059990 con 0x7ff7cc145ba0 2022-04-28T14:41:23.015 INFO:tasks.ceph.mgr.x.smithi022.stderr:2022-04-28T14:41:23.009+0000 7f45dcff7680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-04-28T14:41:23.022 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.018+0000 7ff7d46f9700 1 -- 172.21.15.22:0/729312557 --> v1:172.21.15.22:6800/87556 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff7cc046540 con 0x7ff7cc145ba0 2022-04-28T14:41:23.022 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.018+0000 7ff7ba7fc700 1 -- 172.21.15.22:0/729312557 <== osd.0 v1:172.21.15.22:6800/87556 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 719924382) 0x7ff7cc046540 con 0x7ff7cc145ba0 2022-04-28T14:41:23.023 INFO:teuthology.orchestra.run.smithi022.stdout:38654705694 2022-04-28T14:41:23.024 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.018+0000 7ff7d46f9700 1 -- 172.21.15.22:0/729312557 >> v1:172.21.15.22:6800/87556 conn(0x7ff7cc145ba0 legacy=0x7ff7cc148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.024 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.018+0000 7ff7d46f9700 1 -- 172.21.15.22:0/729312557 >> v1:172.21.15.22:6808/86956 conn(0x7ff7ac01c940 legacy=0x7ff7ac01ee00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-04-28T14:41:23.024 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.018+0000 7ff7d46f9700 1 -- 172.21.15.22:0/729312557 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff7cc063e20 msgr2=0x7ff7cc09f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.024 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.018+0000 7ff7d46f9700 1 --2- 172.21.15.22:0/729312557 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff7cc063e20 0x7ff7cc09f900 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7ff7c800e980 tx=0x7ff7c8009060).stop 2022-04-28T14:41:23.024 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.018+0000 7ff7d2c96700 1 -- 172.21.15.22:0/729312557 reap_dead start 2022-04-28T14:41:23.024 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.018+0000 7ff7d46f9700 1 -- 172.21.15.22:0/729312557 shutdown_connections 2022-04-28T14:41:23.024 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.018+0000 7ff7d46f9700 1 -- 172.21.15.22:0/729312557 >> 172.21.15.22:0/729312557 conn(0x7ff7cc0aaf80 msgr2=0x7ff7cc090b50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:23.025 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.018+0000 7ff7d46f9700 1 -- 172.21.15.22:0/729312557 shutdown_connections 2022-04-28T14:41:23.025 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.019+0000 7ff7d46f9700 1 -- 172.21.15.22:0/729312557 wait complete. 2022-04-28T14:41:23.035 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2022-04-28T14:41:23.127 INFO:tasks.ceph.mgr.x.smithi022.stderr:2022-04-28T14:41:23.122+0000 7f45dcff7680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-04-28T14:41:23.196 INFO:tasks.ceph.mgr.x.smithi022.stderr:2022-04-28T14:41:23.191+0000 7f45dcff7680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-04-28T14:41:23.197 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.193+0000 7f8fb251a700 1 Processor -- start 2022-04-28T14:41:23.198 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.193+0000 7f8fb251a700 1 -- start start 2022-04-28T14:41:23.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.194+0000 7f8fb251a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8fac0a9ee0 0x7f8fac0a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:23.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.194+0000 7f8fb251a700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8fac13e980 0x7f8fac140d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:23.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.194+0000 7f8fb251a700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fac0a2920 con 0x7f8fac0a3070 2022-04-28T14:41:23.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.194+0000 7f8fb251a700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fac13a540 con 0x7f8fac0a9ee0 2022-04-28T14:41:23.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.194+0000 7f8fb251a700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac13a280 con 0x7f8fac13e980 2022-04-28T14:41:23.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.194+0000 7f8fabfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8fac0a9ee0 0x7f8fac0a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:23.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.194+0000 7f8fb0ab7700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8fac13e980 0x7f8fac140d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:23.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.194+0000 7f8fabfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8fac0a9ee0 0x7f8fac0a1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50152/0 (socket says 172.21.15.22:50152) 2022-04-28T14:41:23.201 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.194+0000 7f8fb0ab7700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8fac13e980 0x7f8fac140d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:47506/0 (socket says 172.21.15.22:47506) 2022-04-28T14:41:23.201 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.194+0000 7f8fab7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f8fac0a3070 0x7f8fac1398b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39548/0 (socket says 172.21.15.22:39548) 2022-04-28T14:41:23.201 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.194+0000 7f8fabfff700 1 -- 172.21.15.22:0/901361851 learned_addr learned my addr 172.21.15.22:0/901361851 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:23.201 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.195+0000 7f8fabfff700 1 -- 172.21.15.22:0/901361851 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8fac13e980 msgr2=0x7f8fac140d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:23.201 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.195+0000 7f8fabfff700 1 --2- 172.21.15.22:0/901361851 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8fac13e980 0x7f8fac140d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:23.201 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.195+0000 7f8fabfff700 1 -- 172.21.15.22:0/901361851 >> v1:172.21.15.22:6789/0 conn(0x7f8fac0a3070 legacy=0x7f8fac1398b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.201 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.195+0000 7f8fabfff700 1 -- 172.21.15.22:0/901361851 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fac139fc0 con 0x7f8fac0a9ee0 2022-04-28T14:41:23.201 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.195+0000 7f8fabfff700 1 --2- 172.21.15.22:0/901361851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fac0a9ee0 0x7f8fac0a1dc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f8f9c006fd0 tx=0x7f8f9c0090f0).ready entity=mon.0 client_cookie=b2bf9275b3553b01 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:23.201 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.195+0000 7f8faaffd700 1 -- 172.21.15.22:0/901361851 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c00b580 con 0x7f8fac0a9ee0 2022-04-28T14:41:23.201 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.195+0000 7f8faaffd700 1 -- 172.21.15.22:0/901361851 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9c00b6e0 con 0x7f8fac0a9ee0 2022-04-28T14:41:23.202 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.195+0000 7f8faaffd700 1 -- 172.21.15.22:0/901361851 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c00ba60 con 0x7f8fac0a9ee0 2022-04-28T14:41:23.205 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.196+0000 7f8fb251a700 1 -- 172.21.15.22:0/901361851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fac0a9ee0 msgr2=0x7f8fac0a1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.205 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.196+0000 7f8fb251a700 1 --2- 172.21.15.22:0/901361851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fac0a9ee0 0x7f8fac0a1dc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f8f9c006fd0 tx=0x7f8f9c0090f0).stop 2022-04-28T14:41:23.205 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.196+0000 7f8fb251a700 1 -- 172.21.15.22:0/901361851 shutdown_connections 2022-04-28T14:41:23.205 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.196+0000 7f8fb251a700 1 --2- 172.21.15.22:0/901361851 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8fac13e980 0x7f8fac140d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:23.205 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.196+0000 7f8fb251a700 1 --2- 172.21.15.22:0/901361851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fac0a9ee0 0x7f8fac0a1dc0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:23.205 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.196+0000 7f8fb251a700 1 -- 172.21.15.22:0/901361851 >> 172.21.15.22:0/901361851 conn(0x7f8fac069860 msgr2=0x7f8fac069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:23.205 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.196+0000 7f8fb251a700 1 -- 172.21.15.22:0/901361851 shutdown_connections 2022-04-28T14:41:23.206 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.196+0000 7f8fb251a700 1 -- 172.21.15.22:0/901361851 wait complete. 2022-04-28T14:41:23.206 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.197+0000 7f8fb251a700 1 Processor -- start 2022-04-28T14:41:23.206 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.197+0000 7f8fb251a700 1 -- start start 2022-04-28T14:41:23.206 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.198+0000 7f8fb251a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fac0a3070 0x7f8fac0ad240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:23.206 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.198+0000 7f8fb251a700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8fac0a9ee0 0x7f8fac149200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:23.206 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.198+0000 7f8fb251a700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8fac13e980 0x7f8fac1496f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:23.206 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.198+0000 7f8fb251a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac0ac880 con 0x7f8fac0a3070 2022-04-28T14:41:23.206 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.198+0000 7f8fb251a700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac0acb60 con 0x7f8fac13e980 2022-04-28T14:41:23.206 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.198+0000 7f8fb251a700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fac0ab1c0 con 0x7f8fac0a9ee0 2022-04-28T14:41:23.206 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.199+0000 7f8fab7fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8fac0a9ee0 0x7f8fac149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:23.207 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.199+0000 7f8fb0ab7700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8fac13e980 0x7f8fac1496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:23.207 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.199+0000 7f8fb0ab7700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8fac13e980 0x7f8fac1496f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:47728/0 (socket says 172.21.15.22:47728) 2022-04-28T14:41:23.207 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.199+0000 7f8fab7fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8fac0a9ee0 0x7f8fac149200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:47510/0 (socket says 172.21.15.22:47510) 2022-04-28T14:41:23.207 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.199+0000 7f8fb0ab7700 1 -- 172.21.15.22:0/34998285 learned_addr learned my addr 172.21.15.22:0/34998285 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:23.207 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.199+0000 7f8fabfff700 1 --2- 172.21.15.22:0/34998285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fac0a3070 0x7f8fac0ad240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:23.207 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.199+0000 7f8fb0ab7700 1 -- 172.21.15.22:0/34998285 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8fac0a9ee0 msgr2=0x7f8fac149200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.207 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.199+0000 7f8fb0ab7700 1 --2- 172.21.15.22:0/34998285 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8fac0a9ee0 0x7f8fac149200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:23.207 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.199+0000 7f8fb0ab7700 1 -- 172.21.15.22:0/34998285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fac0a3070 msgr2=0x7f8fac0ad240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.207 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.199+0000 7f8fb0ab7700 1 --2- 172.21.15.22:0/34998285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fac0a3070 0x7f8fac0ad240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:23.207 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.199+0000 7f8fb0ab7700 1 -- 172.21.15.22:0/34998285 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9c009370 con 0x7f8fac13e980 2022-04-28T14:41:23.208 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.199+0000 7f8fabfff700 1 --2- 172.21.15.22:0/34998285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fac0a3070 0x7f8fac0ad240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:23.208 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.199+0000 7f8fb0ab7700 1 --2- 172.21.15.22:0/34998285 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8fac13e980 0x7f8fac1496f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f8fa4009ec0 tx=0x7f8fa400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:23.208 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.199+0000 7f8f93fff700 1 -- 172.21.15.22:0/34998285 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa400cb70 con 0x7f8fac13e980 2022-04-28T14:41:23.208 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.199+0000 7f8f93fff700 1 -- 172.21.15.22:0/34998285 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa400f040 con 0x7f8fac13e980 2022-04-28T14:41:23.208 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.199+0000 7f8fb251a700 1 -- 172.21.15.22:0/34998285 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fac0aaf00 con 0x7f8fac13e980 2022-04-28T14:41:23.208 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.199+0000 7f8f93fff700 1 -- 172.21.15.22:0/34998285 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa40135c0 con 0x7f8fac13e980 2022-04-28T14:41:23.208 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.199+0000 7f8fb251a700 1 -- 172.21.15.22:0/34998285 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fac13cef0 con 0x7f8fac13e980 2022-04-28T14:41:23.208 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.200+0000 7f8f93fff700 1 -- 172.21.15.22:0/34998285 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 4) v1 ==== 22927+0+0 (secure 0 0 0) 0x7f8fa4013930 con 0x7f8fac13e980 2022-04-28T14:41:23.208 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.200+0000 7f8f93fff700 1 -- 172.21.15.22:0/34998285 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f8fa402e7c0 con 0x7f8fac13e980 2022-04-28T14:41:23.208 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.200+0000 7f8fabfff700 1 -- 172.21.15.22:0/34998285 >> v1:172.21.15.22:6808/86956 conn(0x7f8f8c01c910 legacy=0x7f8f8c01edd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.22:6808/86956 2022-04-28T14:41:23.209 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.201+0000 7f8fb251a700 1 -- 172.21.15.22:0/34998285 --> v1:172.21.15.22:6804/87557 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8fac0accd0 con 0x7f8fac0ab390 2022-04-28T14:41:23.209 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.201+0000 7f8f93fff700 1 -- 172.21.15.22:0/34998285 <== osd.1 v1:172.21.15.22:6804/87557 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7f8fac0accd0 con 0x7f8fac0ab390 2022-04-28T14:41:23.218 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.207+0000 7f8fb251a700 1 -- 172.21.15.22:0/34998285 --> v1:172.21.15.22:6804/87557 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8fac0aac80 con 0x7f8fac0ab390 2022-04-28T14:41:23.218 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.207+0000 7f8f93fff700 1 -- 172.21.15.22:0/34998285 <== osd.1 v1:172.21.15.22:6804/87557 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 1350886875) 0x7f8fac0aac80 con 0x7f8fac0ab390 2022-04-28T14:41:23.219 INFO:teuthology.orchestra.run.smithi022.stdout:38654705693 2022-04-28T14:41:23.220 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.208+0000 7f8fb251a700 1 -- 172.21.15.22:0/34998285 >> v1:172.21.15.22:6804/87557 conn(0x7f8fac0ab390 legacy=0x7f8fac132e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.220 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.208+0000 7f8fb251a700 1 -- 172.21.15.22:0/34998285 >> v1:172.21.15.22:6808/86956 conn(0x7f8f8c01c910 legacy=0x7f8f8c01edd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-04-28T14:41:23.220 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.208+0000 7f8fb251a700 1 -- 172.21.15.22:0/34998285 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8fac13e980 msgr2=0x7f8fac1496f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.220 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.208+0000 7f8fb251a700 1 --2- 172.21.15.22:0/34998285 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8fac13e980 0x7f8fac1496f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f8fa4009ec0 tx=0x7f8fa400b040).stop 2022-04-28T14:41:23.220 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.208+0000 7f8fb0ab7700 1 -- 172.21.15.22:0/34998285 reap_dead start 2022-04-28T14:41:23.221 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.208+0000 7f8fb251a700 1 -- 172.21.15.22:0/34998285 shutdown_connections 2022-04-28T14:41:23.221 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.208+0000 7f8fb251a700 1 -- 172.21.15.22:0/34998285 >> 172.21.15.22:0/34998285 conn(0x7f8fac069860 msgr2=0x7f8fac0a18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:23.221 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.208+0000 7f8fb251a700 1 -- 172.21.15.22:0/34998285 shutdown_connections 2022-04-28T14:41:23.221 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.208+0000 7f8fb251a700 1 -- 172.21.15.22:0/34998285 wait complete. 2022-04-28T14:41:23.225 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2022-04-28T14:41:23.341 INFO:tasks.ceph.mgr.x.smithi022.stderr:2022-04-28T14:41:23.337+0000 7f45dcff7680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-04-28T14:41:23.345 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:23.341+0000 7fd9ecf21680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-04-28T14:41:23.350 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.346+0000 7fd0d35bd700 1 Processor -- start 2022-04-28T14:41:23.351 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.346+0000 7fd0d35bd700 1 -- start start 2022-04-28T14:41:23.353 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.347+0000 7fd0d35bd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd0cc064530 0x7fd0cc1364e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:23.353 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.347+0000 7fd0d35bd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd0cc0a8cb0 0x7fd0cc1409b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:23.353 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.347+0000 7fd0d35bd700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0cc064910 con 0x7fd0cc1369d0 2022-04-28T14:41:23.354 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.347+0000 7fd0d35bd700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0cc0a8020 con 0x7fd0cc0a8cb0 2022-04-28T14:41:23.354 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.347+0000 7fd0d35bd700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc062250 con 0x7fd0cc064530 2022-04-28T14:41:23.354 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.347+0000 7fd0d0b58700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd0cc1369d0 0x7fd0cc0a85a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39562/0 (socket says 172.21.15.22:39562) 2022-04-28T14:41:23.354 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.347+0000 7fd0d0b58700 1 -- 172.21.15.22:0/2546330611 learned_addr learned my addr 172.21.15.22:0/2546330611 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:41:23.354 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.347+0000 7fd0d1b5a700 1 --2- 172.21.15.22:0/2546330611 >> v2:172.21.15.22:3300/0 conn(0x7fd0cc0a8cb0 0x7fd0cc1409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:23.354 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.347+0000 7fd0d1359700 1 --2- 172.21.15.22:0/2546330611 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd0cc064530 0x7fd0cc1364e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:23.354 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.347+0000 7fd0d1b5a700 1 -- 172.21.15.22:0/2546330611 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd0cc064530 msgr2=0x7fd0cc1364e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:23.354 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.347+0000 7fd0d1b5a700 1 --2- 172.21.15.22:0/2546330611 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd0cc064530 0x7fd0cc1364e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:23.354 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.347+0000 7fd0d1b5a700 1 -- 172.21.15.22:0/2546330611 >> v1:172.21.15.22:6789/0 conn(0x7fd0cc1369d0 legacy=0x7fd0cc0a85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.355 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.347+0000 7fd0bbfff700 1 -- 172.21.15.22:0/2546330611 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469190417 0 0) 0x7fd0cc064910 con 0x7fd0cc1369d0 2022-04-28T14:41:23.355 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.348+0000 7fd0d1b5a700 1 -- 172.21.15.22:0/2546330611 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0cc136eb0 con 0x7fd0cc0a8cb0 2022-04-28T14:41:23.355 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.348+0000 7fd0d1359700 1 --2- 172.21.15.22:0/2546330611 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd0cc064530 0x7fd0cc1364e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:23.355 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.348+0000 7fd0d1b5a700 1 --2- 172.21.15.22:0/2546330611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0cc0a8cb0 0x7fd0cc1409b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fd0c4009e60 tx=0x7fd0c4009780).ready entity=mon.0 client_cookie=e06601fc10843f28 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:23.355 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.348+0000 7fd0bbfff700 1 -- 172.21.15.22:0/2546330611 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c400e070 con 0x7fd0cc0a8cb0 2022-04-28T14:41:23.355 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.348+0000 7fd0bbfff700 1 -- 172.21.15.22:0/2546330611 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c400bb60 con 0x7fd0cc0a8cb0 2022-04-28T14:41:23.355 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.348+0000 7fd0bbfff700 1 -- 172.21.15.22:0/2546330611 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4012410 con 0x7fd0cc0a8cb0 2022-04-28T14:41:23.355 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.348+0000 7fd0d35bd700 1 -- 172.21.15.22:0/2546330611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0cc0a8cb0 msgr2=0x7fd0cc1409b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.355 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.348+0000 7fd0d35bd700 1 --2- 172.21.15.22:0/2546330611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0cc0a8cb0 0x7fd0cc1409b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fd0c4009e60 tx=0x7fd0c4009780).stop 2022-04-28T14:41:23.356 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.349+0000 7fd0d35bd700 1 -- 172.21.15.22:0/2546330611 shutdown_connections 2022-04-28T14:41:23.356 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.349+0000 7fd0d35bd700 1 --2- 172.21.15.22:0/2546330611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0cc0a8cb0 0x7fd0cc1409b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:23.356 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.349+0000 7fd0d35bd700 1 --2- 172.21.15.22:0/2546330611 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd0cc064530 0x7fd0cc1364e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:23.356 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.349+0000 7fd0d35bd700 1 -- 172.21.15.22:0/2546330611 >> 172.21.15.22:0/2546330611 conn(0x7fd0cc067070 msgr2=0x7fd0cc063c60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:23.356 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.349+0000 7fd0d35bd700 1 -- 172.21.15.22:0/2546330611 shutdown_connections 2022-04-28T14:41:23.356 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.349+0000 7fd0d35bd700 1 -- 172.21.15.22:0/2546330611 wait complete. 2022-04-28T14:41:23.359 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.350+0000 7fd0d35bd700 1 Processor -- start 2022-04-28T14:41:23.359 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.350+0000 7fd0d35bd700 1 -- start start 2022-04-28T14:41:23.359 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.350+0000 7fd0d35bd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd0cc064530 0x7fd0cc0a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:23.359 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.350+0000 7fd0d35bd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd0cc0a8cb0 0x7fd0cc091ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:23.359 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.350+0000 7fd0d35bd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0cc1369d0 0x7fd0cc149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:23.359 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.350+0000 7fd0d35bd700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc0926b0 con 0x7fd0cc1369d0 2022-04-28T14:41:23.360 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.350+0000 7fd0d35bd700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc13a5a0 con 0x7fd0cc064530 2022-04-28T14:41:23.360 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.350+0000 7fd0d35bd700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc090c70 con 0x7fd0cc0a8cb0 2022-04-28T14:41:23.360 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.351+0000 7fd0d1359700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd0cc064530 0x7fd0cc0a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:23.360 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.351+0000 7fd0d0b58700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd0cc0a8cb0 0x7fd0cc091ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:23.360 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.351+0000 7fd0d1359700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd0cc064530 0x7fd0cc0a1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:47740/0 (socket says 172.21.15.22:47740) 2022-04-28T14:41:23.360 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.351+0000 7fd0d1359700 1 -- 172.21.15.22:0/3066761866 learned_addr learned my addr 172.21.15.22:0/3066761866 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:23.360 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.351+0000 7fd0d1b5a700 1 --2- 172.21.15.22:0/3066761866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0cc1369d0 0x7fd0cc149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:23.360 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.351+0000 7fd0d1359700 1 -- 172.21.15.22:0/3066761866 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd0cc0a8cb0 msgr2=0x7fd0cc091ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.361 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.351+0000 7fd0d1359700 1 --2- 172.21.15.22:0/3066761866 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd0cc0a8cb0 0x7fd0cc091ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:23.361 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.351+0000 7fd0d1359700 1 -- 172.21.15.22:0/3066761866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0cc1369d0 msgr2=0x7fd0cc149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.361 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.351+0000 7fd0d1359700 1 --2- 172.21.15.22:0/3066761866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0cc1369d0 0x7fd0cc149620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:23.361 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.351+0000 7fd0d1359700 1 -- 172.21.15.22:0/3066761866 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c80092a0 con 0x7fd0cc064530 2022-04-28T14:41:23.361 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.351+0000 7fd0d0b58700 1 --2- 172.21.15.22:0/3066761866 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fd0cc0a8cb0 0x7fd0cc091ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:23.361 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.351+0000 7fd0d1359700 1 --2- 172.21.15.22:0/3066761866 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd0cc064530 0x7fd0cc0a1cf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fd0c800ea50 tx=0x7fd0c8009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:23.361 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.351+0000 7fd0b97fa700 1 -- 172.21.15.22:0/3066761866 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c800ee90 con 0x7fd0cc064530 2022-04-28T14:41:23.361 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.351+0000 7fd0b97fa700 1 -- 172.21.15.22:0/3066761866 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c8013860 con 0x7fd0cc064530 2022-04-28T14:41:23.361 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.352+0000 7fd0b97fa700 1 -- 172.21.15.22:0/3066761866 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8013be0 con 0x7fd0cc064530 2022-04-28T14:41:23.361 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.352+0000 7fd0d35bd700 1 -- 172.21.15.22:0/3066761866 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c4009a20 con 0x7fd0cc064530 2022-04-28T14:41:23.362 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.352+0000 7fd0d35bd700 1 -- 172.21.15.22:0/3066761866 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0cc091150 con 0x7fd0cc064530 2022-04-28T14:41:23.362 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.352+0000 7fd0d35bd700 1 -- 172.21.15.22:0/3066761866 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd0cc066870 con 0x7fd0cc064530 2022-04-28T14:41:23.362 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.353+0000 7fd0b97fa700 1 -- 172.21.15.22:0/3066761866 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 4) v1 ==== 22927+0+0 (secure 0 0 0) 0x7fd0c800c640 con 0x7fd0cc064530 2022-04-28T14:41:23.362 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.353+0000 7fd0b97fa700 1 -- 172.21.15.22:0/3066761866 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7fd0c801ea10 con 0x7fd0cc064530 2022-04-28T14:41:23.362 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.353+0000 7fd0d0b58700 1 -- 172.21.15.22:0/3066761866 >> v1:172.21.15.22:6808/86956 conn(0x7fd0ac01c910 legacy=0x7fd0ac01edd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.22:6808/86956 2022-04-28T14:41:23.362 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.353+0000 7fd0b97fa700 1 -- 172.21.15.22:0/3066761866 --> v1:172.21.15.22:6813/87558 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd0ac0296b0 con 0x7fd0ac0259e0 2022-04-28T14:41:23.362 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.353+0000 7fd0b97fa700 1 -- 172.21.15.22:0/3066761866 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0c801bea0 con 0x7fd0cc064530 2022-04-28T14:41:23.362 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.354+0000 7fd0b97fa700 1 -- 172.21.15.22:0/3066761866 <== osd.2 v1:172.21.15.22:6813/87558 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7fd0ac0296b0 con 0x7fd0ac0259e0 2022-04-28T14:41:23.365 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.360+0000 7fd0d35bd700 1 -- 172.21.15.22:0/3066761866 --> v1:172.21.15.22:6813/87558 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd0cc046540 con 0x7fd0ac0259e0 2022-04-28T14:41:23.365 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.360+0000 7fd0b97fa700 1 -- 172.21.15.22:0/3066761866 <== osd.2 v1:172.21.15.22:6813/87558 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 719924382) 0x7fd0cc046540 con 0x7fd0ac0259e0 2022-04-28T14:41:23.366 INFO:teuthology.orchestra.run.smithi022.stdout:38654705694 2022-04-28T14:41:23.368 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.360+0000 7fd0d35bd700 1 -- 172.21.15.22:0/3066761866 >> v1:172.21.15.22:6813/87558 conn(0x7fd0ac0259e0 legacy=0x7fd0ac027e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.368 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.360+0000 7fd0d35bd700 1 -- 172.21.15.22:0/3066761866 >> v1:172.21.15.22:6808/86956 conn(0x7fd0ac01c910 legacy=0x7fd0ac01edd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-04-28T14:41:23.369 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.360+0000 7fd0d35bd700 1 -- 172.21.15.22:0/3066761866 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd0cc064530 msgr2=0x7fd0cc0a1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.369 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.360+0000 7fd0d35bd700 1 --2- 172.21.15.22:0/3066761866 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fd0cc064530 0x7fd0cc0a1cf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fd0c800ea50 tx=0x7fd0c8009060).stop 2022-04-28T14:41:23.369 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.360+0000 7fd0d1b5a700 1 -- 172.21.15.22:0/3066761866 reap_dead start 2022-04-28T14:41:23.369 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.360+0000 7fd0d35bd700 1 -- 172.21.15.22:0/3066761866 shutdown_connections 2022-04-28T14:41:23.370 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.360+0000 7fd0d35bd700 1 -- 172.21.15.22:0/3066761866 >> 172.21.15.22:0/3066761866 conn(0x7fd0cc067070 msgr2=0x7fd0cc0a8370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:23.371 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.361+0000 7fd0d35bd700 1 -- 172.21.15.22:0/3066761866 shutdown_connections 2022-04-28T14:41:23.371 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.361+0000 7fd0d35bd700 1 -- 172.21.15.22:0/3066761866 wait complete. 2022-04-28T14:41:23.377 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2022-04-28T14:41:23.422 INFO:tasks.ceph.mgr.x.smithi022.stderr:2022-04-28T14:41:23.417+0000 7f45dcff7680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-04-28T14:41:23.445 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:23.441+0000 7fd9ecf21680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-04-28T14:41:23.509 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.494+0000 7f436f9a4700 1 Processor -- start 2022-04-28T14:41:23.509 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.494+0000 7f436f9a4700 1 -- start start 2022-04-28T14:41:23.509 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.495+0000 7f436f9a4700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f43680a9ee0 0x7f43680a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:23.510 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.495+0000 7f436f9a4700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f43680a3070 0x7f43681398b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:23.510 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.495+0000 7f436f9a4700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43680a2920 con 0x7f4368139da0 2022-04-28T14:41:23.510 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.495+0000 7f436f9a4700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f436813a540 con 0x7f43680a9ee0 2022-04-28T14:41:23.510 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.495+0000 7f436f9a4700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436813a280 con 0x7f43680a3070 2022-04-28T14:41:23.511 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.495+0000 7f436d740700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f43680a9ee0 0x7f43680a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:23.511 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.495+0000 7f436cf3f700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f43680a3070 0x7f43681398b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:23.511 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.495+0000 7f436d740700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f43680a9ee0 0x7f43680a1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50182/0 (socket says 172.21.15.22:50182) 2022-04-28T14:41:23.511 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.495+0000 7f436cf3f700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f43680a3070 0x7f43681398b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:47752/0 (socket says 172.21.15.22:47752) 2022-04-28T14:41:23.511 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.495+0000 7f436d740700 1 -- 172.21.15.22:0/90881162 learned_addr learned my addr 172.21.15.22:0/90881162 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:23.512 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.496+0000 7f436d740700 1 -- 172.21.15.22:0/90881162 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f43680a3070 msgr2=0x7f43681398b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:23.512 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.496+0000 7f436d740700 1 --2- 172.21.15.22:0/90881162 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f43680a3070 0x7f43681398b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:23.512 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.496+0000 7f436d740700 1 -- 172.21.15.22:0/90881162 >> v1:172.21.15.22:6789/0 conn(0x7f4368139da0 legacy=0x7f43681360a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.512 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.496+0000 7f436d740700 1 -- 172.21.15.22:0/90881162 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43680a22b0 con 0x7f43680a9ee0 2022-04-28T14:41:23.513 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.496+0000 7f4357fff700 1 -- 172.21.15.22:0/90881162 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 892596822 0 0) 0x7f43680a2920 con 0x7f4368139da0 2022-04-28T14:41:23.513 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.496+0000 7f436cf3f700 1 --2- 172.21.15.22:0/90881162 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f43680a3070 0x7f43681398b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:23.513 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.496+0000 7f436d740700 1 --2- 172.21.15.22:0/90881162 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43680a9ee0 0x7f43680a1dc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f4364006fd0 tx=0x7f43640090f0).ready entity=mon.0 client_cookie=b069bebd1b2e9bc7 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:23.514 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.496+0000 7f4357fff700 1 -- 172.21.15.22:0/90881162 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436400b580 con 0x7f43680a9ee0 2022-04-28T14:41:23.514 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.496+0000 7f4357fff700 1 -- 172.21.15.22:0/90881162 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436400b6e0 con 0x7f43680a9ee0 2022-04-28T14:41:23.514 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.496+0000 7f4357fff700 1 -- 172.21.15.22:0/90881162 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436400ba60 con 0x7f43680a9ee0 2022-04-28T14:41:23.514 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.496+0000 7f436f9a4700 1 -- 172.21.15.22:0/90881162 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43680a9ee0 msgr2=0x7f43680a1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.496+0000 7f436f9a4700 1 --2- 172.21.15.22:0/90881162 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43680a9ee0 0x7f43680a1dc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f4364006fd0 tx=0x7f43640090f0).stop 2022-04-28T14:41:23.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.497+0000 7f436f9a4700 1 -- 172.21.15.22:0/90881162 shutdown_connections 2022-04-28T14:41:23.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.497+0000 7f436f9a4700 1 --2- 172.21.15.22:0/90881162 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43680a9ee0 0x7f43680a1dc0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:23.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.497+0000 7f436f9a4700 1 --2- 172.21.15.22:0/90881162 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f43680a3070 0x7f43681398b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:23.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.497+0000 7f436f9a4700 1 -- 172.21.15.22:0/90881162 >> 172.21.15.22:0/90881162 conn(0x7f4368069860 msgr2=0x7f4368069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:23.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.497+0000 7f436f9a4700 1 -- 172.21.15.22:0/90881162 shutdown_connections 2022-04-28T14:41:23.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.497+0000 7f436f9a4700 1 -- 172.21.15.22:0/90881162 wait complete. 2022-04-28T14:41:23.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.498+0000 7f436f9a4700 1 Processor -- start 2022-04-28T14:41:23.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.498+0000 7f436f9a4700 1 -- start start 2022-04-28T14:41:23.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.499+0000 7f436f9a4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43680a3070 0x7f43680a5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:23.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.499+0000 7f436f9a4700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f43680a9ee0 0x7f43680a47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:23.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.499+0000 7f436f9a4700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4368139da0 0x7f43680acb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:23.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.499+0000 7f436f9a4700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43680a6790 con 0x7f43680a3070 2022-04-28T14:41:23.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.499+0000 7f436f9a4700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43680a6990 con 0x7f4368139da0 2022-04-28T14:41:23.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.499+0000 7f436f9a4700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4368145f50 con 0x7f43680a9ee0 2022-04-28T14:41:23.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.499+0000 7f436cf3f700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f43680a9ee0 0x7f43680a47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:23.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.499+0000 7f436cf3f700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f43680a9ee0 0x7f43680a47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:47542/0 (socket says 172.21.15.22:47542) 2022-04-28T14:41:23.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.499+0000 7f436cf3f700 1 -- 172.21.15.22:0/2541027995 learned_addr learned my addr 172.21.15.22:0/2541027995 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:23.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.500+0000 7f436df41700 1 --2- 172.21.15.22:0/2541027995 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4368139da0 0x7f43680acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:23.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.500+0000 7f436d740700 1 --2- 172.21.15.22:0/2541027995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43680a3070 0x7f43680a5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:23.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.500+0000 7f436df41700 1 -- 172.21.15.22:0/2541027995 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f43680a9ee0 msgr2=0x7f43680a47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.500+0000 7f436df41700 1 --2- 172.21.15.22:0/2541027995 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f43680a9ee0 0x7f43680a47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:23.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.500+0000 7f436df41700 1 -- 172.21.15.22:0/2541027995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43680a3070 msgr2=0x7f43680a5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.520 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.500+0000 7f436df41700 1 --2- 172.21.15.22:0/2541027995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43680a3070 0x7f43680a5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:23.520 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.500+0000 7f436df41700 1 -- 172.21.15.22:0/2541027995 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43580092a0 con 0x7f4368139da0 2022-04-28T14:41:23.520 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.500+0000 7f436d740700 1 --2- 172.21.15.22:0/2541027995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f43680a3070 0x7f43680a5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:23.521 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.500+0000 7f436cf3f700 1 --2- 172.21.15.22:0/2541027995 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f43680a9ee0 0x7f43680a47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:23.521 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.500+0000 7f436df41700 1 --2- 172.21.15.22:0/2541027995 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4368139da0 0x7f43680acb70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f436000c7e0 tx=0x7f4360001480).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:23.521 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.500+0000 7f43557fa700 1 -- 172.21.15.22:0/2541027995 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436000f470 con 0x7f4368139da0 2022-04-28T14:41:23.521 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.500+0000 7f43557fa700 1 -- 172.21.15.22:0/2541027995 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436000f5d0 con 0x7f4368139da0 2022-04-28T14:41:23.522 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.500+0000 7f436f9a4700 1 -- 172.21.15.22:0/2541027995 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4364009370 con 0x7f4368139da0 2022-04-28T14:41:23.522 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.500+0000 7f43557fa700 1 -- 172.21.15.22:0/2541027995 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436000f970 con 0x7f4368139da0 2022-04-28T14:41:23.522 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.500+0000 7f436f9a4700 1 -- 172.21.15.22:0/2541027995 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43680ad060 con 0x7f4368139da0 2022-04-28T14:41:23.522 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.501+0000 7f43557fa700 1 -- 172.21.15.22:0/2541027995 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 4) v1 ==== 22927+0+0 (secure 0 0 0) 0x7f4360019030 con 0x7f4368139da0 2022-04-28T14:41:23.523 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.501+0000 7f43557fa700 1 -- 172.21.15.22:0/2541027995 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f4360029470 con 0x7f4368139da0 2022-04-28T14:41:23.523 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.501+0000 7f436d740700 1 -- 172.21.15.22:0/2541027995 >> v1:172.21.15.22:6808/86956 conn(0x7f4348020d20 legacy=0x7f43480231e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.22:6808/86956 2022-04-28T14:41:23.523 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.501+0000 7f436f9a4700 1 -- 172.21.15.22:0/2541027995 --> v1:172.21.15.22:6809/87561 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4368067500 con 0x7f4368145a90 2022-04-28T14:41:23.523 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.502+0000 7f43557fa700 1 -- 172.21.15.22:0/2541027995 <== osd.3 v1:172.21.15.22:6809/87561 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+5151 (unknown 0 0 4057655604) 0x7f4368067500 con 0x7f4368145a90 2022-04-28T14:41:23.524 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.507+0000 7f436f9a4700 1 -- 172.21.15.22:0/2541027995 --> v1:172.21.15.22:6809/87561 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f43680aa300 con 0x7f4368145a90 2022-04-28T14:41:23.524 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.508+0000 7f43557fa700 1 -- 172.21.15.22:0/2541027995 <== osd.3 v1:172.21.15.22:6809/87561 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 719924382) 0x7f43680aa300 con 0x7f4368145a90 2022-04-28T14:41:23.525 INFO:teuthology.orchestra.run.smithi022.stdout:38654705694 2022-04-28T14:41:23.528 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.508+0000 7f436f9a4700 1 -- 172.21.15.22:0/2541027995 >> v1:172.21.15.22:6809/87561 conn(0x7f4368145a90 legacy=0x7f436813cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.528 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.508+0000 7f436f9a4700 1 -- 172.21.15.22:0/2541027995 >> v1:172.21.15.22:6808/86956 conn(0x7f4348020d20 legacy=0x7f43480231e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-04-28T14:41:23.529 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.508+0000 7f436f9a4700 1 -- 172.21.15.22:0/2541027995 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4368139da0 msgr2=0x7f43680acb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.529 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.508+0000 7f436f9a4700 1 --2- 172.21.15.22:0/2541027995 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4368139da0 0x7f43680acb70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f436000c7e0 tx=0x7f4360001480).stop 2022-04-28T14:41:23.529 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.508+0000 7f436df41700 1 -- 172.21.15.22:0/2541027995 reap_dead start 2022-04-28T14:41:23.529 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.508+0000 7f436f9a4700 1 -- 172.21.15.22:0/2541027995 shutdown_connections 2022-04-28T14:41:23.530 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.508+0000 7f436f9a4700 1 -- 172.21.15.22:0/2541027995 >> 172.21.15.22:0/2541027995 conn(0x7f4368069860 msgr2=0x7f4368137a70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:23.530 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.508+0000 7f436f9a4700 1 -- 172.21.15.22:0/2541027995 shutdown_connections 2022-04-28T14:41:23.530 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.508+0000 7f436f9a4700 1 -- 172.21.15.22:0/2541027995 wait complete. 2022-04-28T14:41:23.531 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-04-28T14:41:23.608 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:23.604+0000 7fd9ecf21680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-04-28T14:41:23.694 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.689+0000 7f045f350700 1 Processor -- start 2022-04-28T14:41:23.694 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.690+0000 7f045f350700 1 -- start start 2022-04-28T14:41:23.697 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.690+0000 7f045f350700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0458064530 0x7f0458067d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:23.697 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.690+0000 7f045f350700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0458135ba0 0x7f045813f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:23.697 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.690+0000 7f045f350700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0458064910 con 0x7f04580a7130 2022-04-28T14:41:23.698 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.690+0000 7f045f350700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04580a7550 con 0x7f0458135ba0 2022-04-28T14:41:23.698 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.690+0000 7f045f350700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04580a77f0 con 0x7f0458064530 2022-04-28T14:41:23.698 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.690+0000 7f045d8ed700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0458135ba0 0x7f045813f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:23.698 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.690+0000 7f045d0ec700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0458064530 0x7f0458067d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:23.698 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.690+0000 7f045d8ed700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0458135ba0 0x7f045813f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50202/0 (socket says 172.21.15.22:50202) 2022-04-28T14:41:23.698 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.691+0000 7f045d8ed700 1 -- 172.21.15.22:0/1009248774 learned_addr learned my addr 172.21.15.22:0/1009248774 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:23.698 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.691+0000 7f045d0ec700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0458064530 0x7f0458067d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:47550/0 (socket says 172.21.15.22:47550) 2022-04-28T14:41:23.698 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.690+0000 7f045c8eb700 1 --1- 172.21.15.22:0/1009248774 >> v1:172.21.15.22:6789/0 conn(0x7f04580a7130 0x7f0458134480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39594/0 (socket says 172.21.15.22:39594) 2022-04-28T14:41:23.698 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.691+0000 7f045d8ed700 1 -- 172.21.15.22:0/1009248774 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0458064530 msgr2=0x7f0458067d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:23.698 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.691+0000 7f045d8ed700 1 --2- 172.21.15.22:0/1009248774 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0458064530 0x7f0458067d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:23.699 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.691+0000 7f045d8ed700 1 -- 172.21.15.22:0/1009248774 >> v1:172.21.15.22:6789/0 conn(0x7f04580a7130 legacy=0x7f0458134480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.699 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.691+0000 7f0447fff700 1 -- 172.21.15.22:0/1009248774 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3630460481 0 0) 0x7f0458064910 con 0x7f04580a7130 2022-04-28T14:41:23.699 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.691+0000 7f045d8ed700 1 -- 172.21.15.22:0/1009248774 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04580a7ab0 con 0x7f0458135ba0 2022-04-28T14:41:23.699 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.691+0000 7f045d0ec700 1 --2- 172.21.15.22:0/1009248774 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0458064530 0x7f0458067d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:23.699 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.691+0000 7f045d8ed700 1 --2- 172.21.15.22:0/1009248774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0458135ba0 0x7f045813f8a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f0450009f20 tx=0x7f0450009840).ready entity=mon.0 client_cookie=acfc4570987762a6 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:23.699 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.691+0000 7f0447fff700 1 -- 172.21.15.22:0/1009248774 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045000e070 con 0x7f0458135ba0 2022-04-28T14:41:23.699 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.691+0000 7f0447fff700 1 -- 172.21.15.22:0/1009248774 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045000b9d0 con 0x7f0458135ba0 2022-04-28T14:41:23.699 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.691+0000 7f0447fff700 1 -- 172.21.15.22:0/1009248774 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045000bd50 con 0x7f0458135ba0 2022-04-28T14:41:23.699 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.692+0000 7f045f350700 1 -- 172.21.15.22:0/1009248774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0458135ba0 msgr2=0x7f045813f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.700 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.692+0000 7f045f350700 1 --2- 172.21.15.22:0/1009248774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0458135ba0 0x7f045813f8a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f0450009f20 tx=0x7f0450009840).stop 2022-04-28T14:41:23.700 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.692+0000 7f045f350700 1 -- 172.21.15.22:0/1009248774 shutdown_connections 2022-04-28T14:41:23.700 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.692+0000 7f045f350700 1 --2- 172.21.15.22:0/1009248774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0458135ba0 0x7f045813f8a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:23.700 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.692+0000 7f045f350700 1 --2- 172.21.15.22:0/1009248774 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0458064530 0x7f0458067d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:23.700 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.692+0000 7f045f350700 1 -- 172.21.15.22:0/1009248774 >> 172.21.15.22:0/1009248774 conn(0x7f0458067070 msgr2=0x7f0458063c60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:23.700 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.692+0000 7f045f350700 1 -- 172.21.15.22:0/1009248774 shutdown_connections 2022-04-28T14:41:23.700 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.692+0000 7f045f350700 1 -- 172.21.15.22:0/1009248774 wait complete. 2022-04-28T14:41:23.703 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.693+0000 7f045f350700 1 Processor -- start 2022-04-28T14:41:23.703 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.693+0000 7f045f350700 1 -- start start 2022-04-28T14:41:23.703 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.694+0000 7f045f350700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0458064530 0x7f045814b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:23.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.694+0000 7f045f350700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f04580a7130 0x7f045814ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:23.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.694+0000 7f045f350700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0458135ba0 0x7f0458147b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:23.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.694+0000 7f045f350700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04580a30b0 con 0x7f0458135ba0 2022-04-28T14:41:23.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.694+0000 7f045f350700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04580a3980 con 0x7f0458064530 2022-04-28T14:41:23.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.694+0000 7f045f350700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04580a4f10 con 0x7f04580a7130 2022-04-28T14:41:23.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.694+0000 7f045c8eb700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f04580a7130 0x7f045814ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:23.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.694+0000 7f045c8eb700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f04580a7130 0x7f045814ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:47558/0 (socket says 172.21.15.22:47558) 2022-04-28T14:41:23.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.694+0000 7f045c8eb700 1 -- 172.21.15.22:0/590956723 learned_addr learned my addr 172.21.15.22:0/590956723 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:23.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.694+0000 7f045d0ec700 1 --2- 172.21.15.22:0/590956723 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0458064530 0x7f045814b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:23.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.695+0000 7f045d8ed700 1 --2- 172.21.15.22:0/590956723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0458135ba0 0x7f0458147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:23.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.695+0000 7f045d0ec700 1 -- 172.21.15.22:0/590956723 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f04580a7130 msgr2=0x7f045814ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.695+0000 7f045d0ec700 1 --2- 172.21.15.22:0/590956723 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f04580a7130 0x7f045814ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:23.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.695+0000 7f045d0ec700 1 -- 172.21.15.22:0/590956723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0458135ba0 msgr2=0x7f0458147b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.695+0000 7f045d0ec700 1 --2- 172.21.15.22:0/590956723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0458135ba0 0x7f0458147b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:23.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.695+0000 7f045d0ec700 1 -- 172.21.15.22:0/590956723 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04540092a0 con 0x7f0458064530 2022-04-28T14:41:23.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.695+0000 7f045c8eb700 1 --2- 172.21.15.22:0/590956723 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f04580a7130 0x7f045814ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:23.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.695+0000 7f045d8ed700 1 --2- 172.21.15.22:0/590956723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0458135ba0 0x7f0458147b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-04-28T14:41:23.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.695+0000 7f045d0ec700 1 --2- 172.21.15.22:0/590956723 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0458064530 0x7f045814b3b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f045400e980 tx=0x7f0454009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:23.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.695+0000 7f04457fa700 1 -- 172.21.15.22:0/590956723 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045400ee70 con 0x7f0458064530 2022-04-28T14:41:23.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.695+0000 7f04457fa700 1 -- 172.21.15.22:0/590956723 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045400c7f0 con 0x7f0458064530 2022-04-28T14:41:23.706 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.695+0000 7f045f350700 1 -- 172.21.15.22:0/590956723 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0450009ae0 con 0x7f0458064530 2022-04-28T14:41:23.706 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.695+0000 7f04457fa700 1 -- 172.21.15.22:0/590956723 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045400cb70 con 0x7f0458064530 2022-04-28T14:41:23.706 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.695+0000 7f045f350700 1 -- 172.21.15.22:0/590956723 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04580a1e80 con 0x7f0458064530 2022-04-28T14:41:23.706 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.696+0000 7f04457fa700 1 -- 172.21.15.22:0/590956723 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 4) v1 ==== 22927+0+0 (secure 0 0 0) 0x7f0454022070 con 0x7f0458064530 2022-04-28T14:41:23.706 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.696+0000 7f04457fa700 1 -- 172.21.15.22:0/590956723 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3259+0+0 (secure 0 0 0) 0x7f045402aab0 con 0x7f0458064530 2022-04-28T14:41:23.706 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.696+0000 7f045c8eb700 1 -- 172.21.15.22:0/590956723 >> v1:172.21.15.22:6808/86956 conn(0x7f043801c940 legacy=0x7f043801ee00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.22:6808/86956 2022-04-28T14:41:23.706 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.696+0000 7f045f350700 1 -- 172.21.15.22:0/590956723 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04580a31f0 con 0x7f0458064530 2022-04-28T14:41:23.707 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:23.697+0000 7fd9ecf21680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-04-28T14:41:23.707 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.700+0000 7f04457fa700 1 -- 172.21.15.22:0/590956723 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+101097 (secure 0 0 0) 0x7f045400be20 con 0x7f0458064530 2022-04-28T14:41:23.783 INFO:tasks.ceph.mgr.x.smithi022.stderr:2022-04-28T14:41:23.779+0000 7f45dcff7680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-04-28T14:41:23.812 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.807+0000 7f045f350700 1 -- 172.21.15.22:0/590956723 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0458066870 con 0x7f0458064530 2022-04-28T14:41:23.812 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.807+0000 7f04457fa700 1 -- 172.21.15.22:0/590956723 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f045401e120 con 0x7f0458064530 2022-04-28T14:41:23.812 INFO:teuthology.orchestra.run.smithi022.stdout:38654705693 2022-04-28T14:41:23.813 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.808+0000 7f045f350700 1 -- 172.21.15.22:0/590956723 >> v1:172.21.15.22:6808/86956 conn(0x7f043801c940 legacy=0x7f043801ee00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-04-28T14:41:23.814 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.808+0000 7f045f350700 1 -- 172.21.15.22:0/590956723 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0458064530 msgr2=0x7f045814b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:23.814 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.808+0000 7f045f350700 1 --2- 172.21.15.22:0/590956723 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0458064530 0x7f045814b3b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f045400e980 tx=0x7f0454009060).stop 2022-04-28T14:41:23.814 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.808+0000 7f045f350700 1 -- 172.21.15.22:0/590956723 shutdown_connections 2022-04-28T14:41:23.814 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.808+0000 7f045f350700 1 --2- 172.21.15.22:0/590956723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0458135ba0 0x7f0458147b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:23.814 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.808+0000 7f045f350700 1 --2- 172.21.15.22:0/590956723 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0458064530 0x7f045814b3b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:23.814 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.808+0000 7f045f350700 1 --2- 172.21.15.22:0/590956723 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f04580a7130 0x7f045814ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:23.814 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.808+0000 7f045f350700 1 -- 172.21.15.22:0/590956723 >> 172.21.15.22:0/590956723 conn(0x7f0458067070 msgr2=0x7f04580a95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:23.814 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.808+0000 7f045f350700 1 -- 172.21.15.22:0/590956723 shutdown_connections 2022-04-28T14:41:23.815 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:23.808+0000 7f045f350700 1 -- 172.21.15.22:0/590956723 wait complete. 2022-04-28T14:41:23.824 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.0 2022-04-28T14:41:23.828 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:23.823+0000 7fd9ecf21680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-04-28T14:41:23.860 INFO:tasks.ceph.mgr.x.smithi022.stderr:2022-04-28T14:41:23.855+0000 7f45dcff7680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-04-28T14:41:24.061 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:24.056+0000 7fd9ecf21680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-04-28T14:41:24.101 INFO:tasks.ceph.mgr.x.smithi022.stderr:2022-04-28T14:41:24.096+0000 7f45dcff7680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-04-28T14:41:24.218 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:24.213+0000 7fd9ecf21680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-04-28T14:41:24.274 INFO:tasks.ceph.mgr.x.smithi022.stderr:2022-04-28T14:41:24.269+0000 7f45dcff7680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-04-28T14:41:24.293 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:24.289+0000 7fd9ecf21680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-04-28T14:41:24.421 INFO:tasks.ceph.mgr.x.smithi022.stderr:2022-04-28T14:41:24.417+0000 7f45dcff7680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-04-28T14:41:24.490 INFO:tasks.ceph.mgr.x.smithi022.stderr:2022-04-28T14:41:24.486+0000 7f45dcff7680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-04-28T14:41:24.605 INFO:tasks.ceph.mgr.x.smithi022.stderr:2022-04-28T14:41:24.601+0000 7f45dcff7680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-04-28T14:41:24.825 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-04-28T14:41:24.832 INFO:tasks.ceph.mgr.x.smithi022.stderr:2022-04-28T14:41:24.827+0000 7f45dcff7680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-04-28T14:41:24.945 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.940+0000 7f6c93440700 1 Processor -- start 2022-04-28T14:41:24.945 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.941+0000 7f6c93440700 1 -- start start 2022-04-28T14:41:24.948 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.941+0000 7f6c93440700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6c8c064530 0x7f6c8c13bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:24.948 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.941+0000 7f6c93440700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6c8c13b850 0x7f6c8c138920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:24.948 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.941+0000 7f6c93440700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6c8c0681c0 0x7f6c8c138e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:24.949 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.941+0000 7f6c93440700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c8c0a7930 con 0x7f6c8c0681c0 2022-04-28T14:41:24.949 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.941+0000 7f6c93440700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c064910 con 0x7f6c8c13b850 2022-04-28T14:41:24.949 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.941+0000 7f6c93440700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c138410 con 0x7f6c8c064530 2022-04-28T14:41:24.949 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.941+0000 7f6c911dc700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6c8c064530 0x7f6c8c13bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:24.949 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.941+0000 7f6c919dd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6c8c0681c0 0x7f6c8c138e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:24.949 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.941+0000 7f6c909db700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6c8c13b850 0x7f6c8c138920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:24.949 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.941+0000 7f6c911dc700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6c8c064530 0x7f6c8c13bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:47570/0 (socket says 172.21.15.22:47570) 2022-04-28T14:41:24.950 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.941+0000 7f6c911dc700 1 -- 172.21.15.22:0/130516568 learned_addr learned my addr 172.21.15.22:0/130516568 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:24.950 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.942+0000 7f6c911dc700 1 -- 172.21.15.22:0/130516568 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6c8c13b850 msgr2=0x7f6c8c138920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:24.950 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.942+0000 7f6c911dc700 1 --2- 172.21.15.22:0/130516568 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6c8c13b850 0x7f6c8c138920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:24.950 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.942+0000 7f6c911dc700 1 -- 172.21.15.22:0/130516568 >> v2:172.21.15.22:3300/0 conn(0x7f6c8c0681c0 msgr2=0x7f6c8c138e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:24.950 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.942+0000 7f6c911dc700 1 --2- 172.21.15.22:0/130516568 >> v2:172.21.15.22:3300/0 conn(0x7f6c8c0681c0 0x7f6c8c138e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:24.951 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.942+0000 7f6c911dc700 1 -- 172.21.15.22:0/130516568 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c138670 con 0x7f6c8c064530 2022-04-28T14:41:24.951 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.942+0000 7f6c919dd700 1 --2- 172.21.15.22:0/130516568 >> v2:172.21.15.22:3300/0 conn(0x7f6c8c0681c0 0x7f6c8c138e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:24.951 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.942+0000 7f6c909db700 1 --2- 172.21.15.22:0/130516568 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6c8c13b850 0x7f6c8c138920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:24.951 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.942+0000 7f6c911dc700 1 --2- 172.21.15.22:0/130516568 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6c8c064530 0x7f6c8c13bf60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f6c88009830 tx=0x7f6c880090f0).ready entity=mon.2 client_cookie=b4cf4c595800a507 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:24.951 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.942+0000 7f6c7bfff700 1 -- 172.21.15.22:0/130516568 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8800f510 con 0x7f6c8c064530 2022-04-28T14:41:24.951 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.942+0000 7f6c7bfff700 1 -- 172.21.15.22:0/130516568 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8800f670 con 0x7f6c8c064530 2022-04-28T14:41:24.951 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.942+0000 7f6c7bfff700 1 -- 172.21.15.22:0/130516568 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8800f9f0 con 0x7f6c8c064530 2022-04-28T14:41:24.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.943+0000 7f6c93440700 1 -- 172.21.15.22:0/130516568 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6c8c064530 msgr2=0x7f6c8c13bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:24.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.943+0000 7f6c93440700 1 --2- 172.21.15.22:0/130516568 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6c8c064530 0x7f6c8c13bf60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f6c88009830 tx=0x7f6c880090f0).stop 2022-04-28T14:41:24.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.943+0000 7f6c93440700 1 -- 172.21.15.22:0/130516568 shutdown_connections 2022-04-28T14:41:24.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.943+0000 7f6c93440700 1 --2- 172.21.15.22:0/130516568 >> v2:172.21.15.22:3300/0 conn(0x7f6c8c0681c0 0x7f6c8c138e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:24.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.943+0000 7f6c93440700 1 --2- 172.21.15.22:0/130516568 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6c8c064530 0x7f6c8c13bf60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:24.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.943+0000 7f6c93440700 1 --2- 172.21.15.22:0/130516568 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6c8c13b850 0x7f6c8c138920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:24.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.943+0000 7f6c93440700 1 -- 172.21.15.22:0/130516568 >> 172.21.15.22:0/130516568 conn(0x7f6c8c067070 msgr2=0x7f6c8c063c60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:24.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.943+0000 7f6c93440700 1 -- 172.21.15.22:0/130516568 shutdown_connections 2022-04-28T14:41:24.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.943+0000 7f6c93440700 1 -- 172.21.15.22:0/130516568 wait complete. 2022-04-28T14:41:24.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.944+0000 7f6c93440700 1 Processor -- start 2022-04-28T14:41:24.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.944+0000 7f6c93440700 1 -- start start 2022-04-28T14:41:24.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.945+0000 7f6c93440700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6c8c064530 0x7f6c8c0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:24.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.945+0000 7f6c93440700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c8c0681c0 0x7f6c8c14b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:24.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.945+0000 7f6c93440700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6c8c13b850 0x7f6c8c09f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:24.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.945+0000 7f6c93440700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c095000 con 0x7f6c8c0681c0 2022-04-28T14:41:24.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.945+0000 7f6c93440700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0a0b00 con 0x7f6c8c13b850 2022-04-28T14:41:24.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.945+0000 7f6c93440700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c14bd60 con 0x7f6c8c064530 2022-04-28T14:41:24.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.945+0000 7f6c911dc700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6c8c064530 0x7f6c8c0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:24.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.945+0000 7f6c919dd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6c8c13b850 0x7f6c8c09f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:24.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.945+0000 7f6c911dc700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6c8c064530 0x7f6c8c0a4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:47576/0 (socket says 172.21.15.22:47576) 2022-04-28T14:41:24.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.945+0000 7f6c909db700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c8c0681c0 0x7f6c8c14b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:24.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.945+0000 7f6c911dc700 1 -- 172.21.15.22:0/1797680671 learned_addr learned my addr 172.21.15.22:0/1797680671 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:24.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.945+0000 7f6c919dd700 1 -- 172.21.15.22:0/1797680671 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6c8c064530 msgr2=0x7f6c8c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:24.956 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.945+0000 7f6c919dd700 1 --2- 172.21.15.22:0/1797680671 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6c8c064530 0x7f6c8c0a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:24.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.945+0000 7f6c919dd700 1 -- 172.21.15.22:0/1797680671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c8c0681c0 msgr2=0x7f6c8c14b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:24.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.945+0000 7f6c919dd700 1 --2- 172.21.15.22:0/1797680671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c8c0681c0 0x7f6c8c14b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:24.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.945+0000 7f6c919dd700 1 -- 172.21.15.22:0/1797680671 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c84009a20 con 0x7f6c8c13b850 2022-04-28T14:41:24.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.945+0000 7f6c909db700 1 --2- 172.21.15.22:0/1797680671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c8c0681c0 0x7f6c8c14b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:24.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.945+0000 7f6c919dd700 1 --2- 172.21.15.22:0/1797680671 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6c8c13b850 0x7f6c8c09f350 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f6c84009f10 tx=0x7f6c8400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:24.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.945+0000 7f6c797fa700 1 -- 172.21.15.22:0/1797680671 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8400cc00 con 0x7f6c8c13b850 2022-04-28T14:41:24.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.945+0000 7f6c797fa700 1 -- 172.21.15.22:0/1797680671 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8400f040 con 0x7f6c8c13b850 2022-04-28T14:41:24.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.945+0000 7f6c93440700 1 -- 172.21.15.22:0/1797680671 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7c0092a0 con 0x7f6c8c13b850 2022-04-28T14:41:24.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.945+0000 7f6c797fa700 1 -- 172.21.15.22:0/1797680671 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c84013400 con 0x7f6c8c13b850 2022-04-28T14:41:24.958 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.946+0000 7f6c93440700 1 -- 172.21.15.22:0/1797680671 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c88009370 con 0x7f6c8c13b850 2022-04-28T14:41:24.958 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.946+0000 7f6c797fa700 1 -- 172.21.15.22:0/1797680671 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 4) v1 ==== 22927+0+0 (secure 0 0 0) 0x7f6c840137f0 con 0x7f6c8c13b850 2022-04-28T14:41:24.958 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.946+0000 7f6c797fa700 1 -- 172.21.15.22:0/1797680671 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3302+0+0 (secure 0 0 0) 0x7f6c8402ad60 con 0x7f6c8c13b850 2022-04-28T14:41:24.958 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.946+0000 7f6c911dc700 1 -- 172.21.15.22:0/1797680671 >> v1:172.21.15.22:6808/86956 conn(0x7f6c6c01c940 legacy=0x7f6c6c01ee00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.22:6808/86956 2022-04-28T14:41:24.958 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.946+0000 7f6c93440700 1 -- 172.21.15.22:0/1797680671 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c8c0a0d00 con 0x7f6c8c13b850 2022-04-28T14:41:24.958 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:24.949+0000 7f6c797fa700 1 -- 172.21.15.22:0/1797680671 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+101097 (secure 0 0 0) 0x7f6c8c0a0d00 con 0x7f6c8c13b850 2022-04-28T14:41:24.959 INFO:tasks.ceph.mgr.x.smithi022.stderr:2022-04-28T14:41:24.952+0000 7f45dcff7680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-04-28T14:41:25.026 INFO:tasks.ceph.mgr.x.smithi022.stderr:2022-04-28T14:41:25.022+0000 7f45dcff7680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-04-28T14:41:25.063 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:25.058+0000 7f6c93440700 1 -- 172.21.15.22:0/1797680671 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6c8c0a0d00 con 0x7f6c8c13b850 2022-04-28T14:41:25.063 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:25.058+0000 7f6c797fa700 1 -- 172.21.15.22:0/1797680671 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6c8c0a0d00 con 0x7f6c8c13b850 2022-04-28T14:41:25.063 INFO:teuthology.orchestra.run.smithi022.stdout:38654705693 2022-04-28T14:41:25.064 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:25.059+0000 7f6c93440700 1 -- 172.21.15.22:0/1797680671 >> v1:172.21.15.22:6808/86956 conn(0x7f6c6c01c940 legacy=0x7f6c6c01ee00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-04-28T14:41:25.064 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:25.059+0000 7f6c93440700 1 -- 172.21.15.22:0/1797680671 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6c8c13b850 msgr2=0x7f6c8c09f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:25.064 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:25.059+0000 7f6c93440700 1 --2- 172.21.15.22:0/1797680671 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6c8c13b850 0x7f6c8c09f350 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f6c84009f10 tx=0x7f6c8400b040).stop 2022-04-28T14:41:25.065 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:25.059+0000 7f6c93440700 1 -- 172.21.15.22:0/1797680671 shutdown_connections 2022-04-28T14:41:25.065 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:25.059+0000 7f6c93440700 1 --2- 172.21.15.22:0/1797680671 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6c8c13b850 0x7f6c8c09f350 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:25.065 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:25.059+0000 7f6c93440700 1 --2- 172.21.15.22:0/1797680671 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6c8c064530 0x7f6c8c0a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:25.065 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:25.059+0000 7f6c93440700 1 --2- 172.21.15.22:0/1797680671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c8c0681c0 0x7f6c8c14b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:25.065 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:25.059+0000 7f6c93440700 1 -- 172.21.15.22:0/1797680671 >> 172.21.15.22:0/1797680671 conn(0x7f6c8c067070 msgr2=0x7f6c8c138890 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:25.065 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:25.059+0000 7f6c93440700 1 -- 172.21.15.22:0/1797680671 shutdown_connections 2022-04-28T14:41:25.065 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:25.059+0000 7f6c93440700 1 -- 172.21.15.22:0/1797680671 wait complete. 2022-04-28T14:41:25.075 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.0 2022-04-28T14:41:25.225 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:25.220+0000 7fd9b27e9700 -1 client.0 error registering admin socket command: (17) File exists 2022-04-28T14:41:25.225 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:25.220+0000 7fd9b27e9700 -1 client.0 error registering admin socket command: (17) File exists 2022-04-28T14:41:25.225 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:25.220+0000 7fd9b27e9700 -1 client.0 error registering admin socket command: (17) File exists 2022-04-28T14:41:25.225 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:25.220+0000 7fd9b27e9700 -1 client.0 error registering admin socket command: (17) File exists 2022-04-28T14:41:25.225 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:25.220+0000 7fd9b27e9700 -1 client.0 error registering admin socket command: (17) File exists 2022-04-28T14:41:25.225 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:25.220+0000 7fd9af7e3700 -1 client.0 error registering admin socket command: (17) File exists 2022-04-28T14:41:25.225 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:25.220+0000 7fd9af7e3700 -1 client.0 error registering admin socket command: (17) File exists 2022-04-28T14:41:25.226 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:25.220+0000 7fd9af7e3700 -1 client.0 error registering admin socket command: (17) File exists 2022-04-28T14:41:25.226 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:25.220+0000 7fd9af7e3700 -1 client.0 error registering admin socket command: (17) File exists 2022-04-28T14:41:25.226 INFO:tasks.ceph.mgr.y.smithi022.stderr:2022-04-28T14:41:25.220+0000 7fd9af7e3700 -1 client.0 error registering admin socket command: (17) File exists 2022-04-28T14:41:26.076 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-04-28T14:41:26.218 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.213+0000 7f4dbcb93700 1 Processor -- start 2022-04-28T14:41:26.218 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.213+0000 7f4dbcb93700 1 -- start start 2022-04-28T14:41:26.221 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.214+0000 7f4dbcb93700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4db8135ba0 0x7f4db8067d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:26.221 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.214+0000 7f4dbcb93700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4db80a7130 0x7f4db813f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:26.221 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.214+0000 7f4dbcb93700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db8064910 con 0x7f4db8064530 2022-04-28T14:41:26.221 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.214+0000 7f4dbcb93700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db80a75e0 con 0x7f4db80a7130 2022-04-28T14:41:26.221 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.214+0000 7f4dbcb93700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db80a77f0 con 0x7f4db8135ba0 2022-04-28T14:41:26.221 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.214+0000 7f4db6d9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4db80a7130 0x7f4db813f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:26.221 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.214+0000 7f4db5d9b700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4db8135ba0 0x7f4db8067d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:26.221 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.214+0000 7f4db5d9b700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4db8135ba0 0x7f4db8067d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:47890/0 (socket says 172.21.15.22:47890) 2022-04-28T14:41:26.222 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.214+0000 7f4db6d9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4db80a7130 0x7f4db813f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50324/0 (socket says 172.21.15.22:50324) 2022-04-28T14:41:26.222 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.214+0000 7f4db659c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4db8064530 0x7f4db8134480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39716/0 (socket says 172.21.15.22:39716) 2022-04-28T14:41:26.222 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.214+0000 7f4db5d9b700 1 -- 172.21.15.22:0/3174141327 learned_addr learned my addr 172.21.15.22:0/3174141327 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:26.222 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.214+0000 7f4db5d9b700 1 -- 172.21.15.22:0/3174141327 >> v2:172.21.15.22:3300/0 conn(0x7f4db80a7130 msgr2=0x7f4db813f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:26.222 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.214+0000 7f4db5d9b700 1 --2- 172.21.15.22:0/3174141327 >> v2:172.21.15.22:3300/0 conn(0x7f4db80a7130 0x7f4db813f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:26.222 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.214+0000 7f4db5d9b700 1 -- 172.21.15.22:0/3174141327 >> v1:172.21.15.22:6789/0 conn(0x7f4db8064530 legacy=0x7f4db8134480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:26.222 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.214+0000 7f4db5d9b700 1 -- 172.21.15.22:0/3174141327 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db80a7ab0 con 0x7f4db8135ba0 2022-04-28T14:41:26.222 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.214+0000 7f4db559a700 1 -- 172.21.15.22:0/3174141327 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2922364773 0 0) 0x7f4db8064910 con 0x7f4db8064530 2022-04-28T14:41:26.222 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.214+0000 7f4db6d9d700 1 --2- 172.21.15.22:0/3174141327 >> v2:172.21.15.22:3300/0 conn(0x7f4db80a7130 0x7f4db813f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:26.222 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.214+0000 7f4db5d9b700 1 --2- 172.21.15.22:0/3174141327 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4db8135ba0 0x7f4db8067d00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f4da0006fd0 tx=0x7f4da000b3b0).ready entity=mon.1 client_cookie=8106385e7aa6b50f server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:26.223 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.214+0000 7f4db559a700 1 -- 172.21.15.22:0/3174141327 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da000da70 con 0x7f4db8135ba0 2022-04-28T14:41:26.223 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.214+0000 7f4db559a700 1 -- 172.21.15.22:0/3174141327 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da000dbd0 con 0x7f4db8135ba0 2022-04-28T14:41:26.223 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.215+0000 7f4db559a700 1 -- 172.21.15.22:0/3174141327 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da0010470 con 0x7f4db8135ba0 2022-04-28T14:41:26.223 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.215+0000 7f4dbcb93700 1 -- 172.21.15.22:0/3174141327 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4db8135ba0 msgr2=0x7f4db8067d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:26.223 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.215+0000 7f4dbcb93700 1 --2- 172.21.15.22:0/3174141327 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4db8135ba0 0x7f4db8067d00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f4da0006fd0 tx=0x7f4da000b3b0).stop 2022-04-28T14:41:26.223 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.215+0000 7f4dbcb93700 1 -- 172.21.15.22:0/3174141327 shutdown_connections 2022-04-28T14:41:26.223 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.215+0000 7f4dbcb93700 1 --2- 172.21.15.22:0/3174141327 >> v2:172.21.15.22:3300/0 conn(0x7f4db80a7130 0x7f4db813f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:26.223 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.215+0000 7f4dbcb93700 1 --2- 172.21.15.22:0/3174141327 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4db8135ba0 0x7f4db8067d00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:26.223 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.215+0000 7f4dbcb93700 1 -- 172.21.15.22:0/3174141327 >> 172.21.15.22:0/3174141327 conn(0x7f4db8067070 msgr2=0x7f4db8063c60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:26.223 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.215+0000 7f4dbcb93700 1 -- 172.21.15.22:0/3174141327 shutdown_connections 2022-04-28T14:41:26.224 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.215+0000 7f4dbcb93700 1 -- 172.21.15.22:0/3174141327 wait complete. 2022-04-28T14:41:26.224 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.216+0000 7f4dbcb93700 1 Processor -- start 2022-04-28T14:41:26.224 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.216+0000 7f4dbcb93700 1 -- start start 2022-04-28T14:41:26.226 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.217+0000 7f4dbcb93700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4db8064530 0x7f4db80a7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:26.226 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.217+0000 7f4dbcb93700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4db80a7130 0x7f4db8143ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:26.226 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.217+0000 7f4dbcb93700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4db8135ba0 0x7f4db809f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:26.227 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.217+0000 7f4dbcb93700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db8143a50 con 0x7f4db80a7130 2022-04-28T14:41:26.227 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.217+0000 7f4dbcb93700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db809f350 con 0x7f4db8064530 2022-04-28T14:41:26.227 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.217+0000 7f4dbcb93700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4db8144870 con 0x7f4db8135ba0 2022-04-28T14:41:26.227 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.217+0000 7f4db659c700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4db8064530 0x7f4db80a7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:26.227 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.217+0000 7f4db5d9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4db80a7130 0x7f4db8143ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:26.227 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.217+0000 7f4db6d9d700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4db8135ba0 0x7f4db809f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:26.227 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.217+0000 7f4db659c700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4db8064530 0x7f4db80a7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:47894/0 (socket says 172.21.15.22:47894) 2022-04-28T14:41:26.227 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.217+0000 7f4db659c700 1 -- 172.21.15.22:0/3798354793 learned_addr learned my addr 172.21.15.22:0/3798354793 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:26.227 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.217+0000 7f4db659c700 1 -- 172.21.15.22:0/3798354793 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4db8135ba0 msgr2=0x7f4db809f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:26.227 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.217+0000 7f4db659c700 1 --2- 172.21.15.22:0/3798354793 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4db8135ba0 0x7f4db809f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:26.228 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.217+0000 7f4db659c700 1 -- 172.21.15.22:0/3798354793 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4db80a7130 msgr2=0x7f4db8143ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:26.228 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.217+0000 7f4db659c700 1 --2- 172.21.15.22:0/3798354793 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4db80a7130 0x7f4db8143ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:26.228 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.217+0000 7f4db659c700 1 -- 172.21.15.22:0/3798354793 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db0009a20 con 0x7f4db8064530 2022-04-28T14:41:26.228 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.217+0000 7f4db659c700 1 --2- 172.21.15.22:0/3798354793 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4db8064530 0x7f4db80a7e90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f4da8001700 tx=0x7f4da8007ca0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:26.228 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.217+0000 7f4dae7fc700 1 -- 172.21.15.22:0/3798354793 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da8012030 con 0x7f4db8064530 2022-04-28T14:41:26.228 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.217+0000 7f4dae7fc700 1 -- 172.21.15.22:0/3798354793 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da80072e0 con 0x7f4db8064530 2022-04-28T14:41:26.228 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.217+0000 7f4dbcb93700 1 -- 172.21.15.22:0/3798354793 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da000b610 con 0x7f4db8064530 2022-04-28T14:41:26.228 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.217+0000 7f4dae7fc700 1 -- 172.21.15.22:0/3798354793 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da800c070 con 0x7f4db8064530 2022-04-28T14:41:26.228 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.217+0000 7f4dbcb93700 1 -- 172.21.15.22:0/3798354793 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db80a3b20 con 0x7f4db8064530 2022-04-28T14:41:26.229 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.218+0000 7f4dbcb93700 1 -- 172.21.15.22:0/3798354793 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db8143bc0 con 0x7f4db8064530 2022-04-28T14:41:26.229 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.219+0000 7f4dae7fc700 1 -- 172.21.15.22:0/3798354793 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 6) v1 ==== 48374+0+0 (secure 0 0 0) 0x7f4da80058f0 con 0x7f4db8064530 2022-04-28T14:41:26.229 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.219+0000 7f4dae7fc700 1 -- 172.21.15.22:0/3798354793 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3678+0+0 (secure 0 0 0) 0x7f4da8013070 con 0x7f4db8064530 2022-04-28T14:41:26.230 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.222+0000 7f4dae7fc700 1 -- 172.21.15.22:0/3798354793 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f4db8143bc0 con 0x7f4db8064530 2022-04-28T14:41:26.366 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.361+0000 7f4dbcb93700 1 -- 172.21.15.22:0/3798354793 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4db8143bc0 con 0x7f4db8064530 2022-04-28T14:41:26.366 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.361+0000 7f4dae7fc700 1 -- 172.21.15.22:0/3798354793 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4db8143bc0 con 0x7f4db8064530 2022-04-28T14:41:26.366 INFO:teuthology.orchestra.run.smithi022.stdout:38654705693 2022-04-28T14:41:26.368 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.363+0000 7f4dbcb93700 1 -- 172.21.15.22:0/3798354793 >> v1:172.21.15.22:6808/92758 conn(0x7f4d9c041a10 legacy=0x7f4d9c043ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:26.368 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.363+0000 7f4dbcb93700 1 -- 172.21.15.22:0/3798354793 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4db8064530 msgr2=0x7f4db80a7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:26.368 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.363+0000 7f4dbcb93700 1 --2- 172.21.15.22:0/3798354793 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4db8064530 0x7f4db80a7e90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f4da8001700 tx=0x7f4da8007ca0).stop 2022-04-28T14:41:26.368 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.363+0000 7f4dbcb93700 1 -- 172.21.15.22:0/3798354793 shutdown_connections 2022-04-28T14:41:26.368 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.363+0000 7f4dbcb93700 1 --2- 172.21.15.22:0/3798354793 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4db8135ba0 0x7f4db809f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:26.368 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.363+0000 7f4dbcb93700 1 --2- 172.21.15.22:0/3798354793 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4db8064530 0x7f4db80a7e90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:26.369 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.363+0000 7f4dbcb93700 1 --2- 172.21.15.22:0/3798354793 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4db80a7130 0x7f4db8143ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:26.369 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.363+0000 7f4dbcb93700 1 -- 172.21.15.22:0/3798354793 >> 172.21.15.22:0/3798354793 conn(0x7f4db8067070 msgr2=0x7f4db80ab680 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:26.369 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.363+0000 7f4dbcb93700 1 -- 172.21.15.22:0/3798354793 shutdown_connections 2022-04-28T14:41:26.369 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:26.363+0000 7f4dbcb93700 1 -- 172.21.15.22:0/3798354793 wait complete. 2022-04-28T14:41:26.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.0 2022-04-28T14:41:27.380 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-04-28T14:41:27.511 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.499+0000 7f53fd709700 1 Processor -- start 2022-04-28T14:41:27.594 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.499+0000 7f53fd709700 1 -- start start 2022-04-28T14:41:27.594 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.500+0000 7f53fd709700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f53f8063100 0x7f53f809a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:27.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.500+0000 7f53fd709700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f53f8097c60 0x7f53f8098b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:27.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.500+0000 7f53fd709700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f53f8133b60 0x7f53f8133fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:27.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.500+0000 7f53fd709700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f8099e00 con 0x7f53f8097c60 2022-04-28T14:41:27.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.500+0000 7f53fd709700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f80634e0 con 0x7f53f8133b60 2022-04-28T14:41:27.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.500+0000 7f53fd709700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53f80980f0 con 0x7f53f8063100 2022-04-28T14:41:27.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.500+0000 7f53f67fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f53f8097c60 0x7f53f8098b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:27.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.500+0000 7f53f77fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f53f8133b60 0x7f53f8133fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:27.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.500+0000 7f53f67fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f53f8097c60 0x7f53f8098b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50360/0 (socket says 172.21.15.22:50360) 2022-04-28T14:41:27.595 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.500+0000 7f53f77fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f53f8133b60 0x7f53f8133fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:47930/0 (socket says 172.21.15.22:47930) 2022-04-28T14:41:27.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.500+0000 7f53f67fc700 1 -- 172.21.15.22:0/3285822352 learned_addr learned my addr 172.21.15.22:0/3285822352 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:27.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.500+0000 7f53f6ffd700 1 --2- 172.21.15.22:0/3285822352 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f53f8063100 0x7f53f809a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:27.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.500+0000 7f53f6ffd700 1 -- 172.21.15.22:0/3285822352 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f53f8133b60 msgr2=0x7f53f8133fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:27.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.501+0000 7f53f6ffd700 1 --2- 172.21.15.22:0/3285822352 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f53f8133b60 0x7f53f8133fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:27.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.501+0000 7f53f6ffd700 1 -- 172.21.15.22:0/3285822352 >> v2:172.21.15.22:3300/0 conn(0x7f53f8097c60 msgr2=0x7f53f8098b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:27.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.501+0000 7f53f6ffd700 1 --2- 172.21.15.22:0/3285822352 >> v2:172.21.15.22:3300/0 conn(0x7f53f8097c60 0x7f53f8098b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:27.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.501+0000 7f53f6ffd700 1 -- 172.21.15.22:0/3285822352 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f80983b0 con 0x7f53f8063100 2022-04-28T14:41:27.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.501+0000 7f53f77fe700 1 --2- 172.21.15.22:0/3285822352 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f53f8133b60 0x7f53f8133fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:27.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.501+0000 7f53f67fc700 1 --2- 172.21.15.22:0/3285822352 >> v2:172.21.15.22:3300/0 conn(0x7f53f8097c60 0x7f53f8098b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:27.596 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.501+0000 7f53f6ffd700 1 --2- 172.21.15.22:0/3285822352 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f53f8063100 0x7f53f809a270 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f53e8009e60 tx=0x7f53e8009780).ready entity=mon.2 client_cookie=751a5c29d6c9e281 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:27.597 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.501+0000 7f53f5ffb700 1 -- 172.21.15.22:0/3285822352 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e800e070 con 0x7f53f8063100 2022-04-28T14:41:27.597 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.501+0000 7f53f5ffb700 1 -- 172.21.15.22:0/3285822352 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e800bab0 con 0x7f53f8063100 2022-04-28T14:41:27.597 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.501+0000 7f53f5ffb700 1 -- 172.21.15.22:0/3285822352 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e800be30 con 0x7f53f8063100 2022-04-28T14:41:27.597 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.501+0000 7f53fd709700 1 -- 172.21.15.22:0/3285822352 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f53f8063100 msgr2=0x7f53f809a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:27.597 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.501+0000 7f53fd709700 1 --2- 172.21.15.22:0/3285822352 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f53f8063100 0x7f53f809a270 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f53e8009e60 tx=0x7f53e8009780).stop 2022-04-28T14:41:27.597 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.502+0000 7f53fd709700 1 -- 172.21.15.22:0/3285822352 shutdown_connections 2022-04-28T14:41:27.597 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.502+0000 7f53fd709700 1 --2- 172.21.15.22:0/3285822352 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f53f8133b60 0x7f53f8133fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:27.597 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.502+0000 7f53fd709700 1 --2- 172.21.15.22:0/3285822352 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f53f8063100 0x7f53f809a270 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:27.597 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.502+0000 7f53fd709700 1 --2- 172.21.15.22:0/3285822352 >> v2:172.21.15.22:3300/0 conn(0x7f53f8097c60 0x7f53f8098b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:27.598 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.502+0000 7f53fd709700 1 -- 172.21.15.22:0/3285822352 >> 172.21.15.22:0/3285822352 conn(0x7f53f80aaf80 msgr2=0x7f53f80ab390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:27.598 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.502+0000 7f53fd709700 1 -- 172.21.15.22:0/3285822352 shutdown_connections 2022-04-28T14:41:27.598 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.502+0000 7f53fd709700 1 -- 172.21.15.22:0/3285822352 wait complete. 2022-04-28T14:41:27.598 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.503+0000 7f53fd709700 1 Processor -- start 2022-04-28T14:41:27.598 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.503+0000 7f53fd709700 1 -- start start 2022-04-28T14:41:27.599 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.503+0000 7f53fd709700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53f8063100 0x7f53f8136f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:27.599 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.503+0000 7f53fd709700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f53f8133b60 0x7f53f81380a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:27.599 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.503+0000 7f53fd709700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f53f8147330 0x7f53f81477b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:27.600 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.503+0000 7f53fd709700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f814b7a0 con 0x7f53f8063100 2022-04-28T14:41:27.600 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.503+0000 7f53fd709700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f814ba40 con 0x7f53f8133b60 2022-04-28T14:41:27.600 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.503+0000 7f53fd709700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53f8138a90 con 0x7f53f8147330 2022-04-28T14:41:27.600 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.504+0000 7f53f6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53f8063100 0x7f53f8136f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:27.601 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.504+0000 7f53f77fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f53f8147330 0x7f53f81477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:27.601 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.504+0000 7f53f77fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f53f8147330 0x7f53f81477b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:47720/0 (socket says 172.21.15.22:47720) 2022-04-28T14:41:27.601 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.504+0000 7f53f6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53f8063100 0x7f53f8136f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50364/0 (socket says 172.21.15.22:50364) 2022-04-28T14:41:27.601 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.504+0000 7f53f77fe700 1 -- 172.21.15.22:0/1865984462 learned_addr learned my addr 172.21.15.22:0/1865984462 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:27.602 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.504+0000 7f53f67fc700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f53f8133b60 0x7f53f81380a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:27.602 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.504+0000 7f53f77fe700 1 -- 172.21.15.22:0/1865984462 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f53f8133b60 msgr2=0x7f53f81380a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:27.602 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.504+0000 7f53f77fe700 1 --2- 172.21.15.22:0/1865984462 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f53f8133b60 0x7f53f81380a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:27.602 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.504+0000 7f53f77fe700 1 -- 172.21.15.22:0/1865984462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53f8063100 msgr2=0x7f53f8136f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:27.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.504+0000 7f53f77fe700 1 --2- 172.21.15.22:0/1865984462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53f8063100 0x7f53f8136f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:27.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.504+0000 7f53f77fe700 1 -- 172.21.15.22:0/1865984462 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e0009370 con 0x7f53f8147330 2022-04-28T14:41:27.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.504+0000 7f53f67fc700 1 --2- 172.21.15.22:0/1865984462 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f53f8133b60 0x7f53f81380a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:27.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.504+0000 7f53f6ffd700 1 --2- 172.21.15.22:0/1865984462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53f8063100 0x7f53f8136f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:27.603 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.504+0000 7f53f77fe700 1 --2- 172.21.15.22:0/1865984462 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f53f8147330 0x7f53f81477b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f53f000bfd0 tx=0x7f53f000b300).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:27.604 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.504+0000 7f53eeffd700 1 -- 172.21.15.22:0/1865984462 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f000da50 con 0x7f53f8147330 2022-04-28T14:41:27.604 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.504+0000 7f53eeffd700 1 -- 172.21.15.22:0/1865984462 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f000dbb0 con 0x7f53f8147330 2022-04-28T14:41:27.604 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.504+0000 7f53fd709700 1 -- 172.21.15.22:0/1865984462 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f000b540 con 0x7f53f8147330 2022-04-28T14:41:27.604 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.504+0000 7f53eeffd700 1 -- 172.21.15.22:0/1865984462 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f0010440 con 0x7f53f8147330 2022-04-28T14:41:27.604 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.504+0000 7f53fd709700 1 -- 172.21.15.22:0/1865984462 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e8009a20 con 0x7f53f8147330 2022-04-28T14:41:27.605 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.505+0000 7f53fd709700 1 -- 172.21.15.22:0/1865984462 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f8066da0 con 0x7f53f8147330 2022-04-28T14:41:27.605 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.506+0000 7f53eeffd700 1 -- 172.21.15.22:0/1865984462 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 7) v1 ==== 48534+0+0 (secure 0 0 0) 0x7f53f0020070 con 0x7f53f8147330 2022-04-28T14:41:27.605 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.506+0000 7f53eeffd700 1 -- 172.21.15.22:0/1865984462 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f53f0055a90 con 0x7f53f8147330 2022-04-28T14:41:27.606 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.510+0000 7f53eeffd700 1 -- 172.21.15.22:0/1865984462 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f53f0036180 con 0x7f53f8147330 2022-04-28T14:41:27.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.654+0000 7f53fd709700 1 -- 172.21.15.22:0/1865984462 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f53f8099690 con 0x7f53f8147330 2022-04-28T14:41:27.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.654+0000 7f53eeffd700 1 -- 172.21.15.22:0/1865984462 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f53f0014070 con 0x7f53f8147330 2022-04-28T14:41:27.659 INFO:teuthology.orchestra.run.smithi022.stdout:38654705695 2022-04-28T14:41:27.661 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.656+0000 7f53fd709700 1 -- 172.21.15.22:0/1865984462 >> v1:172.21.15.22:6808/92758 conn(0x7f53dc041ad0 legacy=0x7f53dc043f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:27.661 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.656+0000 7f53fd709700 1 -- 172.21.15.22:0/1865984462 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f53f8147330 msgr2=0x7f53f81477b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:27.661 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.656+0000 7f53fd709700 1 --2- 172.21.15.22:0/1865984462 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f53f8147330 0x7f53f81477b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f53f000bfd0 tx=0x7f53f000b300).stop 2022-04-28T14:41:27.661 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.656+0000 7f53fd709700 1 -- 172.21.15.22:0/1865984462 shutdown_connections 2022-04-28T14:41:27.662 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.656+0000 7f53fd709700 1 --2- 172.21.15.22:0/1865984462 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f53f8147330 0x7f53f81477b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:27.662 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.656+0000 7f53fd709700 1 --2- 172.21.15.22:0/1865984462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f53f8063100 0x7f53f8136f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:27.662 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.656+0000 7f53fd709700 1 --2- 172.21.15.22:0/1865984462 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f53f8133b60 0x7f53f81380a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:27.662 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.656+0000 7f53fd709700 1 -- 172.21.15.22:0/1865984462 >> 172.21.15.22:0/1865984462 conn(0x7f53f80aaf80 msgr2=0x7f53f8063c40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:27.662 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.656+0000 7f53fd709700 1 -- 172.21.15.22:0/1865984462 shutdown_connections 2022-04-28T14:41:27.662 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.656+0000 7f53fd709700 1 -- 172.21.15.22:0/1865984462 wait complete. 2022-04-28T14:41:27.673 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705695 for osd.0 2022-04-28T14:41:27.673 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2022-04-28T14:41:27.795 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.790+0000 7f29a436e700 1 Processor -- start 2022-04-28T14:41:27.795 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.790+0000 7f29a436e700 1 -- start start 2022-04-28T14:41:27.796 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.791+0000 7f29a436e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f299c097c60 0x7f299c09a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:27.796 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.791+0000 7f29a436e700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f299c133b60 0x7f299c133ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:27.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.791+0000 7f29a436e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f299c099e00 con 0x7f299c063100 2022-04-28T14:41:27.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.791+0000 7f29a436e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f299c0634e0 con 0x7f299c097c60 2022-04-28T14:41:27.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.791+0000 7f29a436e700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f299c0980f0 con 0x7f299c133b60 2022-04-28T14:41:27.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.791+0000 7f29a210a700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f299c063100 0x7f299c098b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39778/0 (socket says 172.21.15.22:39778) 2022-04-28T14:41:27.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.791+0000 7f29a210a700 1 -- 172.21.15.22:0/3286841596 learned_addr learned my addr 172.21.15.22:0/3286841596 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:41:27.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.791+0000 7f29a1909700 1 --2- 172.21.15.22:0/3286841596 >> v2:172.21.15.22:3300/0 conn(0x7f299c097c60 0x7f299c09a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:27.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.791+0000 7f29a1909700 1 -- 172.21.15.22:0/3286841596 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f299c133b60 msgr2=0x7f299c133ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:27.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.791+0000 7f29a1909700 1 --2- 172.21.15.22:0/3286841596 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f299c133b60 0x7f299c133ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-04-28T14:41:27.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.791+0000 7f29a1909700 1 -- 172.21.15.22:0/3286841596 >> v1:172.21.15.22:6789/0 conn(0x7f299c063100 legacy=0x7f299c098b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:27.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.791+0000 7f29a1108700 1 -- 172.21.15.22:0/3286841596 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786015382 0 0) 0x7f299c099e00 con 0x7f299c063100 2022-04-28T14:41:27.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.791+0000 7f29a1909700 1 -- 172.21.15.22:0/3286841596 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299c099240 con 0x7f299c097c60 2022-04-28T14:41:27.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.791+0000 7f29a1909700 1 --2- 172.21.15.22:0/3286841596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f299c097c60 0x7f299c09a270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f298c009760 tx=0x7f298c009060).ready entity=mon.0 client_cookie=1e4cd3ee12a8af2d server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:27.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.792+0000 7f29a1108700 1 -- 172.21.15.22:0/3286841596 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c00b580 con 0x7f299c097c60 2022-04-28T14:41:27.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.792+0000 7f29a1108700 1 -- 172.21.15.22:0/3286841596 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c00b6e0 con 0x7f299c097c60 2022-04-28T14:41:27.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.792+0000 7f29a1108700 1 -- 172.21.15.22:0/3286841596 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c00ba60 con 0x7f299c097c60 2022-04-28T14:41:27.802 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.792+0000 7f29a436e700 1 -- 172.21.15.22:0/3286841596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f299c097c60 msgr2=0x7f299c09a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:27.802 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.792+0000 7f29a436e700 1 --2- 172.21.15.22:0/3286841596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f299c097c60 0x7f299c09a270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f298c009760 tx=0x7f298c009060).stop 2022-04-28T14:41:27.802 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.792+0000 7f29a436e700 1 -- 172.21.15.22:0/3286841596 shutdown_connections 2022-04-28T14:41:27.802 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.792+0000 7f29a436e700 1 --2- 172.21.15.22:0/3286841596 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f299c133b60 0x7f299c133ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-04-28T14:41:27.802 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.793+0000 7f29a436e700 1 --2- 172.21.15.22:0/3286841596 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f299c097c60 0x7f299c09a270 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:27.802 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.793+0000 7f29a436e700 1 -- 172.21.15.22:0/3286841596 >> 172.21.15.22:0/3286841596 conn(0x7f299c0aaf80 msgr2=0x7f299c0ab390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:27.802 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.793+0000 7f29a436e700 1 -- 172.21.15.22:0/3286841596 shutdown_connections 2022-04-28T14:41:27.802 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.793+0000 7f29a436e700 1 -- 172.21.15.22:0/3286841596 wait complete. 2022-04-28T14:41:27.803 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.794+0000 7f29a436e700 1 Processor -- start 2022-04-28T14:41:27.803 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.794+0000 7f29a436e700 1 -- start start 2022-04-28T14:41:27.803 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.794+0000 7f29a436e700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f299c063100 0x7f299c091520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:27.803 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.794+0000 7f29a436e700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f299c133b60 0x7f299c0929e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:27.803 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.794+0000 7f29a436e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f299c091060 0x7f299c136b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:27.803 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.794+0000 7f29a436e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c097ac0 con 0x7f299c091060 2022-04-28T14:41:27.803 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.794+0000 7f29a436e700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c1442d0 con 0x7f299c133b60 2022-04-28T14:41:27.803 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.794+0000 7f29a436e700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f299c144570 con 0x7f299c063100 2022-04-28T14:41:27.803 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.794+0000 7f29a210a700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f299c063100 0x7f299c091520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:27.803 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.794+0000 7f29a210a700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f299c063100 0x7f299c091520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:47736/0 (socket says 172.21.15.22:47736) 2022-04-28T14:41:27.804 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.794+0000 7f29a290b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f299c091060 0x7f299c136b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:27.804 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.794+0000 7f29a210a700 1 -- 172.21.15.22:0/3518451365 learned_addr learned my addr 172.21.15.22:0/3518451365 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:27.804 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.794+0000 7f29a1909700 1 --2- 172.21.15.22:0/3518451365 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f299c133b60 0x7f299c0929e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:27.804 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.795+0000 7f29a290b700 1 -- 172.21.15.22:0/3518451365 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f299c063100 msgr2=0x7f299c091520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:27.804 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.795+0000 7f29a290b700 1 --2- 172.21.15.22:0/3518451365 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f299c063100 0x7f299c091520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:27.804 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.795+0000 7f29a290b700 1 -- 172.21.15.22:0/3518451365 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f299c133b60 msgr2=0x7f299c0929e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:27.804 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.795+0000 7f29a290b700 1 --2- 172.21.15.22:0/3518451365 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f299c133b60 0x7f299c0929e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:27.804 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.795+0000 7f29a290b700 1 -- 172.21.15.22:0/3518451365 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298c0092a0 con 0x7f299c091060 2022-04-28T14:41:27.804 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.795+0000 7f29a290b700 1 --2- 172.21.15.22:0/3518451365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f299c091060 0x7f299c136b70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f299400b810 tx=0x7f2994009270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:27.804 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.795+0000 7f298a7fc700 1 -- 172.21.15.22:0/3518451365 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299400d4a0 con 0x7f299c091060 2022-04-28T14:41:27.805 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.795+0000 7f298a7fc700 1 -- 172.21.15.22:0/3518451365 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299400d620 con 0x7f299c091060 2022-04-28T14:41:27.805 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.795+0000 7f29a436e700 1 -- 172.21.15.22:0/3518451365 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299c091d00 con 0x7f299c091060 2022-04-28T14:41:27.805 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.795+0000 7f298a7fc700 1 -- 172.21.15.22:0/3518451365 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299400d9e0 con 0x7f299c091060 2022-04-28T14:41:27.805 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.795+0000 7f29a436e700 1 -- 172.21.15.22:0/3518451365 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299c092f80 con 0x7f299c091060 2022-04-28T14:41:27.805 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.796+0000 7f29a436e700 1 -- 172.21.15.22:0/3518451365 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299c066da0 con 0x7f299c091060 2022-04-28T14:41:27.805 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.796+0000 7f298a7fc700 1 -- 172.21.15.22:0/3518451365 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 48534+0+0 (secure 0 0 0) 0x7f2994018030 con 0x7f299c091060 2022-04-28T14:41:27.806 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.797+0000 7f298a7fc700 1 -- 172.21.15.22:0/3518451365 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f2994054b60 con 0x7f299c091060 2022-04-28T14:41:27.806 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.800+0000 7f298a7fc700 1 -- 172.21.15.22:0/3518451365 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f2994035250 con 0x7f299c091060 2022-04-28T14:41:27.948 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.943+0000 7f29a436e700 1 -- 172.21.15.22:0/3518451365 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f299c1384e0 con 0x7f299c091060 2022-04-28T14:41:27.949 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.943+0000 7f298a7fc700 1 -- 172.21.15.22:0/3518451365 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2994038a40 con 0x7f299c091060 2022-04-28T14:41:27.949 INFO:teuthology.orchestra.run.smithi022.stdout:38654705694 2022-04-28T14:41:27.951 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.945+0000 7f29a436e700 1 -- 172.21.15.22:0/3518451365 >> v1:172.21.15.22:6808/92758 conn(0x7f297c041ad0 legacy=0x7f297c043f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:27.951 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.945+0000 7f29a436e700 1 -- 172.21.15.22:0/3518451365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f299c091060 msgr2=0x7f299c136b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:27.951 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.945+0000 7f29a436e700 1 --2- 172.21.15.22:0/3518451365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f299c091060 0x7f299c136b70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f299400b810 tx=0x7f2994009270).stop 2022-04-28T14:41:27.951 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.945+0000 7f29a436e700 1 -- 172.21.15.22:0/3518451365 shutdown_connections 2022-04-28T14:41:27.951 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.945+0000 7f29a436e700 1 --2- 172.21.15.22:0/3518451365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f299c091060 0x7f299c136b70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:27.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.945+0000 7f29a436e700 1 --2- 172.21.15.22:0/3518451365 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f299c063100 0x7f299c091520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:27.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.945+0000 7f29a436e700 1 --2- 172.21.15.22:0/3518451365 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f299c133b60 0x7f299c0929e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:27.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.945+0000 7f29a436e700 1 -- 172.21.15.22:0/3518451365 >> 172.21.15.22:0/3518451365 conn(0x7f299c0aaf80 msgr2=0x7f299c063c40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:27.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.945+0000 7f29a436e700 1 -- 172.21.15.22:0/3518451365 shutdown_connections 2022-04-28T14:41:27.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:27.945+0000 7f29a436e700 1 -- 172.21.15.22:0/3518451365 wait complete. 2022-04-28T14:41:27.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705693 got 38654705694 for osd.1 2022-04-28T14:41:27.961 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2022-04-28T14:41:28.080 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.075+0000 7fc6b5e37700 1 Processor -- start 2022-04-28T14:41:28.080 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.075+0000 7fc6b5e37700 1 -- start start 2022-04-28T14:41:28.087 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.076+0000 7fc6b5e37700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6b013b850 0x7fc6b0138920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:28.087 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.076+0000 7fc6b5e37700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc6b00681c0 0x7fc6b0138e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:28.087 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.076+0000 7fc6b5e37700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b00a7930 con 0x7fc6b0064530 2022-04-28T14:41:28.087 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.076+0000 7fc6b5e37700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b0064910 con 0x7fc6b00681c0 2022-04-28T14:41:28.087 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.076+0000 7fc6b5e37700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b0138410 con 0x7fc6b013b850 2022-04-28T14:41:28.087 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.076+0000 7fc6af7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc6b0064530 0x7fc6b013bf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39788/0 (socket says 172.21.15.22:39788) 2022-04-28T14:41:28.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.076+0000 7fc6affff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc6b00681c0 0x7fc6b0138e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:28.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.076+0000 7fc6af7fe700 1 -- 172.21.15.22:0/234796130 learned_addr learned my addr 172.21.15.22:0/234796130 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:41:28.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.076+0000 7fc6aeffd700 1 --2- 172.21.15.22:0/234796130 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6b013b850 0x7fc6b0138920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:28.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.076+0000 7fc6affff700 1 -- 172.21.15.22:0/234796130 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6b013b850 msgr2=0x7fc6b0138920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:28.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.076+0000 7fc6affff700 1 --2- 172.21.15.22:0/234796130 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6b013b850 0x7fc6b0138920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.076+0000 7fc6affff700 1 -- 172.21.15.22:0/234796130 >> v1:172.21.15.22:6789/0 conn(0x7fc6b0064530 legacy=0x7fc6b013bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:28.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.076+0000 7fc6ae7fc700 1 -- 172.21.15.22:0/234796130 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2589729162 0 0) 0x7fc6b00a7930 con 0x7fc6b0064530 2022-04-28T14:41:28.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.076+0000 7fc6affff700 1 -- 172.21.15.22:0/234796130 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b0138670 con 0x7fc6b00681c0 2022-04-28T14:41:28.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.077+0000 7fc6affff700 1 --2- 172.21.15.22:0/234796130 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6b00681c0 0x7fc6b0138e10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fc6a8009e60 tx=0x7fc6a8009780).ready entity=mon.0 client_cookie=c18f568c4cbb7c4 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:28.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.077+0000 7fc6ae7fc700 1 -- 172.21.15.22:0/234796130 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a800e070 con 0x7fc6b00681c0 2022-04-28T14:41:28.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.077+0000 7fc6ae7fc700 1 -- 172.21.15.22:0/234796130 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a800bb60 con 0x7fc6b00681c0 2022-04-28T14:41:28.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.077+0000 7fc6ae7fc700 1 -- 172.21.15.22:0/234796130 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8012410 con 0x7fc6b00681c0 2022-04-28T14:41:28.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.077+0000 7fc6b5e37700 1 -- 172.21.15.22:0/234796130 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6b00681c0 msgr2=0x7fc6b0138e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:28.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.077+0000 7fc6b5e37700 1 --2- 172.21.15.22:0/234796130 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6b00681c0 0x7fc6b0138e10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fc6a8009e60 tx=0x7fc6a8009780).stop 2022-04-28T14:41:28.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.077+0000 7fc6b5e37700 1 -- 172.21.15.22:0/234796130 shutdown_connections 2022-04-28T14:41:28.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.077+0000 7fc6b5e37700 1 --2- 172.21.15.22:0/234796130 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6b00681c0 0x7fc6b0138e10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.077+0000 7fc6b5e37700 1 --2- 172.21.15.22:0/234796130 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6b013b850 0x7fc6b0138920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.077+0000 7fc6b5e37700 1 -- 172.21.15.22:0/234796130 >> 172.21.15.22:0/234796130 conn(0x7fc6b0067070 msgr2=0x7fc6b0063c60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:28.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.077+0000 7fc6b5e37700 1 -- 172.21.15.22:0/234796130 shutdown_connections 2022-04-28T14:41:28.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.077+0000 7fc6b5e37700 1 -- 172.21.15.22:0/234796130 wait complete. 2022-04-28T14:41:28.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.078+0000 7fc6b5e37700 1 Processor -- start 2022-04-28T14:41:28.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.078+0000 7fc6b5e37700 1 -- start start 2022-04-28T14:41:28.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.079+0000 7fc6b5e37700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6b0064530 0x7fc6b00a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:28.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.079+0000 7fc6b5e37700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6b00681c0 0x7fc6b00a2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:28.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.079+0000 7fc6b5e37700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6b013b850 0x7fc6b0147210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:28.092 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.079+0000 7fc6b5e37700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b00a2060 con 0x7fc6b0064530 2022-04-28T14:41:28.092 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.079+0000 7fc6b5e37700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b00a22d0 con 0x7fc6b013b850 2022-04-28T14:41:28.092 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.079+0000 7fc6b5e37700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b0148050 con 0x7fc6b00681c0 2022-04-28T14:41:28.092 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.079+0000 7fc6aeffd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6b00681c0 0x7fc6b00a2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:28.092 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.079+0000 7fc6af7fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6b0064530 0x7fc6b00a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:28.092 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.079+0000 7fc6affff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6b013b850 0x7fc6b0147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:28.092 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.079+0000 7fc6aeffd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6b00681c0 0x7fc6b00a2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:47752/0 (socket says 172.21.15.22:47752) 2022-04-28T14:41:28.093 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.079+0000 7fc6aeffd700 1 -- 172.21.15.22:0/1461943087 learned_addr learned my addr 172.21.15.22:0/1461943087 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:28.093 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.079+0000 7fc6af7fe700 1 -- 172.21.15.22:0/1461943087 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6b00681c0 msgr2=0x7fc6b00a2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:28.093 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.079+0000 7fc6af7fe700 1 --2- 172.21.15.22:0/1461943087 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6b00681c0 0x7fc6b00a2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.093 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.079+0000 7fc6af7fe700 1 -- 172.21.15.22:0/1461943087 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6b013b850 msgr2=0x7fc6b0147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:28.093 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.079+0000 7fc6af7fe700 1 --2- 172.21.15.22:0/1461943087 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6b013b850 0x7fc6b0147210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.093 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.079+0000 7fc6af7fe700 1 -- 172.21.15.22:0/1461943087 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a8009a20 con 0x7fc6b0064530 2022-04-28T14:41:28.094 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.079+0000 7fc6af7fe700 1 --2- 172.21.15.22:0/1461943087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6b0064530 0x7fc6b00a1690 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fc6a0000c00 tx=0x7fc6a0007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:28.094 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.080+0000 7fc6a77fe700 1 -- 172.21.15.22:0/1461943087 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a000ce00 con 0x7fc6b0064530 2022-04-28T14:41:28.094 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.080+0000 7fc6a77fe700 1 -- 172.21.15.22:0/1461943087 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a00072e0 con 0x7fc6b0064530 2022-04-28T14:41:28.094 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.080+0000 7fc6b5e37700 1 -- 172.21.15.22:0/1461943087 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b0148310 con 0x7fc6b0064530 2022-04-28T14:41:28.094 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.080+0000 7fc6a77fe700 1 -- 172.21.15.22:0/1461943087 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a00057a0 con 0x7fc6b0064530 2022-04-28T14:41:28.095 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.080+0000 7fc6b5e37700 1 -- 172.21.15.22:0/1461943087 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b009f3e0 con 0x7fc6b0064530 2022-04-28T14:41:28.095 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.081+0000 7fc6a77fe700 1 -- 172.21.15.22:0/1461943087 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 7) v1 ==== 48534+0+0 (secure 0 0 0) 0x7fc6a0010070 con 0x7fc6b0064530 2022-04-28T14:41:28.095 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.081+0000 7fc6a77fe700 1 -- 172.21.15.22:0/1461943087 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3702+0+0 (secure 0 0 0) 0x7fc6a00548f0 con 0x7fc6b0064530 2022-04-28T14:41:28.095 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.081+0000 7fc6b5e37700 1 -- 172.21.15.22:0/1461943087 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b00a14e0 con 0x7fc6b0064530 2022-04-28T14:41:28.095 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.085+0000 7fc6a77fe700 1 -- 172.21.15.22:0/1461943087 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7fc6a00351b0 con 0x7fc6b0064530 2022-04-28T14:41:28.236 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.230+0000 7fc6b5e37700 1 -- 172.21.15.22:0/1461943087 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc6b013b1f0 con 0x7fc6b0064530 2022-04-28T14:41:28.236 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.231+0000 7fc6a77fe700 1 -- 172.21.15.22:0/1461943087 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc6a00387d0 con 0x7fc6b0064530 2022-04-28T14:41:28.236 INFO:teuthology.orchestra.run.smithi022.stdout:38654705695 2022-04-28T14:41:28.238 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.232+0000 7fc6b5e37700 1 -- 172.21.15.22:0/1461943087 >> v1:172.21.15.22:6808/92758 conn(0x7fc694041ad0 legacy=0x7fc694043f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:28.238 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.232+0000 7fc6b5e37700 1 -- 172.21.15.22:0/1461943087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6b0064530 msgr2=0x7fc6b00a1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:28.238 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.232+0000 7fc6b5e37700 1 --2- 172.21.15.22:0/1461943087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6b0064530 0x7fc6b00a1690 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fc6a0000c00 tx=0x7fc6a0007b90).stop 2022-04-28T14:41:28.238 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.232+0000 7fc6b5e37700 1 -- 172.21.15.22:0/1461943087 shutdown_connections 2022-04-28T14:41:28.238 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.232+0000 7fc6b5e37700 1 --2- 172.21.15.22:0/1461943087 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc6b013b850 0x7fc6b0147210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.238 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.232+0000 7fc6b5e37700 1 --2- 172.21.15.22:0/1461943087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6b0064530 0x7fc6b00a1690 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.238 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.232+0000 7fc6b5e37700 1 --2- 172.21.15.22:0/1461943087 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc6b00681c0 0x7fc6b00a2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.239 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.232+0000 7fc6b5e37700 1 -- 172.21.15.22:0/1461943087 >> 172.21.15.22:0/1461943087 conn(0x7fc6b0067070 msgr2=0x7fc6b0138890 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:28.239 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.232+0000 7fc6b5e37700 1 -- 172.21.15.22:0/1461943087 shutdown_connections 2022-04-28T14:41:28.239 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.232+0000 7fc6b5e37700 1 -- 172.21.15.22:0/1461943087 wait complete. 2022-04-28T14:41:28.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705695 for osd.2 2022-04-28T14:41:28.249 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2022-04-28T14:41:28.368 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.364+0000 7fa221344700 1 Processor -- start 2022-04-28T14:41:28.369 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.364+0000 7fa221344700 1 -- start start 2022-04-28T14:41:28.374 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.364+0000 7fa221344700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa21c0a9ee0 0x7fa21c0a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:28.374 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.364+0000 7fa221344700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa21c0a3070 0x7fa21c1398b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:28.374 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.364+0000 7fa221344700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa21c0a2920 con 0x7fa21c139da0 2022-04-28T14:41:28.374 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.364+0000 7fa221344700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c13a540 con 0x7fa21c0a9ee0 2022-04-28T14:41:28.374 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.364+0000 7fa221344700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c13a280 con 0x7fa21c0a3070 2022-04-28T14:41:28.374 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.365+0000 7fa21a7fc700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa21c0a3070 0x7fa21c1398b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:28.374 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.365+0000 7fa21affd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa21c0a9ee0 0x7fa21c0a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:28.375 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.365+0000 7fa21b7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa21c139da0 0x7fa21c1360a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39806/0 (socket says 172.21.15.22:39806) 2022-04-28T14:41:28.375 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.365+0000 7fa21b7fe700 1 -- 172.21.15.22:0/838292983 learned_addr learned my addr 172.21.15.22:0/838292983 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:41:28.375 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.365+0000 7fa21affd700 1 --2- 172.21.15.22:0/838292983 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa21c0a9ee0 0x7fa21c0a1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:47974/0 (socket says 172.21.15.22:47974) 2022-04-28T14:41:28.375 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.365+0000 7fa21a7fc700 1 -- 172.21.15.22:0/838292983 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa21c0a9ee0 msgr2=0x7fa21c0a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:28.375 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.365+0000 7fa219ffb700 1 -- 172.21.15.22:0/838292983 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1825558485 0 0) 0x7fa21c0a2920 con 0x7fa21c139da0 2022-04-28T14:41:28.375 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.365+0000 7fa21a7fc700 1 --2- 172.21.15.22:0/838292983 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa21c0a9ee0 0x7fa21c0a1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.375 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.365+0000 7fa21a7fc700 1 -- 172.21.15.22:0/838292983 >> v1:172.21.15.22:6789/0 conn(0x7fa21c139da0 legacy=0x7fa21c1360a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:28.375 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.365+0000 7fa21a7fc700 1 -- 172.21.15.22:0/838292983 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21c0a22b0 con 0x7fa21c0a3070 2022-04-28T14:41:28.375 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.365+0000 7fa21affd700 1 --2- 172.21.15.22:0/838292983 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa21c0a9ee0 0x7fa21c0a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:28.375 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.365+0000 7fa21a7fc700 1 --2- 172.21.15.22:0/838292983 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa21c0a3070 0x7fa21c1398b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fa210009790 tx=0x7fa210009060).ready entity=mon.2 client_cookie=cbff03767682546 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:28.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.365+0000 7fa219ffb700 1 -- 172.21.15.22:0/838292983 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21000f510 con 0x7fa21c0a3070 2022-04-28T14:41:28.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.365+0000 7fa219ffb700 1 -- 172.21.15.22:0/838292983 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21000f670 con 0x7fa21c0a3070 2022-04-28T14:41:28.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.365+0000 7fa219ffb700 1 -- 172.21.15.22:0/838292983 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21000f9f0 con 0x7fa21c0a3070 2022-04-28T14:41:28.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.366+0000 7fa221344700 1 -- 172.21.15.22:0/838292983 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa21c0a3070 msgr2=0x7fa21c1398b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:28.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.366+0000 7fa221344700 1 --2- 172.21.15.22:0/838292983 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa21c0a3070 0x7fa21c1398b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fa210009790 tx=0x7fa210009060).stop 2022-04-28T14:41:28.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.366+0000 7fa221344700 1 -- 172.21.15.22:0/838292983 shutdown_connections 2022-04-28T14:41:28.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.366+0000 7fa221344700 1 --2- 172.21.15.22:0/838292983 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa21c0a9ee0 0x7fa21c0a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.366+0000 7fa221344700 1 --2- 172.21.15.22:0/838292983 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa21c0a3070 0x7fa21c1398b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.366+0000 7fa221344700 1 -- 172.21.15.22:0/838292983 >> 172.21.15.22:0/838292983 conn(0x7fa21c069860 msgr2=0x7fa21c069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:28.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.366+0000 7fa221344700 1 -- 172.21.15.22:0/838292983 shutdown_connections 2022-04-28T14:41:28.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.366+0000 7fa221344700 1 -- 172.21.15.22:0/838292983 wait complete. 2022-04-28T14:41:28.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.367+0000 7fa221344700 1 Processor -- start 2022-04-28T14:41:28.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.367+0000 7fa221344700 1 -- start start 2022-04-28T14:41:28.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.367+0000 7fa221344700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa21c0a3070 0x7fa21c0a9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:28.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.367+0000 7fa221344700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa21c0a9ee0 0x7fa21c146440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:28.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.367+0000 7fa221344700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa21c139da0 0x7fa21c149170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:28.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.367+0000 7fa221344700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c0a8d70 con 0x7fa21c0a9ee0 2022-04-28T14:41:28.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.367+0000 7fa221344700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c0a8f50 con 0x7fa21c0a3070 2022-04-28T14:41:28.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.367+0000 7fa221344700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c0a7520 con 0x7fa21c139da0 2022-04-28T14:41:28.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.367+0000 7fa21affd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa21c0a3070 0x7fa21c0a9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:28.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.368+0000 7fa21affd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa21c0a3070 0x7fa21c0a9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:47980/0 (socket says 172.21.15.22:47980) 2022-04-28T14:41:28.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.368+0000 7fa21affd700 1 -- 172.21.15.22:0/1579525551 learned_addr learned my addr 172.21.15.22:0/1579525551 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:28.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.368+0000 7fa21b7fe700 1 --2- 172.21.15.22:0/1579525551 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa21c139da0 0x7fa21c149170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:28.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.368+0000 7fa21a7fc700 1 --2- 172.21.15.22:0/1579525551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa21c0a9ee0 0x7fa21c146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:28.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.368+0000 7fa21affd700 1 -- 172.21.15.22:0/1579525551 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa21c139da0 msgr2=0x7fa21c149170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:28.379 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.368+0000 7fa21affd700 1 --2- 172.21.15.22:0/1579525551 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa21c139da0 0x7fa21c149170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.379 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.368+0000 7fa21affd700 1 -- 172.21.15.22:0/1579525551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa21c0a9ee0 msgr2=0x7fa21c146440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:28.379 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.368+0000 7fa21affd700 1 --2- 172.21.15.22:0/1579525551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa21c0a9ee0 0x7fa21c146440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.379 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.368+0000 7fa21affd700 1 -- 172.21.15.22:0/1579525551 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20c0092a0 con 0x7fa21c0a3070 2022-04-28T14:41:28.379 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.368+0000 7fa21a7fc700 1 --2- 172.21.15.22:0/1579525551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa21c0a9ee0 0x7fa21c146440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:28.379 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.368+0000 7fa21b7fe700 1 --2- 172.21.15.22:0/1579525551 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa21c139da0 0x7fa21c149170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:28.379 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.368+0000 7fa21affd700 1 --2- 172.21.15.22:0/1579525551 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa21c0a3070 0x7fa21c0a9910 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fa20c00ea20 tx=0x7fa20c009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:28.379 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.368+0000 7fa202ffd700 1 -- 172.21.15.22:0/1579525551 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c00ee60 con 0x7fa21c0a3070 2022-04-28T14:41:28.379 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.368+0000 7fa202ffd700 1 -- 172.21.15.22:0/1579525551 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20c00c850 con 0x7fa21c0a3070 2022-04-28T14:41:28.380 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.368+0000 7fa221344700 1 -- 172.21.15.22:0/1579525551 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2100092a0 con 0x7fa21c0a3070 2022-04-28T14:41:28.380 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.368+0000 7fa202ffd700 1 -- 172.21.15.22:0/1579525551 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c00cbd0 con 0x7fa21c0a3070 2022-04-28T14:41:28.380 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.368+0000 7fa221344700 1 -- 172.21.15.22:0/1579525551 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa21c0a78f0 con 0x7fa21c0a3070 2022-04-28T14:41:28.380 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.369+0000 7fa202ffd700 1 -- 172.21.15.22:0/1579525551 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 7) v1 ==== 48534+0+0 (secure 0 0 0) 0x7fa20c022070 con 0x7fa21c0a3070 2022-04-28T14:41:28.380 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.369+0000 7fa221344700 1 -- 172.21.15.22:0/1579525551 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa21c09f510 con 0x7fa21c0a3070 2022-04-28T14:41:28.380 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.369+0000 7fa202ffd700 1 -- 172.21.15.22:0/1579525551 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7fa20c055710 con 0x7fa21c0a3070 2022-04-28T14:41:28.381 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.373+0000 7fa202ffd700 1 -- 172.21.15.22:0/1579525551 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7fa20c035e00 con 0x7fa21c0a3070 2022-04-28T14:41:28.521 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.516+0000 7fa221344700 1 -- 172.21.15.22:0/1579525551 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa21c0aa2c0 con 0x7fa21c0a3070 2022-04-28T14:41:28.521 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.516+0000 7fa202ffd700 1 -- 172.21.15.22:0/1579525551 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa20c0395f0 con 0x7fa21c0a3070 2022-04-28T14:41:28.522 INFO:teuthology.orchestra.run.smithi022.stdout:38654705695 2022-04-28T14:41:28.523 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.517+0000 7fa221344700 1 -- 172.21.15.22:0/1579525551 >> v1:172.21.15.22:6808/92758 conn(0x7fa1fc041ad0 legacy=0x7fa1fc043f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:28.523 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.517+0000 7fa221344700 1 -- 172.21.15.22:0/1579525551 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa21c0a3070 msgr2=0x7fa21c0a9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:28.523 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.517+0000 7fa221344700 1 --2- 172.21.15.22:0/1579525551 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa21c0a3070 0x7fa21c0a9910 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fa20c00ea20 tx=0x7fa20c009060).stop 2022-04-28T14:41:28.523 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.518+0000 7fa221344700 1 -- 172.21.15.22:0/1579525551 shutdown_connections 2022-04-28T14:41:28.524 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.518+0000 7fa221344700 1 --2- 172.21.15.22:0/1579525551 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa21c139da0 0x7fa21c149170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.524 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.518+0000 7fa221344700 1 --2- 172.21.15.22:0/1579525551 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa21c0a3070 0x7fa21c0a9910 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.524 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.518+0000 7fa221344700 1 --2- 172.21.15.22:0/1579525551 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa21c0a9ee0 0x7fa21c146440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.524 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.518+0000 7fa221344700 1 -- 172.21.15.22:0/1579525551 >> 172.21.15.22:0/1579525551 conn(0x7fa21c069860 msgr2=0x7fa21c133060 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:28.524 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.518+0000 7fa221344700 1 -- 172.21.15.22:0/1579525551 shutdown_connections 2022-04-28T14:41:28.525 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.518+0000 7fa221344700 1 -- 172.21.15.22:0/1579525551 wait complete. 2022-04-28T14:41:28.534 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705695 for osd.3 2022-04-28T14:41:28.534 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2022-04-28T14:41:28.534 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-04-28T14:41:28.655 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.647+0000 7fe0edb74700 1 Processor -- start 2022-04-28T14:41:28.655 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.647+0000 7fe0edb74700 1 -- start start 2022-04-28T14:41:28.655 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.648+0000 7fe0edb74700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe0e8063e20 0x7fe0e809cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:28.655 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.648+0000 7fe0edb74700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe0e8099600 0x7fe0e809b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:28.656 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.648+0000 7fe0edb74700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e80639d0 con 0x7fe0e8098180 2022-04-28T14:41:28.656 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.648+0000 7fe0edb74700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e8099d00 con 0x7fe0e8099600 2022-04-28T14:41:28.656 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.648+0000 7fe0edb74700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e8064200 con 0x7fe0e8063e20 2022-04-28T14:41:28.656 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.648+0000 7fe0e6ffd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe0e8099600 0x7fe0e809b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:28.656 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.648+0000 7fe0e7fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe0e8098180 0x7fe0e813b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39818/0 (socket says 172.21.15.22:39818) 2022-04-28T14:41:28.657 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.648+0000 7fe0e77fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe0e8063e20 0x7fe0e809cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:28.657 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.648+0000 7fe0e7fff700 1 -- 172.21.15.22:0/2722767430 learned_addr learned my addr 172.21.15.22:0/2722767430 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:41:28.657 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.648+0000 7fe0e67fc700 1 -- 172.21.15.22:0/2722767430 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 34530238 0 0) 0x7fe0e80639d0 con 0x7fe0e8098180 2022-04-28T14:41:28.657 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.648+0000 7fe0e6ffd700 1 -- 172.21.15.22:0/2722767430 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe0e8063e20 msgr2=0x7fe0e809cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:28.657 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.648+0000 7fe0e6ffd700 1 --2- 172.21.15.22:0/2722767430 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe0e8063e20 0x7fe0e809cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.657 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.648+0000 7fe0e6ffd700 1 -- 172.21.15.22:0/2722767430 >> v1:172.21.15.22:6789/0 conn(0x7fe0e8098180 legacy=0x7fe0e813b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:28.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.648+0000 7fe0e6ffd700 1 -- 172.21.15.22:0/2722767430 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e809b9c0 con 0x7fe0e8099600 2022-04-28T14:41:28.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.648+0000 7fe0e77fe700 1 --2- 172.21.15.22:0/2722767430 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe0e8063e20 0x7fe0e809cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:28.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.648+0000 7fe0e6ffd700 1 --2- 172.21.15.22:0/2722767430 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe0e8099600 0x7fe0e809b4d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fe0d0009790 tx=0x7fe0d0009060).ready entity=mon.1 client_cookie=f36b95866aa2e57 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:28.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.649+0000 7fe0e67fc700 1 -- 172.21.15.22:0/2722767430 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d000b590 con 0x7fe0e8099600 2022-04-28T14:41:28.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.649+0000 7fe0e67fc700 1 -- 172.21.15.22:0/2722767430 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d000b6f0 con 0x7fe0e8099600 2022-04-28T14:41:28.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.649+0000 7fe0e67fc700 1 -- 172.21.15.22:0/2722767430 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d000ba70 con 0x7fe0e8099600 2022-04-28T14:41:28.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.649+0000 7fe0edb74700 1 -- 172.21.15.22:0/2722767430 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe0e8099600 msgr2=0x7fe0e809b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:28.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.649+0000 7fe0edb74700 1 --2- 172.21.15.22:0/2722767430 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe0e8099600 0x7fe0e809b4d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fe0d0009790 tx=0x7fe0d0009060).stop 2022-04-28T14:41:28.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.649+0000 7fe0edb74700 1 -- 172.21.15.22:0/2722767430 shutdown_connections 2022-04-28T14:41:28.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.649+0000 7fe0edb74700 1 --2- 172.21.15.22:0/2722767430 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe0e8063e20 0x7fe0e809cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.649+0000 7fe0edb74700 1 --2- 172.21.15.22:0/2722767430 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe0e8099600 0x7fe0e809b4d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.649+0000 7fe0edb74700 1 -- 172.21.15.22:0/2722767430 >> 172.21.15.22:0/2722767430 conn(0x7fe0e80aaf80 msgr2=0x7fe0e80ab390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:28.660 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.649+0000 7fe0edb74700 1 -- 172.21.15.22:0/2722767430 shutdown_connections 2022-04-28T14:41:28.660 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.649+0000 7fe0edb74700 1 -- 172.21.15.22:0/2722767430 wait complete. 2022-04-28T14:41:28.660 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.650+0000 7fe0edb74700 1 Processor -- start 2022-04-28T14:41:28.660 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.650+0000 7fe0edb74700 1 -- start start 2022-04-28T14:41:28.662 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.651+0000 7fe0edb74700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0e8063e20 0x7fe0e80a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:28.663 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.651+0000 7fe0edb74700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe0e8098180 0x7fe0e80a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:28.663 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.651+0000 7fe0edb74700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe0e8099600 0x7fe0e80a21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:28.663 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.651+0000 7fe0edb74700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e8148fa0 con 0x7fe0e8063e20 2022-04-28T14:41:28.663 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.651+0000 7fe0edb74700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e80a2c40 con 0x7fe0e8098180 2022-04-28T14:41:28.663 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.651+0000 7fe0edb74700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e80a2690 con 0x7fe0e8099600 2022-04-28T14:41:28.663 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.651+0000 7fe0e6ffd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe0e8098180 0x7fe0e80a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:28.664 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.651+0000 7fe0e6ffd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe0e8098180 0x7fe0e80a1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:47996/0 (socket says 172.21.15.22:47996) 2022-04-28T14:41:28.664 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.651+0000 7fe0e77fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0e8063e20 0x7fe0e80a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:28.664 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.651+0000 7fe0e6ffd700 1 -- 172.21.15.22:0/4167141807 learned_addr learned my addr 172.21.15.22:0/4167141807 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:28.664 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.651+0000 7fe0e7fff700 1 --2- 172.21.15.22:0/4167141807 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe0e8099600 0x7fe0e80a21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:28.664 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.651+0000 7fe0e6ffd700 1 -- 172.21.15.22:0/4167141807 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe0e8099600 msgr2=0x7fe0e80a21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:28.664 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.651+0000 7fe0e6ffd700 1 --2- 172.21.15.22:0/4167141807 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe0e8099600 0x7fe0e80a21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.665 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.651+0000 7fe0e6ffd700 1 -- 172.21.15.22:0/4167141807 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0e8063e20 msgr2=0x7fe0e80a3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:28.665 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.651+0000 7fe0e6ffd700 1 --2- 172.21.15.22:0/4167141807 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0e8063e20 0x7fe0e80a3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.665 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.651+0000 7fe0e6ffd700 1 -- 172.21.15.22:0/4167141807 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d80092a0 con 0x7fe0e8098180 2022-04-28T14:41:28.665 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.651+0000 7fe0e6ffd700 1 --2- 172.21.15.22:0/4167141807 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe0e8098180 0x7fe0e80a1af0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fe0d0011000 tx=0x7fe0d0017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:28.665 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.652+0000 7fe0df7fe700 1 -- 172.21.15.22:0/4167141807 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d000b590 con 0x7fe0e8098180 2022-04-28T14:41:28.665 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.652+0000 7fe0df7fe700 1 -- 172.21.15.22:0/4167141807 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d000b860 con 0x7fe0e8098180 2022-04-28T14:41:28.665 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.652+0000 7fe0edb74700 1 -- 172.21.15.22:0/4167141807 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d00092a0 con 0x7fe0e8098180 2022-04-28T14:41:28.666 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.652+0000 7fe0df7fe700 1 -- 172.21.15.22:0/4167141807 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d001b660 con 0x7fe0e8098180 2022-04-28T14:41:28.666 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.652+0000 7fe0edb74700 1 -- 172.21.15.22:0/4167141807 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e8148690 con 0x7fe0e8098180 2022-04-28T14:41:28.666 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.653+0000 7fe0df7fe700 1 -- 172.21.15.22:0/4167141807 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 7) v1 ==== 48534+0+0 (secure 0 0 0) 0x7fe0d000f070 con 0x7fe0e8098180 2022-04-28T14:41:28.666 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.653+0000 7fe0edb74700 1 -- 172.21.15.22:0/4167141807 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e8066da0 con 0x7fe0e8098180 2022-04-28T14:41:28.666 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.653+0000 7fe0df7fe700 1 -- 172.21.15.22:0/4167141807 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7fe0d00565b0 con 0x7fe0e8098180 2022-04-28T14:41:28.666 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.656+0000 7fe0df7fe700 1 -- 172.21.15.22:0/4167141807 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7fe0d003a670 con 0x7fe0e8098180 2022-04-28T14:41:28.796 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.791+0000 7fe0edb74700 1 -- 172.21.15.22:0/4167141807 --> v1:172.21.15.22:6808/92758 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe0e809bc70 con 0x7fe0cc041ad0 2022-04-28T14:41:28.805 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.800+0000 7fe0df7fe700 1 -- 172.21.15.22:0/4167141807 <== mgr.14100 v1:172.21.15.22:6808/92758 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+325715 (unknown 2965378022 0 2009894187) 0x7fe0e809bc70 con 0x7fe0cc041ad0 2022-04-28T14:41:28.810 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:41:28.813 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.803+0000 7fe0edb74700 1 -- 172.21.15.22:0/4167141807 >> v1:172.21.15.22:6808/92758 conn(0x7fe0cc041ad0 legacy=0x7fe0cc043f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:28.814 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.803+0000 7fe0edb74700 1 -- 172.21.15.22:0/4167141807 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe0e8098180 msgr2=0x7fe0e80a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:28.814 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.803+0000 7fe0edb74700 1 --2- 172.21.15.22:0/4167141807 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe0e8098180 0x7fe0e80a1af0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fe0d0011000 tx=0x7fe0d0017000).stop 2022-04-28T14:41:28.814 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.803+0000 7fe0edb74700 1 -- 172.21.15.22:0/4167141807 shutdown_connections 2022-04-28T14:41:28.814 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.803+0000 7fe0edb74700 1 --2- 172.21.15.22:0/4167141807 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe0e8099600 0x7fe0e80a21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.815 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.803+0000 7fe0edb74700 1 --2- 172.21.15.22:0/4167141807 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0e8063e20 0x7fe0e80a3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.815 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.803+0000 7fe0edb74700 1 --2- 172.21.15.22:0/4167141807 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe0e8098180 0x7fe0e80a1af0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.815 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.803+0000 7fe0edb74700 1 -- 172.21.15.22:0/4167141807 >> 172.21.15.22:0/4167141807 conn(0x7fe0e80aaf80 msgr2=0x7fe0e813a060 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:28.815 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.803+0000 7fe0edb74700 1 -- 172.21.15.22:0/4167141807 shutdown_connections 2022-04-28T14:41:28.816 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.803+0000 7fe0edb74700 1 -- 172.21.15.22:0/4167141807 wait complete. 2022-04-28T14:41:28.816 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2022-04-28T14:41:28.820 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":7,"stamp":"2022-04-28T14:41:28.151583+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8344,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":272,"acting":272,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":272,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":4195056,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292304,"statfs":{"total":386547056640,"available":382251319296,"internally_reserved":4294967296,"allocated":737280,"data_stored":204210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7688,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.005994"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613045+0000","last_change":"2022-04-28T14:39:13.943418+0000","last_active":"2022-04-28T14:39:26.613045+0000","last_peered":"2022-04-28T14:39:26.613045+0000","last_clean":"2022-04-28T14:39:26.613045+0000","last_became_active":"2022-04-28T14:39:13.943111+0000","last_became_peered":"2022-04-28T14:39:13.943111+0000","last_unstale":"2022-04-28T14:39:26.613045+0000","last_undegraded":"2022-04-28T14:39:26.613045+0000","last_fullsized":"2022-04-28T14:39:26.613045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"17'9","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:45.546840+0000","last_change":"2022-04-28T14:39:13.619263+0000","last_active":"2022-04-28T14:39:45.546840+0000","last_peered":"2022-04-28T14:39:45.546840+0000","last_clean":"2022-04-28T14:39:45.546840+0000","last_became_active":"2022-04-28T14:39:13.618911+0000","last_became_peered":"2022-04-28T14:39:13.618911+0000","last_unstale":"2022-04-28T14:39:45.546840+0000","last_undegraded":"2022-04-28T14:39:45.546840+0000","last_fullsized":"2022-04-28T14:39:45.546840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2190,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571479+0000","last_change":"2022-04-28T14:39:13.964730+0000","last_active":"2022-04-28T14:39:27.571479+0000","last_peered":"2022-04-28T14:39:27.571479+0000","last_clean":"2022-04-28T14:39:27.571479+0000","last_became_active":"2022-04-28T14:39:13.964405+0000","last_became_peered":"2022-04-28T14:39:13.964405+0000","last_unstale":"2022-04-28T14:39:27.571479+0000","last_undegraded":"2022-04-28T14:39:27.571479+0000","last_fullsized":"2022-04-28T14:39:27.571479+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472078+0000","last_change":"2022-04-28T14:39:13.611678+0000","last_active":"2022-04-28T14:39:27.472078+0000","last_peered":"2022-04-28T14:39:27.472078+0000","last_clean":"2022-04-28T14:39:27.472078+0000","last_became_active":"2022-04-28T14:39:13.611166+0000","last_became_peered":"2022-04-28T14:39:13.611166+0000","last_unstale":"2022-04-28T14:39:27.472078+0000","last_undegraded":"2022-04-28T14:39:27.472078+0000","last_fullsized":"2022-04-28T14:39:27.472078+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471323+0000","last_change":"2022-04-28T14:39:13.960149+0000","last_active":"2022-04-28T14:39:27.471323+0000","last_peered":"2022-04-28T14:39:27.471323+0000","last_clean":"2022-04-28T14:39:27.471323+0000","last_became_active":"2022-04-28T14:39:13.959509+0000","last_became_peered":"2022-04-28T14:39:13.959509+0000","last_unstale":"2022-04-28T14:39:27.471323+0000","last_undegraded":"2022-04-28T14:39:27.471323+0000","last_fullsized":"2022-04-28T14:39:27.471323+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471488+0000","last_change":"2022-04-28T14:39:13.610970+0000","last_active":"2022-04-28T14:39:27.471488+0000","last_peered":"2022-04-28T14:39:27.471488+0000","last_clean":"2022-04-28T14:39:27.471488+0000","last_became_active":"2022-04-28T14:39:13.610661+0000","last_became_peered":"2022-04-28T14:39:13.610661+0000","last_unstale":"2022-04-28T14:39:27.471488+0000","last_undegraded":"2022-04-28T14:39:27.471488+0000","last_fullsized":"2022-04-28T14:39:27.471488+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612470+0000","last_change":"2022-04-28T14:39:13.963240+0000","last_active":"2022-04-28T14:39:26.612470+0000","last_peered":"2022-04-28T14:39:26.612470+0000","last_clean":"2022-04-28T14:39:26.612470+0000","last_became_active":"2022-04-28T14:39:13.961860+0000","last_became_peered":"2022-04-28T14:39:13.961860+0000","last_unstale":"2022-04-28T14:39:26.612470+0000","last_undegraded":"2022-04-28T14:39:26.612470+0000","last_fullsized":"2022-04-28T14:39:26.612470+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471032+0000","last_change":"2022-04-28T14:39:13.607628+0000","last_active":"2022-04-28T14:39:27.471032+0000","last_peered":"2022-04-28T14:39:27.471032+0000","last_clean":"2022-04-28T14:39:27.471032+0000","last_became_active":"2022-04-28T14:39:13.607234+0000","last_became_peered":"2022-04-28T14:39:13.607234+0000","last_unstale":"2022-04-28T14:39:27.471032+0000","last_undegraded":"2022-04-28T14:39:27.471032+0000","last_fullsized":"2022-04-28T14:39:27.471032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613294+0000","last_change":"2022-04-28T14:39:13.972780+0000","last_active":"2022-04-28T14:39:26.613294+0000","last_peered":"2022-04-28T14:39:26.613294+0000","last_clean":"2022-04-28T14:39:26.613294+0000","last_became_active":"2022-04-28T14:39:13.972189+0000","last_became_peered":"2022-04-28T14:39:13.972189+0000","last_unstale":"2022-04-28T14:39:26.613294+0000","last_undegraded":"2022-04-28T14:39:26.613294+0000","last_fullsized":"2022-04-28T14:39:26.613294+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"17'7","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:55.547282+0000","last_change":"2022-04-28T14:39:13.615060+0000","last_active":"2022-04-28T14:39:55.547282+0000","last_peered":"2022-04-28T14:39:55.547282+0000","last_clean":"2022-04-28T14:39:55.547282+0000","last_became_active":"2022-04-28T14:39:13.614686+0000","last_became_peered":"2022-04-28T14:39:13.614686+0000","last_unstale":"2022-04-28T14:39:55.547282+0000","last_undegraded":"2022-04-28T14:39:55.547282+0000","last_fullsized":"2022-04-28T14:39:55.547282+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571597+0000","last_change":"2022-04-28T14:39:13.963855+0000","last_active":"2022-04-28T14:39:27.571597+0000","last_peered":"2022-04-28T14:39:27.571597+0000","last_clean":"2022-04-28T14:39:27.571597+0000","last_became_active":"2022-04-28T14:39:13.963518+0000","last_became_peered":"2022-04-28T14:39:13.963518+0000","last_unstale":"2022-04-28T14:39:27.571597+0000","last_undegraded":"2022-04-28T14:39:27.571597+0000","last_fullsized":"2022-04-28T14:39:27.571597+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571370+0000","last_change":"2022-04-28T14:39:13.623926+0000","last_active":"2022-04-28T14:39:27.571370+0000","last_peered":"2022-04-28T14:39:27.571370+0000","last_clean":"2022-04-28T14:39:27.571370+0000","last_became_active":"2022-04-28T14:39:13.623608+0000","last_became_peered":"2022-04-28T14:39:13.623608+0000","last_unstale":"2022-04-28T14:39:27.571370+0000","last_undegraded":"2022-04-28T14:39:27.571370+0000","last_fullsized":"2022-04-28T14:39:27.571370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471959+0000","last_change":"2022-04-28T14:39:13.968270+0000","last_active":"2022-04-28T14:39:27.471959+0000","last_peered":"2022-04-28T14:39:27.471959+0000","last_clean":"2022-04-28T14:39:27.471959+0000","last_became_active":"2022-04-28T14:39:13.967894+0000","last_became_peered":"2022-04-28T14:39:13.967894+0000","last_unstale":"2022-04-28T14:39:27.471959+0000","last_undegraded":"2022-04-28T14:39:27.471959+0000","last_fullsized":"2022-04-28T14:39:27.471959+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"16'4","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613553+0000","last_change":"2022-04-28T14:39:13.613942+0000","last_active":"2022-04-28T14:39:26.613553+0000","last_peered":"2022-04-28T14:39:26.613553+0000","last_clean":"2022-04-28T14:39:26.613553+0000","last_became_active":"2022-04-28T14:39:13.613151+0000","last_became_peered":"2022-04-28T14:39:13.613151+0000","last_unstale":"2022-04-28T14:39:26.613553+0000","last_undegraded":"2022-04-28T14:39:26.613553+0000","last_fullsized":"2022-04-28T14:39:26.613553+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571448+0000","last_change":"2022-04-28T14:39:13.972010+0000","last_active":"2022-04-28T14:39:27.571448+0000","last_peered":"2022-04-28T14:39:27.571448+0000","last_clean":"2022-04-28T14:39:27.571448+0000","last_became_active":"2022-04-28T14:39:13.971680+0000","last_became_peered":"2022-04-28T14:39:13.971680+0000","last_unstale":"2022-04-28T14:39:27.571448+0000","last_undegraded":"2022-04-28T14:39:27.571448+0000","last_fullsized":"2022-04-28T14:39:27.571448+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"18'4","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-04-28T14:41:24.308238+0000","last_change":"2022-04-28T14:39:13.608578+0000","last_active":"2022-04-28T14:41:24.308238+0000","last_peered":"2022-04-28T14:41:24.308238+0000","last_clean":"2022-04-28T14:41:24.308238+0000","last_became_active":"2022-04-28T14:39:13.608208+0000","last_became_peered":"2022-04-28T14:39:13.608208+0000","last_unstale":"2022-04-28T14:41:24.308238+0000","last_undegraded":"2022-04-28T14:41:24.308238+0000","last_fullsized":"2022-04-28T14:41:24.308238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570627+0000","last_change":"2022-04-28T14:39:13.959741+0000","last_active":"2022-04-28T14:39:27.570627+0000","last_peered":"2022-04-28T14:39:27.570627+0000","last_clean":"2022-04-28T14:39:27.570627+0000","last_became_active":"2022-04-28T14:39:13.959445+0000","last_became_peered":"2022-04-28T14:39:13.959445+0000","last_unstale":"2022-04-28T14:39:27.570627+0000","last_undegraded":"2022-04-28T14:39:27.570627+0000","last_fullsized":"2022-04-28T14:39:27.570627+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571628+0000","last_change":"2022-04-28T14:39:13.615947+0000","last_active":"2022-04-28T14:39:27.571628+0000","last_peered":"2022-04-28T14:39:27.571628+0000","last_clean":"2022-04-28T14:39:27.571628+0000","last_became_active":"2022-04-28T14:39:13.615589+0000","last_became_peered":"2022-04-28T14:39:13.615589+0000","last_unstale":"2022-04-28T14:39:27.571628+0000","last_undegraded":"2022-04-28T14:39:27.571628+0000","last_fullsized":"2022-04-28T14:39:27.571628+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472066+0000","last_change":"2022-04-28T14:39:13.966950+0000","last_active":"2022-04-28T14:39:27.472066+0000","last_peered":"2022-04-28T14:39:27.472066+0000","last_clean":"2022-04-28T14:39:27.472066+0000","last_became_active":"2022-04-28T14:39:13.961621+0000","last_became_peered":"2022-04-28T14:39:13.961621+0000","last_unstale":"2022-04-28T14:39:27.472066+0000","last_undegraded":"2022-04-28T14:39:27.472066+0000","last_fullsized":"2022-04-28T14:39:27.472066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"16'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471758+0000","last_change":"2022-04-28T14:39:13.614233+0000","last_active":"2022-04-28T14:39:27.471758+0000","last_peered":"2022-04-28T14:39:27.471758+0000","last_clean":"2022-04-28T14:39:27.471758+0000","last_became_active":"2022-04-28T14:39:13.613890+0000","last_became_peered":"2022-04-28T14:39:13.613890+0000","last_unstale":"2022-04-28T14:39:27.471758+0000","last_undegraded":"2022-04-28T14:39:27.471758+0000","last_fullsized":"2022-04-28T14:39:27.471758+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612160+0000","last_change":"2022-04-28T14:39:13.953204+0000","last_active":"2022-04-28T14:39:26.612160+0000","last_peered":"2022-04-28T14:39:26.612160+0000","last_clean":"2022-04-28T14:39:26.612160+0000","last_became_active":"2022-04-28T14:39:13.952884+0000","last_became_peered":"2022-04-28T14:39:13.952884+0000","last_unstale":"2022-04-28T14:39:26.612160+0000","last_undegraded":"2022-04-28T14:39:26.612160+0000","last_fullsized":"2022-04-28T14:39:26.612160+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570672+0000","last_change":"2022-04-28T14:39:13.616607+0000","last_active":"2022-04-28T14:39:27.570672+0000","last_peered":"2022-04-28T14:39:27.570672+0000","last_clean":"2022-04-28T14:39:27.570672+0000","last_became_active":"2022-04-28T14:39:13.616264+0000","last_became_peered":"2022-04-28T14:39:13.616264+0000","last_unstale":"2022-04-28T14:39:27.570672+0000","last_undegraded":"2022-04-28T14:39:27.570672+0000","last_fullsized":"2022-04-28T14:39:27.570672+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471370+0000","last_change":"2022-04-28T14:39:13.958559+0000","last_active":"2022-04-28T14:39:27.471370+0000","last_peered":"2022-04-28T14:39:27.471370+0000","last_clean":"2022-04-28T14:39:27.471370+0000","last_became_active":"2022-04-28T14:39:13.958048+0000","last_became_peered":"2022-04-28T14:39:13.958048+0000","last_unstale":"2022-04-28T14:39:27.471370+0000","last_undegraded":"2022-04-28T14:39:27.471370+0000","last_fullsized":"2022-04-28T14:39:27.471370+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.611804+0000","last_change":"2022-04-28T14:39:13.599319+0000","last_active":"2022-04-28T14:39:26.611804+0000","last_peered":"2022-04-28T14:39:26.611804+0000","last_clean":"2022-04-28T14:39:26.611804+0000","last_became_active":"2022-04-28T14:39:13.598926+0000","last_became_peered":"2022-04-28T14:39:13.598926+0000","last_unstale":"2022-04-28T14:39:26.611804+0000","last_undegraded":"2022-04-28T14:39:26.611804+0000","last_fullsized":"2022-04-28T14:39:26.611804+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613237+0000","last_change":"2022-04-28T14:39:13.953566+0000","last_active":"2022-04-28T14:39:26.613237+0000","last_peered":"2022-04-28T14:39:26.613237+0000","last_clean":"2022-04-28T14:39:26.613237+0000","last_became_active":"2022-04-28T14:39:13.953248+0000","last_became_peered":"2022-04-28T14:39:13.953248+0000","last_unstale":"2022-04-28T14:39:26.613237+0000","last_undegraded":"2022-04-28T14:39:26.613237+0000","last_fullsized":"2022-04-28T14:39:26.613237+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571788+0000","last_change":"2022-04-28T14:39:13.621471+0000","last_active":"2022-04-28T14:39:27.571788+0000","last_peered":"2022-04-28T14:39:27.571788+0000","last_clean":"2022-04-28T14:39:27.571788+0000","last_became_active":"2022-04-28T14:39:13.621155+0000","last_became_peered":"2022-04-28T14:39:13.621155+0000","last_unstale":"2022-04-28T14:39:27.571788+0000","last_undegraded":"2022-04-28T14:39:27.571788+0000","last_fullsized":"2022-04-28T14:39:27.571788+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571693+0000","last_change":"2022-04-28T14:39:13.961895+0000","last_active":"2022-04-28T14:39:27.571693+0000","last_peered":"2022-04-28T14:39:27.571693+0000","last_clean":"2022-04-28T14:39:27.571693+0000","last_became_active":"2022-04-28T14:39:13.961160+0000","last_became_peered":"2022-04-28T14:39:13.961160+0000","last_unstale":"2022-04-28T14:39:27.571693+0000","last_undegraded":"2022-04-28T14:39:27.571693+0000","last_fullsized":"2022-04-28T14:39:27.571693+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613450+0000","last_change":"2022-04-28T14:39:13.608696+0000","last_active":"2022-04-28T14:39:26.613450+0000","last_peered":"2022-04-28T14:39:26.613450+0000","last_clean":"2022-04-28T14:39:26.613450+0000","last_became_active":"2022-04-28T14:39:13.608335+0000","last_became_peered":"2022-04-28T14:39:13.608335+0000","last_unstale":"2022-04-28T14:39:26.613450+0000","last_undegraded":"2022-04-28T14:39:26.613450+0000","last_fullsized":"2022-04-28T14:39:26.613450+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571286+0000","last_change":"2022-04-28T14:39:13.959179+0000","last_active":"2022-04-28T14:39:27.571286+0000","last_peered":"2022-04-28T14:39:27.571286+0000","last_clean":"2022-04-28T14:39:27.571286+0000","last_became_active":"2022-04-28T14:39:13.958838+0000","last_became_peered":"2022-04-28T14:39:13.958838+0000","last_unstale":"2022-04-28T14:39:27.571286+0000","last_undegraded":"2022-04-28T14:39:27.571286+0000","last_fullsized":"2022-04-28T14:39:27.571286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613402+0000","last_change":"2022-04-28T14:39:13.618291+0000","last_active":"2022-04-28T14:39:26.613402+0000","last_peered":"2022-04-28T14:39:26.613402+0000","last_clean":"2022-04-28T14:39:26.613402+0000","last_became_active":"2022-04-28T14:39:13.617912+0000","last_became_peered":"2022-04-28T14:39:13.617912+0000","last_unstale":"2022-04-28T14:39:26.613402+0000","last_undegraded":"2022-04-28T14:39:26.613402+0000","last_fullsized":"2022-04-28T14:39:26.613402+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472379+0000","last_change":"2022-04-28T14:39:13.966352+0000","last_active":"2022-04-28T14:39:27.472379+0000","last_peered":"2022-04-28T14:39:27.472379+0000","last_clean":"2022-04-28T14:39:27.472379+0000","last_became_active":"2022-04-28T14:39:13.966039+0000","last_became_peered":"2022-04-28T14:39:13.966039+0000","last_unstale":"2022-04-28T14:39:27.472379+0000","last_undegraded":"2022-04-28T14:39:27.472379+0000","last_fullsized":"2022-04-28T14:39:27.472379+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612474+0000","last_change":"2022-04-28T14:39:13.601416+0000","last_active":"2022-04-28T14:39:26.612474+0000","last_peered":"2022-04-28T14:39:26.612474+0000","last_clean":"2022-04-28T14:39:26.612474+0000","last_became_active":"2022-04-28T14:39:13.601028+0000","last_became_peered":"2022-04-28T14:39:13.601028+0000","last_unstale":"2022-04-28T14:39:26.612474+0000","last_undegraded":"2022-04-28T14:39:26.612474+0000","last_fullsized":"2022-04-28T14:39:26.612474+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471411+0000","last_change":"2022-04-28T14:39:13.958313+0000","last_active":"2022-04-28T14:39:27.471411+0000","last_peered":"2022-04-28T14:39:27.471411+0000","last_clean":"2022-04-28T14:39:27.471411+0000","last_became_active":"2022-04-28T14:39:13.956853+0000","last_became_peered":"2022-04-28T14:39:13.956853+0000","last_unstale":"2022-04-28T14:39:27.471411+0000","last_undegraded":"2022-04-28T14:39:27.471411+0000","last_fullsized":"2022-04-28T14:39:27.471411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471645+0000","last_change":"2022-04-28T14:39:13.613340+0000","last_active":"2022-04-28T14:39:27.471645+0000","last_peered":"2022-04-28T14:39:27.471645+0000","last_clean":"2022-04-28T14:39:27.471645+0000","last_became_active":"2022-04-28T14:39:13.612902+0000","last_became_peered":"2022-04-28T14:39:13.612902+0000","last_unstale":"2022-04-28T14:39:27.471645+0000","last_undegraded":"2022-04-28T14:39:27.471645+0000","last_fullsized":"2022-04-28T14:39:27.471645+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471776+0000","last_change":"2022-04-28T14:39:13.966772+0000","last_active":"2022-04-28T14:39:27.471776+0000","last_peered":"2022-04-28T14:39:27.471776+0000","last_clean":"2022-04-28T14:39:27.471776+0000","last_became_active":"2022-04-28T14:39:13.961393+0000","last_became_peered":"2022-04-28T14:39:13.961393+0000","last_unstale":"2022-04-28T14:39:27.471776+0000","last_undegraded":"2022-04-28T14:39:27.471776+0000","last_fullsized":"2022-04-28T14:39:27.471776+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612943+0000","last_change":"2022-04-28T14:39:13.619825+0000","last_active":"2022-04-28T14:39:26.612943+0000","last_peered":"2022-04-28T14:39:26.612943+0000","last_clean":"2022-04-28T14:39:26.612943+0000","last_became_active":"2022-04-28T14:39:13.619514+0000","last_became_peered":"2022-04-28T14:39:13.619514+0000","last_unstale":"2022-04-28T14:39:26.612943+0000","last_undegraded":"2022-04-28T14:39:26.612943+0000","last_fullsized":"2022-04-28T14:39:26.612943+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472086+0000","last_change":"2022-04-28T14:39:13.956243+0000","last_active":"2022-04-28T14:39:27.472086+0000","last_peered":"2022-04-28T14:39:27.472086+0000","last_clean":"2022-04-28T14:39:27.472086+0000","last_became_active":"2022-04-28T14:39:13.955924+0000","last_became_peered":"2022-04-28T14:39:13.955924+0000","last_unstale":"2022-04-28T14:39:27.472086+0000","last_undegraded":"2022-04-28T14:39:27.472086+0000","last_fullsized":"2022-04-28T14:39:27.472086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"16'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612191+0000","last_change":"2022-04-28T14:39:13.607250+0000","last_active":"2022-04-28T14:39:26.612191+0000","last_peered":"2022-04-28T14:39:26.612191+0000","last_clean":"2022-04-28T14:39:26.612191+0000","last_became_active":"2022-04-28T14:39:13.606892+0000","last_became_peered":"2022-04-28T14:39:13.606892+0000","last_unstale":"2022-04-28T14:39:26.612191+0000","last_undegraded":"2022-04-28T14:39:26.612191+0000","last_fullsized":"2022-04-28T14:39:26.612191+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471904+0000","last_change":"2022-04-28T14:39:13.958594+0000","last_active":"2022-04-28T14:39:27.471904+0000","last_peered":"2022-04-28T14:39:27.471904+0000","last_clean":"2022-04-28T14:39:27.471904+0000","last_became_active":"2022-04-28T14:39:13.958234+0000","last_became_peered":"2022-04-28T14:39:13.958234+0000","last_unstale":"2022-04-28T14:39:27.471904+0000","last_undegraded":"2022-04-28T14:39:27.471904+0000","last_fullsized":"2022-04-28T14:39:27.471904+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570712+0000","last_change":"2022-04-28T14:39:13.610919+0000","last_active":"2022-04-28T14:39:27.570712+0000","last_peered":"2022-04-28T14:39:27.570712+0000","last_clean":"2022-04-28T14:39:27.570712+0000","last_became_active":"2022-04-28T14:39:13.610535+0000","last_became_peered":"2022-04-28T14:39:13.610535+0000","last_unstale":"2022-04-28T14:39:27.570712+0000","last_undegraded":"2022-04-28T14:39:27.570712+0000","last_fullsized":"2022-04-28T14:39:27.570712+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2022-04-28T14:41:26.135911+0000","last_change":"2022-04-28T14:41:26.135911+0000","last_active":"2022-04-28T14:41:26.135911+0000","last_peered":"2022-04-28T14:41:26.135911+0000","last_clean":"2022-04-28T14:41:26.135911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2022-04-28T14:41:26.135911+0000","last_undegraded":"2022-04-28T14:41:26.135911+0000","last_fullsized":"2022-04-28T14:41:26.135911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:41:26.135911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:41:26.135911+0000","last_clean_scrub_stamp":"2022-04-28T14:41:26.135911+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472675+0000","last_change":"2022-04-28T14:39:13.968427+0000","last_active":"2022-04-28T14:39:27.472675+0000","last_peered":"2022-04-28T14:39:27.472675+0000","last_clean":"2022-04-28T14:39:27.472675+0000","last_became_active":"2022-04-28T14:39:13.968116+0000","last_became_peered":"2022-04-28T14:39:13.968116+0000","last_unstale":"2022-04-28T14:39:27.472675+0000","last_undegraded":"2022-04-28T14:39:27.472675+0000","last_fullsized":"2022-04-28T14:39:27.472675+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613017+0000","last_change":"2022-04-28T14:39:05.390479+0000","last_active":"2022-04-28T14:39:26.613017+0000","last_peered":"2022-04-28T14:39:26.613017+0000","last_clean":"2022-04-28T14:39:26.613017+0000","last_became_active":"2022-04-28T14:39:05.390111+0000","last_became_peered":"2022-04-28T14:39:05.390111+0000","last_unstale":"2022-04-28T14:39:26.613017+0000","last_undegraded":"2022-04-28T14:39:26.613017+0000","last_fullsized":"2022-04-28T14:39:26.613017+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613887+0000","last_change":"2022-04-28T14:39:13.610156+0000","last_active":"2022-04-28T14:39:26.613887+0000","last_peered":"2022-04-28T14:39:26.613887+0000","last_clean":"2022-04-28T14:39:26.613887+0000","last_became_active":"2022-04-28T14:39:13.609823+0000","last_became_peered":"2022-04-28T14:39:13.609823+0000","last_unstale":"2022-04-28T14:39:26.613887+0000","last_undegraded":"2022-04-28T14:39:26.613887+0000","last_fullsized":"2022-04-28T14:39:26.613887+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571286+0000","last_change":"2022-04-28T14:39:13.952310+0000","last_active":"2022-04-28T14:39:27.571286+0000","last_peered":"2022-04-28T14:39:27.571286+0000","last_clean":"2022-04-28T14:39:27.571286+0000","last_became_active":"2022-04-28T14:39:13.951984+0000","last_became_peered":"2022-04-28T14:39:13.951984+0000","last_unstale":"2022-04-28T14:39:27.571286+0000","last_undegraded":"2022-04-28T14:39:27.571286+0000","last_fullsized":"2022-04-28T14:39:27.571286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471981+0000","last_change":"2022-04-28T14:39:05.388548+0000","last_active":"2022-04-28T14:39:27.471981+0000","last_peered":"2022-04-28T14:39:27.471981+0000","last_clean":"2022-04-28T14:39:27.471981+0000","last_became_active":"2022-04-28T14:39:05.388215+0000","last_became_peered":"2022-04-28T14:39:05.388215+0000","last_unstale":"2022-04-28T14:39:27.471981+0000","last_undegraded":"2022-04-28T14:39:27.471981+0000","last_fullsized":"2022-04-28T14:39:27.471981+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472385+0000","last_change":"2022-04-28T14:39:13.627277+0000","last_active":"2022-04-28T14:39:27.472385+0000","last_peered":"2022-04-28T14:39:27.472385+0000","last_clean":"2022-04-28T14:39:27.472385+0000","last_became_active":"2022-04-28T14:39:13.626883+0000","last_became_peered":"2022-04-28T14:39:13.626883+0000","last_unstale":"2022-04-28T14:39:27.472385+0000","last_undegraded":"2022-04-28T14:39:27.472385+0000","last_fullsized":"2022-04-28T14:39:27.472385+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612915+0000","last_change":"2022-04-28T14:39:05.388784+0000","last_active":"2022-04-28T14:39:26.612915+0000","last_peered":"2022-04-28T14:39:26.612915+0000","last_clean":"2022-04-28T14:39:26.612915+0000","last_became_active":"2022-04-28T14:39:05.388043+0000","last_became_peered":"2022-04-28T14:39:05.388043+0000","last_unstale":"2022-04-28T14:39:26.612915+0000","last_undegraded":"2022-04-28T14:39:26.612915+0000","last_fullsized":"2022-04-28T14:39:26.612915+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471127+0000","last_change":"2022-04-28T14:39:13.622411+0000","last_active":"2022-04-28T14:39:27.471127+0000","last_peered":"2022-04-28T14:39:27.471127+0000","last_clean":"2022-04-28T14:39:27.471127+0000","last_became_active":"2022-04-28T14:39:13.621590+0000","last_became_peered":"2022-04-28T14:39:13.621590+0000","last_unstale":"2022-04-28T14:39:27.471127+0000","last_undegraded":"2022-04-28T14:39:27.471127+0000","last_fullsized":"2022-04-28T14:39:27.471127+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570674+0000","last_change":"2022-04-28T14:39:13.955187+0000","last_active":"2022-04-28T14:39:27.570674+0000","last_peered":"2022-04-28T14:39:27.570674+0000","last_clean":"2022-04-28T14:39:27.570674+0000","last_became_active":"2022-04-28T14:39:13.954831+0000","last_became_peered":"2022-04-28T14:39:13.954831+0000","last_unstale":"2022-04-28T14:39:27.570674+0000","last_undegraded":"2022-04-28T14:39:27.570674+0000","last_fullsized":"2022-04-28T14:39:27.570674+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570547+0000","last_change":"2022-04-28T14:39:05.390881+0000","last_active":"2022-04-28T14:39:27.570547+0000","last_peered":"2022-04-28T14:39:27.570547+0000","last_clean":"2022-04-28T14:39:27.570547+0000","last_became_active":"2022-04-28T14:39:05.390559+0000","last_became_peered":"2022-04-28T14:39:05.390559+0000","last_unstale":"2022-04-28T14:39:27.570547+0000","last_undegraded":"2022-04-28T14:39:27.570547+0000","last_fullsized":"2022-04-28T14:39:27.570547+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"16'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.611802+0000","last_change":"2022-04-28T14:39:13.608628+0000","last_active":"2022-04-28T14:39:26.611802+0000","last_peered":"2022-04-28T14:39:26.611802+0000","last_clean":"2022-04-28T14:39:26.611802+0000","last_became_active":"2022-04-28T14:39:13.608261+0000","last_became_peered":"2022-04-28T14:39:13.608261+0000","last_unstale":"2022-04-28T14:39:26.611802+0000","last_undegraded":"2022-04-28T14:39:26.611802+0000","last_fullsized":"2022-04-28T14:39:26.611802+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.611981+0000","last_change":"2022-04-28T14:39:13.944110+0000","last_active":"2022-04-28T14:39:26.611981+0000","last_peered":"2022-04-28T14:39:26.611981+0000","last_clean":"2022-04-28T14:39:26.611981+0000","last_became_active":"2022-04-28T14:39:13.943780+0000","last_became_peered":"2022-04-28T14:39:13.943780+0000","last_unstale":"2022-04-28T14:39:26.611981+0000","last_undegraded":"2022-04-28T14:39:26.611981+0000","last_fullsized":"2022-04-28T14:39:26.611981+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612264+0000","last_change":"2022-04-28T14:39:05.390962+0000","last_active":"2022-04-28T14:39:26.612264+0000","last_peered":"2022-04-28T14:39:26.612264+0000","last_clean":"2022-04-28T14:39:26.612264+0000","last_became_active":"2022-04-28T14:39:05.390602+0000","last_became_peered":"2022-04-28T14:39:05.390602+0000","last_unstale":"2022-04-28T14:39:26.612264+0000","last_undegraded":"2022-04-28T14:39:26.612264+0000","last_fullsized":"2022-04-28T14:39:26.612264+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:50.546230+0000","last_change":"2022-04-28T14:39:13.614524+0000","last_active":"2022-04-28T14:39:50.546230+0000","last_peered":"2022-04-28T14:39:50.546230+0000","last_clean":"2022-04-28T14:39:50.546230+0000","last_became_active":"2022-04-28T14:39:13.614177+0000","last_became_peered":"2022-04-28T14:39:13.614177+0000","last_unstale":"2022-04-28T14:39:50.546230+0000","last_undegraded":"2022-04-28T14:39:50.546230+0000","last_fullsized":"2022-04-28T14:39:50.546230+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471620+0000","last_change":"2022-04-28T14:39:13.960464+0000","last_active":"2022-04-28T14:39:27.471620+0000","last_peered":"2022-04-28T14:39:27.471620+0000","last_clean":"2022-04-28T14:39:27.471620+0000","last_became_active":"2022-04-28T14:39:13.958817+0000","last_became_peered":"2022-04-28T14:39:13.958817+0000","last_unstale":"2022-04-28T14:39:27.471620+0000","last_undegraded":"2022-04-28T14:39:27.471620+0000","last_fullsized":"2022-04-28T14:39:27.471620+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471425+0000","last_change":"2022-04-28T14:39:05.389329+0000","last_active":"2022-04-28T14:39:27.471425+0000","last_peered":"2022-04-28T14:39:27.471425+0000","last_clean":"2022-04-28T14:39:27.471425+0000","last_became_active":"2022-04-28T14:39:05.389030+0000","last_became_peered":"2022-04-28T14:39:05.389030+0000","last_unstale":"2022-04-28T14:39:27.471425+0000","last_undegraded":"2022-04-28T14:39:27.471425+0000","last_fullsized":"2022-04-28T14:39:27.471425+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471900+0000","last_change":"2022-04-28T14:39:13.624225+0000","last_active":"2022-04-28T14:39:27.471900+0000","last_peered":"2022-04-28T14:39:27.471900+0000","last_clean":"2022-04-28T14:39:27.471900+0000","last_became_active":"2022-04-28T14:39:13.623631+0000","last_became_peered":"2022-04-28T14:39:13.623631+0000","last_unstale":"2022-04-28T14:39:27.471900+0000","last_undegraded":"2022-04-28T14:39:27.471900+0000","last_fullsized":"2022-04-28T14:39:27.471900+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571628+0000","last_change":"2022-04-28T14:39:13.951379+0000","last_active":"2022-04-28T14:39:27.571628+0000","last_peered":"2022-04-28T14:39:27.571628+0000","last_clean":"2022-04-28T14:39:27.571628+0000","last_became_active":"2022-04-28T14:39:13.950657+0000","last_became_peered":"2022-04-28T14:39:13.950657+0000","last_unstale":"2022-04-28T14:39:27.571628+0000","last_undegraded":"2022-04-28T14:39:27.571628+0000","last_fullsized":"2022-04-28T14:39:27.571628+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472646+0000","last_change":"2022-04-28T14:39:05.388553+0000","last_active":"2022-04-28T14:39:27.472646+0000","last_peered":"2022-04-28T14:39:27.472646+0000","last_clean":"2022-04-28T14:39:27.472646+0000","last_became_active":"2022-04-28T14:39:05.388170+0000","last_became_peered":"2022-04-28T14:39:05.388170+0000","last_unstale":"2022-04-28T14:39:27.472646+0000","last_undegraded":"2022-04-28T14:39:27.472646+0000","last_fullsized":"2022-04-28T14:39:27.472646+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472410+0000","last_change":"2022-04-28T14:39:13.627446+0000","last_active":"2022-04-28T14:39:27.472410+0000","last_peered":"2022-04-28T14:39:27.472410+0000","last_clean":"2022-04-28T14:39:27.472410+0000","last_became_active":"2022-04-28T14:39:13.627067+0000","last_became_peered":"2022-04-28T14:39:13.627067+0000","last_unstale":"2022-04-28T14:39:27.472410+0000","last_undegraded":"2022-04-28T14:39:27.472410+0000","last_fullsized":"2022-04-28T14:39:27.472410+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613478+0000","last_change":"2022-04-28T14:39:13.951391+0000","last_active":"2022-04-28T14:39:26.613478+0000","last_peered":"2022-04-28T14:39:26.613478+0000","last_clean":"2022-04-28T14:39:26.613478+0000","last_became_active":"2022-04-28T14:39:13.951063+0000","last_became_peered":"2022-04-28T14:39:13.951063+0000","last_unstale":"2022-04-28T14:39:26.613478+0000","last_undegraded":"2022-04-28T14:39:26.613478+0000","last_fullsized":"2022-04-28T14:39:26.613478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.614095+0000","last_change":"2022-04-28T14:39:05.388412+0000","last_active":"2022-04-28T14:39:26.614095+0000","last_peered":"2022-04-28T14:39:26.614095+0000","last_clean":"2022-04-28T14:39:26.614095+0000","last_became_active":"2022-04-28T14:39:05.388067+0000","last_became_peered":"2022-04-28T14:39:05.388067+0000","last_unstale":"2022-04-28T14:39:26.614095+0000","last_undegraded":"2022-04-28T14:39:26.614095+0000","last_fullsized":"2022-04-28T14:39:26.614095+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613253+0000","last_change":"2022-04-28T14:39:13.609546+0000","last_active":"2022-04-28T14:39:26.613253+0000","last_peered":"2022-04-28T14:39:26.613253+0000","last_clean":"2022-04-28T14:39:26.613253+0000","last_became_active":"2022-04-28T14:39:13.609231+0000","last_became_peered":"2022-04-28T14:39:13.609231+0000","last_unstale":"2022-04-28T14:39:26.613253+0000","last_undegraded":"2022-04-28T14:39:26.613253+0000","last_fullsized":"2022-04-28T14:39:26.613253+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612888+0000","last_change":"2022-04-28T14:39:13.971977+0000","last_active":"2022-04-28T14:39:26.612888+0000","last_peered":"2022-04-28T14:39:26.612888+0000","last_clean":"2022-04-28T14:39:26.612888+0000","last_became_active":"2022-04-28T14:39:13.971343+0000","last_became_peered":"2022-04-28T14:39:13.971343+0000","last_unstale":"2022-04-28T14:39:26.612888+0000","last_undegraded":"2022-04-28T14:39:26.612888+0000","last_fullsized":"2022-04-28T14:39:26.612888+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472466+0000","last_change":"2022-04-28T14:39:13.970909+0000","last_active":"2022-04-28T14:39:27.472466+0000","last_peered":"2022-04-28T14:39:27.472466+0000","last_clean":"2022-04-28T14:39:27.472466+0000","last_became_active":"2022-04-28T14:39:13.970599+0000","last_became_peered":"2022-04-28T14:39:13.970599+0000","last_unstale":"2022-04-28T14:39:27.472466+0000","last_undegraded":"2022-04-28T14:39:27.472466+0000","last_fullsized":"2022-04-28T14:39:27.472466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571554+0000","last_change":"2022-04-28T14:39:13.622383+0000","last_active":"2022-04-28T14:39:27.571554+0000","last_peered":"2022-04-28T14:39:27.571554+0000","last_clean":"2022-04-28T14:39:27.571554+0000","last_became_active":"2022-04-28T14:39:13.620810+0000","last_became_peered":"2022-04-28T14:39:13.620810+0000","last_unstale":"2022-04-28T14:39:27.571554+0000","last_undegraded":"2022-04-28T14:39:27.571554+0000","last_fullsized":"2022-04-28T14:39:27.571554+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613227+0000","last_change":"2022-04-28T14:39:13.951426+0000","last_active":"2022-04-28T14:39:26.613227+0000","last_peered":"2022-04-28T14:39:26.613227+0000","last_clean":"2022-04-28T14:39:26.613227+0000","last_became_active":"2022-04-28T14:39:13.951111+0000","last_became_peered":"2022-04-28T14:39:13.951111+0000","last_unstale":"2022-04-28T14:39:26.613227+0000","last_undegraded":"2022-04-28T14:39:26.613227+0000","last_fullsized":"2022-04-28T14:39:26.613227+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571179+0000","last_change":"2022-04-28T14:39:13.622151+0000","last_active":"2022-04-28T14:39:27.571179+0000","last_peered":"2022-04-28T14:39:27.571179+0000","last_clean":"2022-04-28T14:39:27.571179+0000","last_became_active":"2022-04-28T14:39:13.621812+0000","last_became_peered":"2022-04-28T14:39:13.621812+0000","last_unstale":"2022-04-28T14:39:27.571179+0000","last_undegraded":"2022-04-28T14:39:27.571179+0000","last_fullsized":"2022-04-28T14:39:27.571179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571901+0000","last_change":"2022-04-28T14:39:13.961409+0000","last_active":"2022-04-28T14:39:27.571901+0000","last_peered":"2022-04-28T14:39:27.571901+0000","last_clean":"2022-04-28T14:39:27.571901+0000","last_became_active":"2022-04-28T14:39:13.961034+0000","last_became_peered":"2022-04-28T14:39:13.961034+0000","last_unstale":"2022-04-28T14:39:27.571901+0000","last_undegraded":"2022-04-28T14:39:27.571901+0000","last_fullsized":"2022-04-28T14:39:27.571901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472607+0000","last_change":"2022-04-28T14:39:13.627961+0000","last_active":"2022-04-28T14:39:27.472607+0000","last_peered":"2022-04-28T14:39:27.472607+0000","last_clean":"2022-04-28T14:39:27.472607+0000","last_became_active":"2022-04-28T14:39:13.627595+0000","last_became_peered":"2022-04-28T14:39:13.627595+0000","last_unstale":"2022-04-28T14:39:27.472607+0000","last_undegraded":"2022-04-28T14:39:27.472607+0000","last_fullsized":"2022-04-28T14:39:27.472607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472713+0000","last_change":"2022-04-28T14:39:13.973251+0000","last_active":"2022-04-28T14:39:27.472713+0000","last_peered":"2022-04-28T14:39:27.472713+0000","last_clean":"2022-04-28T14:39:27.472713+0000","last_became_active":"2022-04-28T14:39:13.973008+0000","last_became_peered":"2022-04-28T14:39:13.973008+0000","last_unstale":"2022-04-28T14:39:27.472713+0000","last_undegraded":"2022-04-28T14:39:27.472713+0000","last_fullsized":"2022-04-28T14:39:27.472713+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571685+0000","last_change":"2022-04-28T14:39:13.619997+0000","last_active":"2022-04-28T14:39:27.571685+0000","last_peered":"2022-04-28T14:39:27.571685+0000","last_clean":"2022-04-28T14:39:27.571685+0000","last_became_active":"2022-04-28T14:39:13.619739+0000","last_became_peered":"2022-04-28T14:39:13.619739+0000","last_unstale":"2022-04-28T14:39:27.571685+0000","last_undegraded":"2022-04-28T14:39:27.571685+0000","last_fullsized":"2022-04-28T14:39:27.571685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.611914+0000","last_change":"2022-04-28T14:39:13.944278+0000","last_active":"2022-04-28T14:39:26.611914+0000","last_peered":"2022-04-28T14:39:26.611914+0000","last_clean":"2022-04-28T14:39:26.611914+0000","last_became_active":"2022-04-28T14:39:13.943973+0000","last_became_peered":"2022-04-28T14:39:13.943973+0000","last_unstale":"2022-04-28T14:39:26.611914+0000","last_undegraded":"2022-04-28T14:39:26.611914+0000","last_fullsized":"2022-04-28T14:39:26.611914+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471295+0000","last_change":"2022-04-28T14:39:13.622598+0000","last_active":"2022-04-28T14:39:27.471295+0000","last_peered":"2022-04-28T14:39:27.471295+0000","last_clean":"2022-04-28T14:39:27.471295+0000","last_became_active":"2022-04-28T14:39:13.622080+0000","last_became_peered":"2022-04-28T14:39:13.622080+0000","last_unstale":"2022-04-28T14:39:27.471295+0000","last_undegraded":"2022-04-28T14:39:27.471295+0000","last_fullsized":"2022-04-28T14:39:27.471295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612009+0000","last_change":"2022-04-28T14:39:13.952416+0000","last_active":"2022-04-28T14:39:26.612009+0000","last_peered":"2022-04-28T14:39:26.612009+0000","last_clean":"2022-04-28T14:39:26.612009+0000","last_became_active":"2022-04-28T14:39:13.952100+0000","last_became_peered":"2022-04-28T14:39:13.952100+0000","last_unstale":"2022-04-28T14:39:26.612009+0000","last_undegraded":"2022-04-28T14:39:26.612009+0000","last_fullsized":"2022-04-28T14:39:26.612009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612015+0000","last_change":"2022-04-28T14:39:13.602486+0000","last_active":"2022-04-28T14:39:26.612015+0000","last_peered":"2022-04-28T14:39:26.612015+0000","last_clean":"2022-04-28T14:39:26.612015+0000","last_became_active":"2022-04-28T14:39:13.602105+0000","last_became_peered":"2022-04-28T14:39:13.602105+0000","last_unstale":"2022-04-28T14:39:26.612015+0000","last_undegraded":"2022-04-28T14:39:26.612015+0000","last_fullsized":"2022-04-28T14:39:26.612015+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571440+0000","last_change":"2022-04-28T14:39:13.964624+0000","last_active":"2022-04-28T14:39:27.571440+0000","last_peered":"2022-04-28T14:39:27.571440+0000","last_clean":"2022-04-28T14:39:27.571440+0000","last_became_active":"2022-04-28T14:39:13.964305+0000","last_became_peered":"2022-04-28T14:39:13.964305+0000","last_unstale":"2022-04-28T14:39:27.571440+0000","last_undegraded":"2022-04-28T14:39:27.571440+0000","last_fullsized":"2022-04-28T14:39:27.571440+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472092+0000","last_change":"2022-04-28T14:39:13.624420+0000","last_active":"2022-04-28T14:39:27.472092+0000","last_peered":"2022-04-28T14:39:27.472092+0000","last_clean":"2022-04-28T14:39:27.472092+0000","last_became_active":"2022-04-28T14:39:13.623884+0000","last_became_peered":"2022-04-28T14:39:13.623884+0000","last_unstale":"2022-04-28T14:39:27.472092+0000","last_undegraded":"2022-04-28T14:39:27.472092+0000","last_fullsized":"2022-04-28T14:39:27.472092+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471665+0000","last_change":"2022-04-28T14:39:13.960655+0000","last_active":"2022-04-28T14:39:27.471665+0000","last_peered":"2022-04-28T14:39:27.471665+0000","last_clean":"2022-04-28T14:39:27.471665+0000","last_became_active":"2022-04-28T14:39:13.960060+0000","last_became_peered":"2022-04-28T14:39:13.960060+0000","last_unstale":"2022-04-28T14:39:27.471665+0000","last_undegraded":"2022-04-28T14:39:27.471665+0000","last_fullsized":"2022-04-28T14:39:27.471665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472222+0000","last_change":"2022-04-28T14:39:13.624344+0000","last_active":"2022-04-28T14:39:27.472222+0000","last_peered":"2022-04-28T14:39:27.472222+0000","last_clean":"2022-04-28T14:39:27.472222+0000","last_became_active":"2022-04-28T14:39:13.623843+0000","last_became_peered":"2022-04-28T14:39:13.623843+0000","last_unstale":"2022-04-28T14:39:27.472222+0000","last_undegraded":"2022-04-28T14:39:27.472222+0000","last_fullsized":"2022-04-28T14:39:27.472222+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613691+0000","last_change":"2022-04-28T14:39:13.969259+0000","last_active":"2022-04-28T14:39:26.613691+0000","last_peered":"2022-04-28T14:39:26.613691+0000","last_clean":"2022-04-28T14:39:26.613691+0000","last_became_active":"2022-04-28T14:39:13.968448+0000","last_became_peered":"2022-04-28T14:39:13.968448+0000","last_unstale":"2022-04-28T14:39:26.613691+0000","last_undegraded":"2022-04-28T14:39:26.613691+0000","last_fullsized":"2022-04-28T14:39:26.613691+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613353+0000","last_change":"2022-04-28T14:39:13.609457+0000","last_active":"2022-04-28T14:39:26.613353+0000","last_peered":"2022-04-28T14:39:26.613353+0000","last_clean":"2022-04-28T14:39:26.613353+0000","last_became_active":"2022-04-28T14:39:13.609114+0000","last_became_peered":"2022-04-28T14:39:13.609114+0000","last_unstale":"2022-04-28T14:39:26.613353+0000","last_undegraded":"2022-04-28T14:39:26.613353+0000","last_fullsized":"2022-04-28T14:39:26.613353+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472105+0000","last_change":"2022-04-28T14:39:13.960837+0000","last_active":"2022-04-28T14:39:27.472105+0000","last_peered":"2022-04-28T14:39:27.472105+0000","last_clean":"2022-04-28T14:39:27.472105+0000","last_became_active":"2022-04-28T14:39:13.960511+0000","last_became_peered":"2022-04-28T14:39:13.960511+0000","last_unstale":"2022-04-28T14:39:27.472105+0000","last_undegraded":"2022-04-28T14:39:27.472105+0000","last_fullsized":"2022-04-28T14:39:27.472105+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"16'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613128+0000","last_change":"2022-04-28T14:39:13.600840+0000","last_active":"2022-04-28T14:39:26.613128+0000","last_peered":"2022-04-28T14:39:26.613128+0000","last_clean":"2022-04-28T14:39:26.613128+0000","last_became_active":"2022-04-28T14:39:13.600508+0000","last_became_peered":"2022-04-28T14:39:13.600508+0000","last_unstale":"2022-04-28T14:39:26.613128+0000","last_undegraded":"2022-04-28T14:39:26.613128+0000","last_fullsized":"2022-04-28T14:39:26.613128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472329+0000","last_change":"2022-04-28T14:39:13.968364+0000","last_active":"2022-04-28T14:39:27.472329+0000","last_peered":"2022-04-28T14:39:27.472329+0000","last_clean":"2022-04-28T14:39:27.472329+0000","last_became_active":"2022-04-28T14:39:13.968054+0000","last_became_peered":"2022-04-28T14:39:13.968054+0000","last_unstale":"2022-04-28T14:39:27.472329+0000","last_undegraded":"2022-04-28T14:39:27.472329+0000","last_fullsized":"2022-04-28T14:39:27.472329+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"17'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:40.550820+0000","last_change":"2022-04-28T14:39:13.623080+0000","last_active":"2022-04-28T14:39:40.550820+0000","last_peered":"2022-04-28T14:39:40.550820+0000","last_clean":"2022-04-28T14:39:40.550820+0000","last_became_active":"2022-04-28T14:39:13.622568+0000","last_became_peered":"2022-04-28T14:39:13.622568+0000","last_unstale":"2022-04-28T14:39:40.550820+0000","last_undegraded":"2022-04-28T14:39:40.550820+0000","last_fullsized":"2022-04-28T14:39:40.550820+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613319+0000","last_change":"2022-04-28T14:39:13.972567+0000","last_active":"2022-04-28T14:39:26.613319+0000","last_peered":"2022-04-28T14:39:26.613319+0000","last_clean":"2022-04-28T14:39:26.613319+0000","last_became_active":"2022-04-28T14:39:13.972179+0000","last_became_peered":"2022-04-28T14:39:13.972179+0000","last_unstale":"2022-04-28T14:39:26.613319+0000","last_undegraded":"2022-04-28T14:39:26.613319+0000","last_fullsized":"2022-04-28T14:39:26.613319+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"16'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472542+0000","last_change":"2022-04-28T14:39:13.622222+0000","last_active":"2022-04-28T14:39:27.472542+0000","last_peered":"2022-04-28T14:39:27.472542+0000","last_clean":"2022-04-28T14:39:27.472542+0000","last_became_active":"2022-04-28T14:39:13.621872+0000","last_became_peered":"2022-04-28T14:39:13.621872+0000","last_unstale":"2022-04-28T14:39:27.472542+0000","last_undegraded":"2022-04-28T14:39:27.472542+0000","last_fullsized":"2022-04-28T14:39:27.472542+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471304+0000","last_change":"2022-04-28T14:39:13.958395+0000","last_active":"2022-04-28T14:39:27.471304+0000","last_peered":"2022-04-28T14:39:27.471304+0000","last_clean":"2022-04-28T14:39:27.471304+0000","last_became_active":"2022-04-28T14:39:13.957976+0000","last_became_peered":"2022-04-28T14:39:13.957976+0000","last_unstale":"2022-04-28T14:39:27.471304+0000","last_undegraded":"2022-04-28T14:39:27.471304+0000","last_fullsized":"2022-04-28T14:39:27.471304+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"16'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471453+0000","last_change":"2022-04-28T14:39:13.622467+0000","last_active":"2022-04-28T14:39:27.471453+0000","last_peered":"2022-04-28T14:39:27.471453+0000","last_clean":"2022-04-28T14:39:27.471453+0000","last_became_active":"2022-04-28T14:39:13.621838+0000","last_became_peered":"2022-04-28T14:39:13.621838+0000","last_unstale":"2022-04-28T14:39:27.471453+0000","last_undegraded":"2022-04-28T14:39:27.471453+0000","last_fullsized":"2022-04-28T14:39:27.471453+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471018+0000","last_change":"2022-04-28T14:39:13.958646+0000","last_active":"2022-04-28T14:39:27.471018+0000","last_peered":"2022-04-28T14:39:27.471018+0000","last_clean":"2022-04-28T14:39:27.471018+0000","last_became_active":"2022-04-28T14:39:13.957994+0000","last_became_peered":"2022-04-28T14:39:13.957994+0000","last_unstale":"2022-04-28T14:39:27.471018+0000","last_undegraded":"2022-04-28T14:39:27.471018+0000","last_fullsized":"2022-04-28T14:39:27.471018+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612374+0000","last_change":"2022-04-28T14:39:13.614008+0000","last_active":"2022-04-28T14:39:26.612374+0000","last_peered":"2022-04-28T14:39:26.612374+0000","last_clean":"2022-04-28T14:39:26.612374+0000","last_became_active":"2022-04-28T14:39:13.613702+0000","last_became_peered":"2022-04-28T14:39:13.613702+0000","last_unstale":"2022-04-28T14:39:26.612374+0000","last_undegraded":"2022-04-28T14:39:26.612374+0000","last_fullsized":"2022-04-28T14:39:26.612374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571072+0000","last_change":"2022-04-28T14:39:13.950979+0000","last_active":"2022-04-28T14:39:27.571072+0000","last_peered":"2022-04-28T14:39:27.571072+0000","last_clean":"2022-04-28T14:39:27.571072+0000","last_became_active":"2022-04-28T14:39:13.950168+0000","last_became_peered":"2022-04-28T14:39:13.950168+0000","last_unstale":"2022-04-28T14:39:27.571072+0000","last_undegraded":"2022-04-28T14:39:27.571072+0000","last_fullsized":"2022-04-28T14:39:27.571072+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"17'4","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:45.546484+0000","last_change":"2022-04-28T14:39:13.617031+0000","last_active":"2022-04-28T14:39:45.546484+0000","last_peered":"2022-04-28T14:39:45.546484+0000","last_clean":"2022-04-28T14:39:45.546484+0000","last_became_active":"2022-04-28T14:39:13.615420+0000","last_became_peered":"2022-04-28T14:39:13.615420+0000","last_unstale":"2022-04-28T14:39:45.546484+0000","last_undegraded":"2022-04-28T14:39:45.546484+0000","last_fullsized":"2022-04-28T14:39:45.546484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612834+0000","last_change":"2022-04-28T14:39:13.954485+0000","last_active":"2022-04-28T14:39:26.612834+0000","last_peered":"2022-04-28T14:39:26.612834+0000","last_clean":"2022-04-28T14:39:26.612834+0000","last_became_active":"2022-04-28T14:39:13.954179+0000","last_became_peered":"2022-04-28T14:39:13.954179+0000","last_unstale":"2022-04-28T14:39:26.612834+0000","last_undegraded":"2022-04-28T14:39:26.612834+0000","last_fullsized":"2022-04-28T14:39:26.612834+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"16'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612359+0000","last_change":"2022-04-28T14:39:13.608868+0000","last_active":"2022-04-28T14:39:26.612359+0000","last_peered":"2022-04-28T14:39:26.612359+0000","last_clean":"2022-04-28T14:39:26.612359+0000","last_became_active":"2022-04-28T14:39:13.608590+0000","last_became_peered":"2022-04-28T14:39:13.608590+0000","last_unstale":"2022-04-28T14:39:26.612359+0000","last_undegraded":"2022-04-28T14:39:26.612359+0000","last_fullsized":"2022-04-28T14:39:26.612359+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472296+0000","last_change":"2022-04-28T14:39:13.966189+0000","last_active":"2022-04-28T14:39:27.472296+0000","last_peered":"2022-04-28T14:39:27.472296+0000","last_clean":"2022-04-28T14:39:27.472296+0000","last_became_active":"2022-04-28T14:39:13.965877+0000","last_became_peered":"2022-04-28T14:39:13.965877+0000","last_unstale":"2022-04-28T14:39:27.472296+0000","last_undegraded":"2022-04-28T14:39:27.472296+0000","last_fullsized":"2022-04-28T14:39:27.472296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612075+0000","last_change":"2022-04-28T14:39:13.601488+0000","last_active":"2022-04-28T14:39:26.612075+0000","last_peered":"2022-04-28T14:39:26.612075+0000","last_clean":"2022-04-28T14:39:26.612075+0000","last_became_active":"2022-04-28T14:39:13.601122+0000","last_became_peered":"2022-04-28T14:39:13.601122+0000","last_unstale":"2022-04-28T14:39:26.612075+0000","last_undegraded":"2022-04-28T14:39:26.612075+0000","last_fullsized":"2022-04-28T14:39:26.612075+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571425+0000","last_change":"2022-04-28T14:39:13.951897+0000","last_active":"2022-04-28T14:39:27.571425+0000","last_peered":"2022-04-28T14:39:27.571425+0000","last_clean":"2022-04-28T14:39:27.571425+0000","last_became_active":"2022-04-28T14:39:13.951314+0000","last_became_peered":"2022-04-28T14:39:13.951314+0000","last_unstale":"2022-04-28T14:39:27.571425+0000","last_undegraded":"2022-04-28T14:39:27.571425+0000","last_fullsized":"2022-04-28T14:39:27.571425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472538+0000","last_change":"2022-04-28T14:39:13.615041+0000","last_active":"2022-04-28T14:39:27.472538+0000","last_peered":"2022-04-28T14:39:27.472538+0000","last_clean":"2022-04-28T14:39:27.472538+0000","last_became_active":"2022-04-28T14:39:13.614710+0000","last_became_peered":"2022-04-28T14:39:13.614710+0000","last_unstale":"2022-04-28T14:39:27.472538+0000","last_undegraded":"2022-04-28T14:39:27.472538+0000","last_fullsized":"2022-04-28T14:39:27.472538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472245+0000","last_change":"2022-04-28T14:39:13.971986+0000","last_active":"2022-04-28T14:39:27.472245+0000","last_peered":"2022-04-28T14:39:27.472245+0000","last_clean":"2022-04-28T14:39:27.472245+0000","last_became_active":"2022-04-28T14:39:13.971243+0000","last_became_peered":"2022-04-28T14:39:13.971243+0000","last_unstale":"2022-04-28T14:39:27.472245+0000","last_undegraded":"2022-04-28T14:39:27.472245+0000","last_fullsized":"2022-04-28T14:39:27.472245+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613895+0000","last_change":"2022-04-28T14:39:13.613362+0000","last_active":"2022-04-28T14:39:26.613895+0000","last_peered":"2022-04-28T14:39:26.613895+0000","last_clean":"2022-04-28T14:39:26.613895+0000","last_became_active":"2022-04-28T14:39:13.612969+0000","last_became_peered":"2022-04-28T14:39:13.612969+0000","last_unstale":"2022-04-28T14:39:26.613895+0000","last_undegraded":"2022-04-28T14:39:26.613895+0000","last_fullsized":"2022-04-28T14:39:26.613895+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613381+0000","last_change":"2022-04-28T14:39:13.972552+0000","last_active":"2022-04-28T14:39:26.613381+0000","last_peered":"2022-04-28T14:39:26.613381+0000","last_clean":"2022-04-28T14:39:26.613381+0000","last_became_active":"2022-04-28T14:39:13.970887+0000","last_became_peered":"2022-04-28T14:39:13.970887+0000","last_unstale":"2022-04-28T14:39:26.613381+0000","last_undegraded":"2022-04-28T14:39:26.613381+0000","last_fullsized":"2022-04-28T14:39:26.613381+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472602+0000","last_change":"2022-04-28T14:39:13.628138+0000","last_active":"2022-04-28T14:39:27.472602+0000","last_peered":"2022-04-28T14:39:27.472602+0000","last_clean":"2022-04-28T14:39:27.472602+0000","last_became_active":"2022-04-28T14:39:13.627785+0000","last_became_peered":"2022-04-28T14:39:13.627785+0000","last_unstale":"2022-04-28T14:39:27.472602+0000","last_undegraded":"2022-04-28T14:39:27.472602+0000","last_fullsized":"2022-04-28T14:39:27.472602+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612073+0000","last_change":"2022-04-28T14:39:13.955799+0000","last_active":"2022-04-28T14:39:26.612073+0000","last_peered":"2022-04-28T14:39:26.612073+0000","last_clean":"2022-04-28T14:39:26.612073+0000","last_became_active":"2022-04-28T14:39:13.955495+0000","last_became_peered":"2022-04-28T14:39:13.955495+0000","last_unstale":"2022-04-28T14:39:26.612073+0000","last_undegraded":"2022-04-28T14:39:26.612073+0000","last_fullsized":"2022-04-28T14:39:26.612073+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"16'6","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570489+0000","last_change":"2022-04-28T14:39:13.621432+0000","last_active":"2022-04-28T14:39:27.570489+0000","last_peered":"2022-04-28T14:39:27.570489+0000","last_clean":"2022-04-28T14:39:27.570489+0000","last_became_active":"2022-04-28T14:39:13.621080+0000","last_became_peered":"2022-04-28T14:39:13.621080+0000","last_unstale":"2022-04-28T14:39:27.570489+0000","last_undegraded":"2022-04-28T14:39:27.570489+0000","last_fullsized":"2022-04-28T14:39:27.570489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471173+0000","last_change":"2022-04-28T14:39:13.956112+0000","last_active":"2022-04-28T14:39:27.471173+0000","last_peered":"2022-04-28T14:39:27.471173+0000","last_clean":"2022-04-28T14:39:27.471173+0000","last_became_active":"2022-04-28T14:39:13.955792+0000","last_became_peered":"2022-04-28T14:39:13.955792+0000","last_unstale":"2022-04-28T14:39:27.471173+0000","last_undegraded":"2022-04-28T14:39:27.471173+0000","last_fullsized":"2022-04-28T14:39:27.471173+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570897+0000","last_change":"2022-04-28T14:39:13.622128+0000","last_active":"2022-04-28T14:39:27.570897+0000","last_peered":"2022-04-28T14:39:27.570897+0000","last_clean":"2022-04-28T14:39:27.570897+0000","last_became_active":"2022-04-28T14:39:13.621790+0000","last_became_peered":"2022-04-28T14:39:13.621790+0000","last_unstale":"2022-04-28T14:39:27.570897+0000","last_undegraded":"2022-04-28T14:39:27.570897+0000","last_fullsized":"2022-04-28T14:39:27.570897+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471600+0000","last_change":"2022-04-28T14:39:13.967323+0000","last_active":"2022-04-28T14:39:27.471600+0000","last_peered":"2022-04-28T14:39:27.471600+0000","last_clean":"2022-04-28T14:39:27.471600+0000","last_became_active":"2022-04-28T14:39:13.961173+0000","last_became_peered":"2022-04-28T14:39:13.961173+0000","last_unstale":"2022-04-28T14:39:27.471600+0000","last_undegraded":"2022-04-28T14:39:27.471600+0000","last_fullsized":"2022-04-28T14:39:27.471600+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612260+0000","last_change":"2022-04-28T14:39:13.609625+0000","last_active":"2022-04-28T14:39:26.612260+0000","last_peered":"2022-04-28T14:39:26.612260+0000","last_clean":"2022-04-28T14:39:26.612260+0000","last_became_active":"2022-04-28T14:39:13.609062+0000","last_became_peered":"2022-04-28T14:39:13.609062+0000","last_unstale":"2022-04-28T14:39:26.612260+0000","last_undegraded":"2022-04-28T14:39:26.612260+0000","last_fullsized":"2022-04-28T14:39:26.612260+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571045+0000","last_change":"2022-04-28T14:39:13.963123+0000","last_active":"2022-04-28T14:39:27.571045+0000","last_peered":"2022-04-28T14:39:27.571045+0000","last_clean":"2022-04-28T14:39:27.571045+0000","last_became_active":"2022-04-28T14:39:13.962825+0000","last_became_peered":"2022-04-28T14:39:13.962825+0000","last_unstale":"2022-04-28T14:39:27.571045+0000","last_undegraded":"2022-04-28T14:39:27.571045+0000","last_fullsized":"2022-04-28T14:39:27.571045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613087+0000","last_change":"2022-04-28T14:39:13.603083+0000","last_active":"2022-04-28T14:39:26.613087+0000","last_peered":"2022-04-28T14:39:26.613087+0000","last_clean":"2022-04-28T14:39:26.613087+0000","last_became_active":"2022-04-28T14:39:13.602776+0000","last_became_peered":"2022-04-28T14:39:13.602776+0000","last_unstale":"2022-04-28T14:39:26.613087+0000","last_undegraded":"2022-04-28T14:39:26.613087+0000","last_fullsized":"2022-04-28T14:39:26.613087+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571336+0000","last_change":"2022-04-28T14:39:13.971833+0000","last_active":"2022-04-28T14:39:27.571336+0000","last_peered":"2022-04-28T14:39:27.571336+0000","last_clean":"2022-04-28T14:39:27.571336+0000","last_became_active":"2022-04-28T14:39:13.971513+0000","last_became_peered":"2022-04-28T14:39:13.971513+0000","last_unstale":"2022-04-28T14:39:27.571336+0000","last_undegraded":"2022-04-28T14:39:27.571336+0000","last_fullsized":"2022-04-28T14:39:27.571336+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"18'12","reported_seq":24,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-04-28T14:41:25.225938+0000","last_change":"2022-04-28T14:39:13.619098+0000","last_active":"2022-04-28T14:41:25.225938+0000","last_peered":"2022-04-28T14:41:25.225938+0000","last_clean":"2022-04-28T14:41:25.225938+0000","last_became_active":"2022-04-28T14:39:13.618737+0000","last_became_peered":"2022-04-28T14:39:13.618737+0000","last_unstale":"2022-04-28T14:41:25.225938+0000","last_undegraded":"2022-04-28T14:41:25.225938+0000","last_fullsized":"2022-04-28T14:41:25.225938+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4014,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571857+0000","last_change":"2022-04-28T14:39:13.951611+0000","last_active":"2022-04-28T14:39:27.571857+0000","last_peered":"2022-04-28T14:39:27.571857+0000","last_clean":"2022-04-28T14:39:27.571857+0000","last_became_active":"2022-04-28T14:39:13.951102+0000","last_became_peered":"2022-04-28T14:39:13.951102+0000","last_unstale":"2022-04-28T14:39:27.571857+0000","last_undegraded":"2022-04-28T14:39:27.571857+0000","last_fullsized":"2022-04-28T14:39:27.571857+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613671+0000","last_change":"2022-04-28T14:39:13.618476+0000","last_active":"2022-04-28T14:39:26.613671+0000","last_peered":"2022-04-28T14:39:26.613671+0000","last_clean":"2022-04-28T14:39:26.613671+0000","last_became_active":"2022-04-28T14:39:13.617950+0000","last_became_peered":"2022-04-28T14:39:13.617950+0000","last_unstale":"2022-04-28T14:39:26.613671+0000","last_undegraded":"2022-04-28T14:39:26.613671+0000","last_fullsized":"2022-04-28T14:39:26.613671+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.614162+0000","last_change":"2022-04-28T14:39:13.969503+0000","last_active":"2022-04-28T14:39:26.614162+0000","last_peered":"2022-04-28T14:39:26.614162+0000","last_clean":"2022-04-28T14:39:26.614162+0000","last_became_active":"2022-04-28T14:39:13.969200+0000","last_became_peered":"2022-04-28T14:39:13.969200+0000","last_unstale":"2022-04-28T14:39:26.614162+0000","last_undegraded":"2022-04-28T14:39:26.614162+0000","last_fullsized":"2022-04-28T14:39:26.614162+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"16'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613815+0000","last_change":"2022-04-28T14:39:13.613426+0000","last_active":"2022-04-28T14:39:26.613815+0000","last_peered":"2022-04-28T14:39:26.613815+0000","last_clean":"2022-04-28T14:39:26.613815+0000","last_became_active":"2022-04-28T14:39:13.613077+0000","last_became_peered":"2022-04-28T14:39:13.613077+0000","last_unstale":"2022-04-28T14:39:26.613815+0000","last_undegraded":"2022-04-28T14:39:26.613815+0000","last_fullsized":"2022-04-28T14:39:26.613815+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571525+0000","last_change":"2022-04-28T14:39:13.953772+0000","last_active":"2022-04-28T14:39:27.571525+0000","last_peered":"2022-04-28T14:39:27.571525+0000","last_clean":"2022-04-28T14:39:27.571525+0000","last_became_active":"2022-04-28T14:39:13.953478+0000","last_became_peered":"2022-04-28T14:39:13.953478+0000","last_unstale":"2022-04-28T14:39:27.571525+0000","last_undegraded":"2022-04-28T14:39:27.571525+0000","last_fullsized":"2022-04-28T14:39:27.571525+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571816+0000","last_change":"2022-04-28T14:39:13.606445+0000","last_active":"2022-04-28T14:39:27.571816+0000","last_peered":"2022-04-28T14:39:27.571816+0000","last_clean":"2022-04-28T14:39:27.571816+0000","last_became_active":"2022-04-28T14:39:13.606028+0000","last_became_peered":"2022-04-28T14:39:13.606028+0000","last_unstale":"2022-04-28T14:39:27.571816+0000","last_undegraded":"2022-04-28T14:39:27.571816+0000","last_fullsized":"2022-04-28T14:39:27.571816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570549+0000","last_change":"2022-04-28T14:39:13.951780+0000","last_active":"2022-04-28T14:39:27.570549+0000","last_peered":"2022-04-28T14:39:27.570549+0000","last_clean":"2022-04-28T14:39:27.570549+0000","last_became_active":"2022-04-28T14:39:13.951236+0000","last_became_peered":"2022-04-28T14:39:13.951236+0000","last_unstale":"2022-04-28T14:39:27.570549+0000","last_undegraded":"2022-04-28T14:39:27.570549+0000","last_fullsized":"2022-04-28T14:39:27.570549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"16'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570560+0000","last_change":"2022-04-28T14:39:13.621466+0000","last_active":"2022-04-28T14:39:27.570560+0000","last_peered":"2022-04-28T14:39:27.570560+0000","last_clean":"2022-04-28T14:39:27.570560+0000","last_became_active":"2022-04-28T14:39:13.621146+0000","last_became_peered":"2022-04-28T14:39:13.621146+0000","last_unstale":"2022-04-28T14:39:27.570560+0000","last_undegraded":"2022-04-28T14:39:27.570560+0000","last_fullsized":"2022-04-28T14:39:27.570560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471591+0000","last_change":"2022-04-28T14:39:13.960230+0000","last_active":"2022-04-28T14:39:27.471591+0000","last_peered":"2022-04-28T14:39:27.471591+0000","last_clean":"2022-04-28T14:39:27.471591+0000","last_became_active":"2022-04-28T14:39:13.958741+0000","last_became_peered":"2022-04-28T14:39:13.958741+0000","last_unstale":"2022-04-28T14:39:27.471591+0000","last_undegraded":"2022-04-28T14:39:27.471591+0000","last_fullsized":"2022-04-28T14:39:27.471591+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612287+0000","last_change":"2022-04-28T14:39:13.603448+0000","last_active":"2022-04-28T14:39:26.612287+0000","last_peered":"2022-04-28T14:39:26.612287+0000","last_clean":"2022-04-28T14:39:26.612287+0000","last_became_active":"2022-04-28T14:39:13.603117+0000","last_became_peered":"2022-04-28T14:39:13.603117+0000","last_unstale":"2022-04-28T14:39:26.612287+0000","last_undegraded":"2022-04-28T14:39:26.612287+0000","last_fullsized":"2022-04-28T14:39:26.612287+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570986+0000","last_change":"2022-04-28T14:39:13.951179+0000","last_active":"2022-04-28T14:39:27.570986+0000","last_peered":"2022-04-28T14:39:27.570986+0000","last_clean":"2022-04-28T14:39:27.570986+0000","last_became_active":"2022-04-28T14:39:13.950413+0000","last_became_peered":"2022-04-28T14:39:13.950413+0000","last_unstale":"2022-04-28T14:39:27.570986+0000","last_undegraded":"2022-04-28T14:39:27.570986+0000","last_fullsized":"2022-04-28T14:39:27.570986+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612296+0000","last_change":"2022-04-28T14:39:13.609803+0000","last_active":"2022-04-28T14:39:26.612296+0000","last_peered":"2022-04-28T14:39:26.612296+0000","last_clean":"2022-04-28T14:39:26.612296+0000","last_became_active":"2022-04-28T14:39:13.609320+0000","last_became_peered":"2022-04-28T14:39:13.609320+0000","last_unstale":"2022-04-28T14:39:26.612296+0000","last_undegraded":"2022-04-28T14:39:26.612296+0000","last_fullsized":"2022-04-28T14:39:26.612296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612199+0000","last_change":"2022-04-28T14:39:13.953322+0000","last_active":"2022-04-28T14:39:26.612199+0000","last_peered":"2022-04-28T14:39:26.612199+0000","last_clean":"2022-04-28T14:39:26.612199+0000","last_became_active":"2022-04-28T14:39:13.952997+0000","last_became_peered":"2022-04-28T14:39:13.952997+0000","last_unstale":"2022-04-28T14:39:26.612199+0000","last_undegraded":"2022-04-28T14:39:26.612199+0000","last_fullsized":"2022-04-28T14:39:26.612199+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571203+0000","last_change":"2022-04-28T14:39:13.624451+0000","last_active":"2022-04-28T14:39:27.571203+0000","last_peered":"2022-04-28T14:39:27.571203+0000","last_clean":"2022-04-28T14:39:27.571203+0000","last_became_active":"2022-04-28T14:39:13.624118+0000","last_became_peered":"2022-04-28T14:39:13.624118+0000","last_unstale":"2022-04-28T14:39:27.571203+0000","last_undegraded":"2022-04-28T14:39:27.571203+0000","last_fullsized":"2022-04-28T14:39:27.571203+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571069+0000","last_change":"2022-04-28T14:39:13.956657+0000","last_active":"2022-04-28T14:39:27.571069+0000","last_peered":"2022-04-28T14:39:27.571069+0000","last_clean":"2022-04-28T14:39:27.571069+0000","last_became_active":"2022-04-28T14:39:13.956291+0000","last_became_peered":"2022-04-28T14:39:13.956291+0000","last_unstale":"2022-04-28T14:39:27.571069+0000","last_undegraded":"2022-04-28T14:39:27.571069+0000","last_fullsized":"2022-04-28T14:39:27.571069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571781+0000","last_change":"2022-04-28T14:39:13.621131+0000","last_active":"2022-04-28T14:39:27.571781+0000","last_peered":"2022-04-28T14:39:27.571781+0000","last_clean":"2022-04-28T14:39:27.571781+0000","last_became_active":"2022-04-28T14:39:13.620764+0000","last_became_peered":"2022-04-28T14:39:13.620764+0000","last_unstale":"2022-04-28T14:39:27.571781+0000","last_undegraded":"2022-04-28T14:39:27.571781+0000","last_fullsized":"2022-04-28T14:39:27.571781+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612381+0000","last_change":"2022-04-28T14:39:13.971712+0000","last_active":"2022-04-28T14:39:26.612381+0000","last_peered":"2022-04-28T14:39:26.612381+0000","last_clean":"2022-04-28T14:39:26.612381+0000","last_became_active":"2022-04-28T14:39:13.970627+0000","last_became_peered":"2022-04-28T14:39:13.970627+0000","last_unstale":"2022-04-28T14:39:26.612381+0000","last_undegraded":"2022-04-28T14:39:26.612381+0000","last_fullsized":"2022-04-28T14:39:26.612381+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613501+0000","last_change":"2022-04-28T14:39:13.618500+0000","last_active":"2022-04-28T14:39:26.613501+0000","last_peered":"2022-04-28T14:39:26.613501+0000","last_clean":"2022-04-28T14:39:26.613501+0000","last_became_active":"2022-04-28T14:39:13.618171+0000","last_became_peered":"2022-04-28T14:39:13.618171+0000","last_unstale":"2022-04-28T14:39:26.613501+0000","last_undegraded":"2022-04-28T14:39:26.613501+0000","last_fullsized":"2022-04-28T14:39:26.613501+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571555+0000","last_change":"2022-04-28T14:39:13.966833+0000","last_active":"2022-04-28T14:39:27.571555+0000","last_peered":"2022-04-28T14:39:27.571555+0000","last_clean":"2022-04-28T14:39:27.571555+0000","last_became_active":"2022-04-28T14:39:13.963563+0000","last_became_peered":"2022-04-28T14:39:13.963563+0000","last_unstale":"2022-04-28T14:39:27.571555+0000","last_undegraded":"2022-04-28T14:39:27.571555+0000","last_fullsized":"2022-04-28T14:39:27.571555+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571662+0000","last_change":"2022-04-28T14:39:13.622884+0000","last_active":"2022-04-28T14:39:27.571662+0000","last_peered":"2022-04-28T14:39:27.571662+0000","last_clean":"2022-04-28T14:39:27.571662+0000","last_became_active":"2022-04-28T14:39:13.617005+0000","last_became_peered":"2022-04-28T14:39:13.617005+0000","last_unstale":"2022-04-28T14:39:27.571662+0000","last_undegraded":"2022-04-28T14:39:27.571662+0000","last_fullsized":"2022-04-28T14:39:27.571662+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613813+0000","last_change":"2022-04-28T14:39:13.951972+0000","last_active":"2022-04-28T14:39:26.613813+0000","last_peered":"2022-04-28T14:39:26.613813+0000","last_clean":"2022-04-28T14:39:26.613813+0000","last_became_active":"2022-04-28T14:39:13.951647+0000","last_became_peered":"2022-04-28T14:39:13.951647+0000","last_unstale":"2022-04-28T14:39:26.613813+0000","last_undegraded":"2022-04-28T14:39:26.613813+0000","last_fullsized":"2022-04-28T14:39:26.613813+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.614113+0000","last_change":"2022-04-28T14:39:13.619298+0000","last_active":"2022-04-28T14:39:26.614113+0000","last_peered":"2022-04-28T14:39:26.614113+0000","last_clean":"2022-04-28T14:39:26.614113+0000","last_became_active":"2022-04-28T14:39:13.618948+0000","last_became_peered":"2022-04-28T14:39:13.618948+0000","last_unstale":"2022-04-28T14:39:26.614113+0000","last_undegraded":"2022-04-28T14:39:26.614113+0000","last_fullsized":"2022-04-28T14:39:26.614113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":8344,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":16688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705695,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048772,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323068,"statfs":{"total":96636764160,"available":95562821632,"internally_reserved":1073741824,"allocated":192512,"data_stored":53891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 28 14:41:07 2022","interfaces":[{"interface":"back","average":{"1min":0.26900000000000002,"5min":0.33300000000000002,"15min":0.34300000000000003},"min":{"1min":0.13800000000000001,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.50700000000000001,"5min":0.623,"15min":0.623},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.27300000000000002,"5min":0.33200000000000002,"15min":0.34200000000000003},"min":{"1min":0.16800000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.55100000000000005,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.315}]},{"osd":1,"last update":"Thu Apr 28 14:41:07 2022","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":0.32500000000000001,"15min":0.33200000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.47899999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.28599999999999998,"5min":0.34300000000000003,"15min":0.35299999999999998},"min":{"1min":0.155,"5min":0.155,"15min":0.155},"max":{"1min":0.56200000000000006,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Apr 28 14:41:07 2022","interfaces":[{"interface":"back","average":{"1min":0.29499999999999998,"5min":0.35799999999999998,"15min":0.36799999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.376},{"interface":"front","average":{"1min":0.29499999999999998,"5min":0.36899999999999999,"15min":0.38100000000000001},"min":{"1min":0.16200000000000001,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.54200000000000004,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.32300000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705694,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048760,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323080,"statfs":{"total":96636764160,"available":95562833920,"internally_reserved":1073741824,"allocated":180224,"data_stored":48449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 28 14:41:05 2022","interfaces":[{"interface":"back","average":{"1min":0.249,"5min":0.27200000000000002,"15min":0.27600000000000002},"min":{"1min":0.20300000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.27400000000000002,"5min":0.442,"15min":0.442},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.308,"15min":0.314},"min":{"1min":0.222,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.31,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Apr 28 14:41:05 2022","interfaces":[{"interface":"back","average":{"1min":0.24199999999999999,"5min":0.28599999999999998,"15min":0.29299999999999998},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.33300000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.27000000000000002,"5min":0.314,"15min":0.32100000000000001},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.34000000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Apr 28 14:41:05 2022","interfaces":[{"interface":"back","average":{"1min":0.24099999999999999,"5min":0.28699999999999998,"15min":0.29499999999999998},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.28599999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.308},{"interface":"front","average":{"1min":0.25,"5min":0.311,"15min":0.32100000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.29599999999999999,"5min":0.495,"15min":0.495},"last":0.28999999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705695,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":47885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 28 14:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.24399999999999999,"5min":0.31,"15min":0.32100000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.308,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.191},{"interface":"front","average":{"1min":0.24399999999999999,"5min":0.33200000000000002,"15min":0.34599999999999997},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.32400000000000001,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.20399999999999999}]},{"osd":1,"last update":"Thu Apr 28 14:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.26600000000000001,"5min":0.34200000000000003,"15min":0.35499999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.29799999999999999,"5min":0.629,"15min":0.629},"last":0.25},{"interface":"front","average":{"1min":0.26000000000000001,"5min":0.35099999999999998,"15min":0.36599999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.313,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.224}]},{"osd":3,"last update":"Thu Apr 28 14:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.28399999999999997,"5min":0.38900000000000001,"15min":0.40699999999999997},"min":{"1min":0.24299999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.34599999999999997,"5min":1.325,"15min":1.325},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.26800000000000002,"5min":0.373,"15min":0.39100000000000001},"min":{"1min":0.217,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.32300000000000001,"5min":1.302,"15min":1.302},"last":0.219}]}]},{"osd":0,"up_from":9,"seq":38654705695,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":53985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 28 14:41:01 2022","interfaces":[{"interface":"back","average":{"1min":0.26100000000000001,"5min":0.29299999999999998,"15min":0.29899999999999999},"min":{"1min":0.186,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.43099999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.252,"5min":0.309,"15min":0.31900000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.40500000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Apr 28 14:41:01 2022","interfaces":[{"interface":"back","average":{"1min":0.26400000000000001,"5min":0.33000000000000002,"15min":0.34100000000000003},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.443,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.27400000000000002,"5min":0.32500000000000001,"15min":0.33300000000000002},"min":{"1min":0.22800000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.46200000000000002,"5min":0.497,"15min":0.497},"last":0.318}]},{"osd":3,"last update":"Thu Apr 28 14:41:01 2022","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.34399999999999997,"15min":0.35199999999999998},"min":{"1min":0.222,"5min":0.216,"15min":0.216},"max":{"1min":0.48299999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.27900000000000003,"5min":0.35099999999999998,"15min":0.36299999999999999},"min":{"1min":0.19500000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.48999999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.39900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-04-28T14:41:28.867 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-04-28T14:41:28.986 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.981+0000 7f80d32a2700 1 Processor -- start 2022-04-28T14:41:28.986 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.981+0000 7f80d32a2700 1 -- start start 2022-04-28T14:41:28.989 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.982+0000 7f80d32a2700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f80cc0a5450 0x7f80cc067010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:28.989 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.982+0000 7f80d32a2700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f80cc135740 0x7f80cc13b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:28.989 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.982+0000 7f80d32a2700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f80cc13be70 0x7f80cc1381e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:28.989 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.982+0000 7f80d32a2700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80cc0a5cd0 con 0x7f80cc135740 2022-04-28T14:41:28.989 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.982+0000 7f80d32a2700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc0a5830 con 0x7f80cc13be70 2022-04-28T14:41:28.989 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.982+0000 7f80d32a2700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc13c350 con 0x7f80cc0a5450 2022-04-28T14:41:28.989 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.982+0000 7f80d103e700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f80cc0a5450 0x7f80cc067010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:28.990 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.982+0000 7f80d183f700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f80cc13be70 0x7f80cc1381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:28.990 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.982+0000 7f80d103e700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f80cc0a5450 0x7f80cc067010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:47786/0 (socket says 172.21.15.22:47786) 2022-04-28T14:41:28.990 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.982+0000 7f80d183f700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f80cc13be70 0x7f80cc1381e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48006/0 (socket says 172.21.15.22:48006) 2022-04-28T14:41:28.990 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.982+0000 7f80d103e700 1 -- 172.21.15.22:0/636509133 learned_addr learned my addr 172.21.15.22:0/636509133 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:28.990 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.982+0000 7f80d083d700 1 --2- 172.21.15.22:0/636509133 >> v2:172.21.15.22:3300/0 conn(0x7f80cc135740 0x7f80cc13b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:28.990 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.982+0000 7f80d183f700 1 -- 172.21.15.22:0/636509133 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f80cc0a5450 msgr2=0x7f80cc067010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:28.990 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.982+0000 7f80d183f700 1 --2- 172.21.15.22:0/636509133 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f80cc0a5450 0x7f80cc067010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.990 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.982+0000 7f80d183f700 1 -- 172.21.15.22:0/636509133 >> v2:172.21.15.22:3300/0 conn(0x7f80cc135740 msgr2=0x7f80cc13b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:28.990 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.982+0000 7f80d183f700 1 --2- 172.21.15.22:0/636509133 >> v2:172.21.15.22:3300/0 conn(0x7f80cc135740 0x7f80cc13b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.991 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.982+0000 7f80d183f700 1 -- 172.21.15.22:0/636509133 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc13c5f0 con 0x7f80cc13be70 2022-04-28T14:41:28.991 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.982+0000 7f80d103e700 1 --2- 172.21.15.22:0/636509133 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f80cc0a5450 0x7f80cc067010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:28.991 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.982+0000 7f80d083d700 1 --2- 172.21.15.22:0/636509133 >> v2:172.21.15.22:3300/0 conn(0x7f80cc135740 0x7f80cc13b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:28.991 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.982+0000 7f80d183f700 1 --2- 172.21.15.22:0/636509133 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f80cc13be70 0x7f80cc1381e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f80c4009e60 tx=0x7f80c4009780).ready entity=mon.1 client_cookie=e80e3e8a5e22720e server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:28.991 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.983+0000 7f80bbfff700 1 -- 172.21.15.22:0/636509133 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c400e070 con 0x7f80cc13be70 2022-04-28T14:41:28.991 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.983+0000 7f80bbfff700 1 -- 172.21.15.22:0/636509133 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c400bab0 con 0x7f80cc13be70 2022-04-28T14:41:28.991 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.983+0000 7f80bbfff700 1 -- 172.21.15.22:0/636509133 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c400be30 con 0x7f80cc13be70 2022-04-28T14:41:28.991 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.983+0000 7f80d32a2700 1 -- 172.21.15.22:0/636509133 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f80cc13be70 msgr2=0x7f80cc1381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:28.991 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.983+0000 7f80d32a2700 1 --2- 172.21.15.22:0/636509133 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f80cc13be70 0x7f80cc1381e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f80c4009e60 tx=0x7f80c4009780).stop 2022-04-28T14:41:28.991 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.983+0000 7f80d32a2700 1 -- 172.21.15.22:0/636509133 shutdown_connections 2022-04-28T14:41:28.992 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.983+0000 7f80d32a2700 1 --2- 172.21.15.22:0/636509133 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f80cc13be70 0x7f80cc1381e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.992 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.983+0000 7f80d32a2700 1 --2- 172.21.15.22:0/636509133 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f80cc0a5450 0x7f80cc067010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.992 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.983+0000 7f80d32a2700 1 --2- 172.21.15.22:0/636509133 >> v2:172.21.15.22:3300/0 conn(0x7f80cc135740 0x7f80cc13b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.992 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.983+0000 7f80d32a2700 1 -- 172.21.15.22:0/636509133 >> 172.21.15.22:0/636509133 conn(0x7f80cc069860 msgr2=0x7f80cc069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:28.992 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.983+0000 7f80d32a2700 1 -- 172.21.15.22:0/636509133 shutdown_connections 2022-04-28T14:41:28.992 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.983+0000 7f80d32a2700 1 -- 172.21.15.22:0/636509133 wait complete. 2022-04-28T14:41:28.992 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.984+0000 7f80d32a2700 1 Processor -- start 2022-04-28T14:41:28.992 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.984+0000 7f80d32a2700 1 -- start start 2022-04-28T14:41:28.995 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.985+0000 7f80d32a2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80cc0a5450 0x7f80cc138670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:28.995 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.985+0000 7f80d32a2700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f80cc135740 0x7f80cc114530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:28.995 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.985+0000 7f80d32a2700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f80cc13be70 0x7f80cc0a8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:28.995 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.985+0000 7f80d32a2700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc1355f0 con 0x7f80cc0a5450 2022-04-28T14:41:28.995 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.985+0000 7f80d32a2700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc147c30 con 0x7f80cc13be70 2022-04-28T14:41:28.995 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.985+0000 7f80d32a2700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc0a8000 con 0x7f80cc135740 2022-04-28T14:41:28.995 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.985+0000 7f80d103e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80cc0a5450 0x7f80cc138670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:28.995 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.985+0000 7f80d083d700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f80cc135740 0x7f80cc114530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:28.995 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.985+0000 7f80d103e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80cc0a5450 0x7f80cc138670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50440/0 (socket says 172.21.15.22:50440) 2022-04-28T14:41:28.996 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.985+0000 7f80d083d700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f80cc135740 0x7f80cc114530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:47794/0 (socket says 172.21.15.22:47794) 2022-04-28T14:41:28.996 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.985+0000 7f80d103e700 1 -- 172.21.15.22:0/1498250097 learned_addr learned my addr 172.21.15.22:0/1498250097 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:28.996 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.985+0000 7f80d183f700 1 --2- 172.21.15.22:0/1498250097 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f80cc13be70 0x7f80cc0a8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:28.996 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.985+0000 7f80d083d700 1 -- 172.21.15.22:0/1498250097 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f80cc13be70 msgr2=0x7f80cc0a8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:28.996 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.985+0000 7f80d083d700 1 --2- 172.21.15.22:0/1498250097 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f80cc13be70 0x7f80cc0a8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.996 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.985+0000 7f80d083d700 1 -- 172.21.15.22:0/1498250097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80cc0a5450 msgr2=0x7f80cc138670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:28.996 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.985+0000 7f80d083d700 1 --2- 172.21.15.22:0/1498250097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80cc0a5450 0x7f80cc138670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:28.996 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.985+0000 7f80d083d700 1 -- 172.21.15.22:0/1498250097 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80bc009370 con 0x7f80cc135740 2022-04-28T14:41:28.997 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.985+0000 7f80d103e700 1 --2- 172.21.15.22:0/1498250097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80cc0a5450 0x7f80cc138670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:28.997 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.985+0000 7f80d083d700 1 --2- 172.21.15.22:0/1498250097 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f80cc135740 0x7f80cc114530 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f80c800e980 tx=0x7f80c8009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:28.997 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.986+0000 7f80b97fa700 1 -- 172.21.15.22:0/1498250097 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c800c640 con 0x7f80cc135740 2022-04-28T14:41:28.997 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.986+0000 7f80b97fa700 1 -- 172.21.15.22:0/1498250097 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c800c7a0 con 0x7f80cc135740 2022-04-28T14:41:28.997 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.986+0000 7f80d32a2700 1 -- 172.21.15.22:0/1498250097 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c80092a0 con 0x7f80cc135740 2022-04-28T14:41:28.997 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.986+0000 7f80b97fa700 1 -- 172.21.15.22:0/1498250097 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c800cb20 con 0x7f80cc135740 2022-04-28T14:41:28.997 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.986+0000 7f80d32a2700 1 -- 172.21.15.22:0/1498250097 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c4009a20 con 0x7f80cc135740 2022-04-28T14:41:28.997 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.987+0000 7f80d32a2700 1 -- 172.21.15.22:0/1498250097 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80cc0a8a50 con 0x7f80cc135740 2022-04-28T14:41:28.997 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.987+0000 7f80b97fa700 1 -- 172.21.15.22:0/1498250097 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 7) v1 ==== 48534+0+0 (secure 0 0 0) 0x7f80c8022070 con 0x7f80cc135740 2022-04-28T14:41:28.998 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.988+0000 7f80b97fa700 1 -- 172.21.15.22:0/1498250097 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f80c8055d20 con 0x7f80cc135740 2022-04-28T14:41:28.998 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:28.991+0000 7f80b97fa700 1 -- 172.21.15.22:0/1498250097 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f80c803a010 con 0x7f80cc135740 2022-04-28T14:41:29.130 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.126+0000 7f80d32a2700 1 -- 172.21.15.22:0/1498250097 --> v1:172.21.15.22:6808/92758 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f80cc0a4a90 con 0x7f80ac041ad0 2022-04-28T14:41:29.139 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.134+0000 7f80b97fa700 1 -- 172.21.15.22:0/1498250097 <== mgr.14100 v1:172.21.15.22:6808/92758 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+325715 (unknown 2965378022 0 2009894187) 0x7f80cc0a4a90 con 0x7f80ac041ad0 2022-04-28T14:41:29.143 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:41:29.146 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.137+0000 7f80d32a2700 1 -- 172.21.15.22:0/1498250097 >> v1:172.21.15.22:6808/92758 conn(0x7f80ac041ad0 legacy=0x7f80ac043f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:29.146 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.137+0000 7f80d32a2700 1 -- 172.21.15.22:0/1498250097 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f80cc135740 msgr2=0x7f80cc114530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:29.146 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.137+0000 7f80d32a2700 1 --2- 172.21.15.22:0/1498250097 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f80cc135740 0x7f80cc114530 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f80c800e980 tx=0x7f80c8009060).stop 2022-04-28T14:41:29.147 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.137+0000 7f80d32a2700 1 -- 172.21.15.22:0/1498250097 shutdown_connections 2022-04-28T14:41:29.147 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.137+0000 7f80d32a2700 1 --2- 172.21.15.22:0/1498250097 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f80cc13be70 0x7f80cc0a8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:29.147 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.137+0000 7f80d32a2700 1 --2- 172.21.15.22:0/1498250097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f80cc0a5450 0x7f80cc138670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:29.147 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.137+0000 7f80d32a2700 1 --2- 172.21.15.22:0/1498250097 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f80cc135740 0x7f80cc114530 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:29.147 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.137+0000 7f80d32a2700 1 -- 172.21.15.22:0/1498250097 >> 172.21.15.22:0/1498250097 conn(0x7f80cc069860 msgr2=0x7f80cc069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:29.147 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.137+0000 7f80d32a2700 1 -- 172.21.15.22:0/1498250097 shutdown_connections 2022-04-28T14:41:29.147 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.137+0000 7f80d32a2700 1 -- 172.21.15.22:0/1498250097 wait complete. 2022-04-28T14:41:29.148 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2022-04-28T14:41:29.153 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":7,"stamp":"2022-04-28T14:41:28.151583+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8344,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":272,"acting":272,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":272,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":4195056,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292304,"statfs":{"total":386547056640,"available":382251319296,"internally_reserved":4294967296,"allocated":737280,"data_stored":204210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7688,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.005994"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613045+0000","last_change":"2022-04-28T14:39:13.943418+0000","last_active":"2022-04-28T14:39:26.613045+0000","last_peered":"2022-04-28T14:39:26.613045+0000","last_clean":"2022-04-28T14:39:26.613045+0000","last_became_active":"2022-04-28T14:39:13.943111+0000","last_became_peered":"2022-04-28T14:39:13.943111+0000","last_unstale":"2022-04-28T14:39:26.613045+0000","last_undegraded":"2022-04-28T14:39:26.613045+0000","last_fullsized":"2022-04-28T14:39:26.613045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"17'9","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:45.546840+0000","last_change":"2022-04-28T14:39:13.619263+0000","last_active":"2022-04-28T14:39:45.546840+0000","last_peered":"2022-04-28T14:39:45.546840+0000","last_clean":"2022-04-28T14:39:45.546840+0000","last_became_active":"2022-04-28T14:39:13.618911+0000","last_became_peered":"2022-04-28T14:39:13.618911+0000","last_unstale":"2022-04-28T14:39:45.546840+0000","last_undegraded":"2022-04-28T14:39:45.546840+0000","last_fullsized":"2022-04-28T14:39:45.546840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2190,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571479+0000","last_change":"2022-04-28T14:39:13.964730+0000","last_active":"2022-04-28T14:39:27.571479+0000","last_peered":"2022-04-28T14:39:27.571479+0000","last_clean":"2022-04-28T14:39:27.571479+0000","last_became_active":"2022-04-28T14:39:13.964405+0000","last_became_peered":"2022-04-28T14:39:13.964405+0000","last_unstale":"2022-04-28T14:39:27.571479+0000","last_undegraded":"2022-04-28T14:39:27.571479+0000","last_fullsized":"2022-04-28T14:39:27.571479+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472078+0000","last_change":"2022-04-28T14:39:13.611678+0000","last_active":"2022-04-28T14:39:27.472078+0000","last_peered":"2022-04-28T14:39:27.472078+0000","last_clean":"2022-04-28T14:39:27.472078+0000","last_became_active":"2022-04-28T14:39:13.611166+0000","last_became_peered":"2022-04-28T14:39:13.611166+0000","last_unstale":"2022-04-28T14:39:27.472078+0000","last_undegraded":"2022-04-28T14:39:27.472078+0000","last_fullsized":"2022-04-28T14:39:27.472078+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471323+0000","last_change":"2022-04-28T14:39:13.960149+0000","last_active":"2022-04-28T14:39:27.471323+0000","last_peered":"2022-04-28T14:39:27.471323+0000","last_clean":"2022-04-28T14:39:27.471323+0000","last_became_active":"2022-04-28T14:39:13.959509+0000","last_became_peered":"2022-04-28T14:39:13.959509+0000","last_unstale":"2022-04-28T14:39:27.471323+0000","last_undegraded":"2022-04-28T14:39:27.471323+0000","last_fullsized":"2022-04-28T14:39:27.471323+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471488+0000","last_change":"2022-04-28T14:39:13.610970+0000","last_active":"2022-04-28T14:39:27.471488+0000","last_peered":"2022-04-28T14:39:27.471488+0000","last_clean":"2022-04-28T14:39:27.471488+0000","last_became_active":"2022-04-28T14:39:13.610661+0000","last_became_peered":"2022-04-28T14:39:13.610661+0000","last_unstale":"2022-04-28T14:39:27.471488+0000","last_undegraded":"2022-04-28T14:39:27.471488+0000","last_fullsized":"2022-04-28T14:39:27.471488+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612470+0000","last_change":"2022-04-28T14:39:13.963240+0000","last_active":"2022-04-28T14:39:26.612470+0000","last_peered":"2022-04-28T14:39:26.612470+0000","last_clean":"2022-04-28T14:39:26.612470+0000","last_became_active":"2022-04-28T14:39:13.961860+0000","last_became_peered":"2022-04-28T14:39:13.961860+0000","last_unstale":"2022-04-28T14:39:26.612470+0000","last_undegraded":"2022-04-28T14:39:26.612470+0000","last_fullsized":"2022-04-28T14:39:26.612470+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471032+0000","last_change":"2022-04-28T14:39:13.607628+0000","last_active":"2022-04-28T14:39:27.471032+0000","last_peered":"2022-04-28T14:39:27.471032+0000","last_clean":"2022-04-28T14:39:27.471032+0000","last_became_active":"2022-04-28T14:39:13.607234+0000","last_became_peered":"2022-04-28T14:39:13.607234+0000","last_unstale":"2022-04-28T14:39:27.471032+0000","last_undegraded":"2022-04-28T14:39:27.471032+0000","last_fullsized":"2022-04-28T14:39:27.471032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613294+0000","last_change":"2022-04-28T14:39:13.972780+0000","last_active":"2022-04-28T14:39:26.613294+0000","last_peered":"2022-04-28T14:39:26.613294+0000","last_clean":"2022-04-28T14:39:26.613294+0000","last_became_active":"2022-04-28T14:39:13.972189+0000","last_became_peered":"2022-04-28T14:39:13.972189+0000","last_unstale":"2022-04-28T14:39:26.613294+0000","last_undegraded":"2022-04-28T14:39:26.613294+0000","last_fullsized":"2022-04-28T14:39:26.613294+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"17'7","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:55.547282+0000","last_change":"2022-04-28T14:39:13.615060+0000","last_active":"2022-04-28T14:39:55.547282+0000","last_peered":"2022-04-28T14:39:55.547282+0000","last_clean":"2022-04-28T14:39:55.547282+0000","last_became_active":"2022-04-28T14:39:13.614686+0000","last_became_peered":"2022-04-28T14:39:13.614686+0000","last_unstale":"2022-04-28T14:39:55.547282+0000","last_undegraded":"2022-04-28T14:39:55.547282+0000","last_fullsized":"2022-04-28T14:39:55.547282+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571597+0000","last_change":"2022-04-28T14:39:13.963855+0000","last_active":"2022-04-28T14:39:27.571597+0000","last_peered":"2022-04-28T14:39:27.571597+0000","last_clean":"2022-04-28T14:39:27.571597+0000","last_became_active":"2022-04-28T14:39:13.963518+0000","last_became_peered":"2022-04-28T14:39:13.963518+0000","last_unstale":"2022-04-28T14:39:27.571597+0000","last_undegraded":"2022-04-28T14:39:27.571597+0000","last_fullsized":"2022-04-28T14:39:27.571597+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571370+0000","last_change":"2022-04-28T14:39:13.623926+0000","last_active":"2022-04-28T14:39:27.571370+0000","last_peered":"2022-04-28T14:39:27.571370+0000","last_clean":"2022-04-28T14:39:27.571370+0000","last_became_active":"2022-04-28T14:39:13.623608+0000","last_became_peered":"2022-04-28T14:39:13.623608+0000","last_unstale":"2022-04-28T14:39:27.571370+0000","last_undegraded":"2022-04-28T14:39:27.571370+0000","last_fullsized":"2022-04-28T14:39:27.571370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471959+0000","last_change":"2022-04-28T14:39:13.968270+0000","last_active":"2022-04-28T14:39:27.471959+0000","last_peered":"2022-04-28T14:39:27.471959+0000","last_clean":"2022-04-28T14:39:27.471959+0000","last_became_active":"2022-04-28T14:39:13.967894+0000","last_became_peered":"2022-04-28T14:39:13.967894+0000","last_unstale":"2022-04-28T14:39:27.471959+0000","last_undegraded":"2022-04-28T14:39:27.471959+0000","last_fullsized":"2022-04-28T14:39:27.471959+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"16'4","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613553+0000","last_change":"2022-04-28T14:39:13.613942+0000","last_active":"2022-04-28T14:39:26.613553+0000","last_peered":"2022-04-28T14:39:26.613553+0000","last_clean":"2022-04-28T14:39:26.613553+0000","last_became_active":"2022-04-28T14:39:13.613151+0000","last_became_peered":"2022-04-28T14:39:13.613151+0000","last_unstale":"2022-04-28T14:39:26.613553+0000","last_undegraded":"2022-04-28T14:39:26.613553+0000","last_fullsized":"2022-04-28T14:39:26.613553+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571448+0000","last_change":"2022-04-28T14:39:13.972010+0000","last_active":"2022-04-28T14:39:27.571448+0000","last_peered":"2022-04-28T14:39:27.571448+0000","last_clean":"2022-04-28T14:39:27.571448+0000","last_became_active":"2022-04-28T14:39:13.971680+0000","last_became_peered":"2022-04-28T14:39:13.971680+0000","last_unstale":"2022-04-28T14:39:27.571448+0000","last_undegraded":"2022-04-28T14:39:27.571448+0000","last_fullsized":"2022-04-28T14:39:27.571448+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"18'4","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-04-28T14:41:24.308238+0000","last_change":"2022-04-28T14:39:13.608578+0000","last_active":"2022-04-28T14:41:24.308238+0000","last_peered":"2022-04-28T14:41:24.308238+0000","last_clean":"2022-04-28T14:41:24.308238+0000","last_became_active":"2022-04-28T14:39:13.608208+0000","last_became_peered":"2022-04-28T14:39:13.608208+0000","last_unstale":"2022-04-28T14:41:24.308238+0000","last_undegraded":"2022-04-28T14:41:24.308238+0000","last_fullsized":"2022-04-28T14:41:24.308238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570627+0000","last_change":"2022-04-28T14:39:13.959741+0000","last_active":"2022-04-28T14:39:27.570627+0000","last_peered":"2022-04-28T14:39:27.570627+0000","last_clean":"2022-04-28T14:39:27.570627+0000","last_became_active":"2022-04-28T14:39:13.959445+0000","last_became_peered":"2022-04-28T14:39:13.959445+0000","last_unstale":"2022-04-28T14:39:27.570627+0000","last_undegraded":"2022-04-28T14:39:27.570627+0000","last_fullsized":"2022-04-28T14:39:27.570627+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571628+0000","last_change":"2022-04-28T14:39:13.615947+0000","last_active":"2022-04-28T14:39:27.571628+0000","last_peered":"2022-04-28T14:39:27.571628+0000","last_clean":"2022-04-28T14:39:27.571628+0000","last_became_active":"2022-04-28T14:39:13.615589+0000","last_became_peered":"2022-04-28T14:39:13.615589+0000","last_unstale":"2022-04-28T14:39:27.571628+0000","last_undegraded":"2022-04-28T14:39:27.571628+0000","last_fullsized":"2022-04-28T14:39:27.571628+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472066+0000","last_change":"2022-04-28T14:39:13.966950+0000","last_active":"2022-04-28T14:39:27.472066+0000","last_peered":"2022-04-28T14:39:27.472066+0000","last_clean":"2022-04-28T14:39:27.472066+0000","last_became_active":"2022-04-28T14:39:13.961621+0000","last_became_peered":"2022-04-28T14:39:13.961621+0000","last_unstale":"2022-04-28T14:39:27.472066+0000","last_undegraded":"2022-04-28T14:39:27.472066+0000","last_fullsized":"2022-04-28T14:39:27.472066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"16'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471758+0000","last_change":"2022-04-28T14:39:13.614233+0000","last_active":"2022-04-28T14:39:27.471758+0000","last_peered":"2022-04-28T14:39:27.471758+0000","last_clean":"2022-04-28T14:39:27.471758+0000","last_became_active":"2022-04-28T14:39:13.613890+0000","last_became_peered":"2022-04-28T14:39:13.613890+0000","last_unstale":"2022-04-28T14:39:27.471758+0000","last_undegraded":"2022-04-28T14:39:27.471758+0000","last_fullsized":"2022-04-28T14:39:27.471758+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612160+0000","last_change":"2022-04-28T14:39:13.953204+0000","last_active":"2022-04-28T14:39:26.612160+0000","last_peered":"2022-04-28T14:39:26.612160+0000","last_clean":"2022-04-28T14:39:26.612160+0000","last_became_active":"2022-04-28T14:39:13.952884+0000","last_became_peered":"2022-04-28T14:39:13.952884+0000","last_unstale":"2022-04-28T14:39:26.612160+0000","last_undegraded":"2022-04-28T14:39:26.612160+0000","last_fullsized":"2022-04-28T14:39:26.612160+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570672+0000","last_change":"2022-04-28T14:39:13.616607+0000","last_active":"2022-04-28T14:39:27.570672+0000","last_peered":"2022-04-28T14:39:27.570672+0000","last_clean":"2022-04-28T14:39:27.570672+0000","last_became_active":"2022-04-28T14:39:13.616264+0000","last_became_peered":"2022-04-28T14:39:13.616264+0000","last_unstale":"2022-04-28T14:39:27.570672+0000","last_undegraded":"2022-04-28T14:39:27.570672+0000","last_fullsized":"2022-04-28T14:39:27.570672+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471370+0000","last_change":"2022-04-28T14:39:13.958559+0000","last_active":"2022-04-28T14:39:27.471370+0000","last_peered":"2022-04-28T14:39:27.471370+0000","last_clean":"2022-04-28T14:39:27.471370+0000","last_became_active":"2022-04-28T14:39:13.958048+0000","last_became_peered":"2022-04-28T14:39:13.958048+0000","last_unstale":"2022-04-28T14:39:27.471370+0000","last_undegraded":"2022-04-28T14:39:27.471370+0000","last_fullsized":"2022-04-28T14:39:27.471370+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.611804+0000","last_change":"2022-04-28T14:39:13.599319+0000","last_active":"2022-04-28T14:39:26.611804+0000","last_peered":"2022-04-28T14:39:26.611804+0000","last_clean":"2022-04-28T14:39:26.611804+0000","last_became_active":"2022-04-28T14:39:13.598926+0000","last_became_peered":"2022-04-28T14:39:13.598926+0000","last_unstale":"2022-04-28T14:39:26.611804+0000","last_undegraded":"2022-04-28T14:39:26.611804+0000","last_fullsized":"2022-04-28T14:39:26.611804+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613237+0000","last_change":"2022-04-28T14:39:13.953566+0000","last_active":"2022-04-28T14:39:26.613237+0000","last_peered":"2022-04-28T14:39:26.613237+0000","last_clean":"2022-04-28T14:39:26.613237+0000","last_became_active":"2022-04-28T14:39:13.953248+0000","last_became_peered":"2022-04-28T14:39:13.953248+0000","last_unstale":"2022-04-28T14:39:26.613237+0000","last_undegraded":"2022-04-28T14:39:26.613237+0000","last_fullsized":"2022-04-28T14:39:26.613237+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571788+0000","last_change":"2022-04-28T14:39:13.621471+0000","last_active":"2022-04-28T14:39:27.571788+0000","last_peered":"2022-04-28T14:39:27.571788+0000","last_clean":"2022-04-28T14:39:27.571788+0000","last_became_active":"2022-04-28T14:39:13.621155+0000","last_became_peered":"2022-04-28T14:39:13.621155+0000","last_unstale":"2022-04-28T14:39:27.571788+0000","last_undegraded":"2022-04-28T14:39:27.571788+0000","last_fullsized":"2022-04-28T14:39:27.571788+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571693+0000","last_change":"2022-04-28T14:39:13.961895+0000","last_active":"2022-04-28T14:39:27.571693+0000","last_peered":"2022-04-28T14:39:27.571693+0000","last_clean":"2022-04-28T14:39:27.571693+0000","last_became_active":"2022-04-28T14:39:13.961160+0000","last_became_peered":"2022-04-28T14:39:13.961160+0000","last_unstale":"2022-04-28T14:39:27.571693+0000","last_undegraded":"2022-04-28T14:39:27.571693+0000","last_fullsized":"2022-04-28T14:39:27.571693+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613450+0000","last_change":"2022-04-28T14:39:13.608696+0000","last_active":"2022-04-28T14:39:26.613450+0000","last_peered":"2022-04-28T14:39:26.613450+0000","last_clean":"2022-04-28T14:39:26.613450+0000","last_became_active":"2022-04-28T14:39:13.608335+0000","last_became_peered":"2022-04-28T14:39:13.608335+0000","last_unstale":"2022-04-28T14:39:26.613450+0000","last_undegraded":"2022-04-28T14:39:26.613450+0000","last_fullsized":"2022-04-28T14:39:26.613450+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571286+0000","last_change":"2022-04-28T14:39:13.959179+0000","last_active":"2022-04-28T14:39:27.571286+0000","last_peered":"2022-04-28T14:39:27.571286+0000","last_clean":"2022-04-28T14:39:27.571286+0000","last_became_active":"2022-04-28T14:39:13.958838+0000","last_became_peered":"2022-04-28T14:39:13.958838+0000","last_unstale":"2022-04-28T14:39:27.571286+0000","last_undegraded":"2022-04-28T14:39:27.571286+0000","last_fullsized":"2022-04-28T14:39:27.571286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613402+0000","last_change":"2022-04-28T14:39:13.618291+0000","last_active":"2022-04-28T14:39:26.613402+0000","last_peered":"2022-04-28T14:39:26.613402+0000","last_clean":"2022-04-28T14:39:26.613402+0000","last_became_active":"2022-04-28T14:39:13.617912+0000","last_became_peered":"2022-04-28T14:39:13.617912+0000","last_unstale":"2022-04-28T14:39:26.613402+0000","last_undegraded":"2022-04-28T14:39:26.613402+0000","last_fullsized":"2022-04-28T14:39:26.613402+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472379+0000","last_change":"2022-04-28T14:39:13.966352+0000","last_active":"2022-04-28T14:39:27.472379+0000","last_peered":"2022-04-28T14:39:27.472379+0000","last_clean":"2022-04-28T14:39:27.472379+0000","last_became_active":"2022-04-28T14:39:13.966039+0000","last_became_peered":"2022-04-28T14:39:13.966039+0000","last_unstale":"2022-04-28T14:39:27.472379+0000","last_undegraded":"2022-04-28T14:39:27.472379+0000","last_fullsized":"2022-04-28T14:39:27.472379+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612474+0000","last_change":"2022-04-28T14:39:13.601416+0000","last_active":"2022-04-28T14:39:26.612474+0000","last_peered":"2022-04-28T14:39:26.612474+0000","last_clean":"2022-04-28T14:39:26.612474+0000","last_became_active":"2022-04-28T14:39:13.601028+0000","last_became_peered":"2022-04-28T14:39:13.601028+0000","last_unstale":"2022-04-28T14:39:26.612474+0000","last_undegraded":"2022-04-28T14:39:26.612474+0000","last_fullsized":"2022-04-28T14:39:26.612474+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471411+0000","last_change":"2022-04-28T14:39:13.958313+0000","last_active":"2022-04-28T14:39:27.471411+0000","last_peered":"2022-04-28T14:39:27.471411+0000","last_clean":"2022-04-28T14:39:27.471411+0000","last_became_active":"2022-04-28T14:39:13.956853+0000","last_became_peered":"2022-04-28T14:39:13.956853+0000","last_unstale":"2022-04-28T14:39:27.471411+0000","last_undegraded":"2022-04-28T14:39:27.471411+0000","last_fullsized":"2022-04-28T14:39:27.471411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471645+0000","last_change":"2022-04-28T14:39:13.613340+0000","last_active":"2022-04-28T14:39:27.471645+0000","last_peered":"2022-04-28T14:39:27.471645+0000","last_clean":"2022-04-28T14:39:27.471645+0000","last_became_active":"2022-04-28T14:39:13.612902+0000","last_became_peered":"2022-04-28T14:39:13.612902+0000","last_unstale":"2022-04-28T14:39:27.471645+0000","last_undegraded":"2022-04-28T14:39:27.471645+0000","last_fullsized":"2022-04-28T14:39:27.471645+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471776+0000","last_change":"2022-04-28T14:39:13.966772+0000","last_active":"2022-04-28T14:39:27.471776+0000","last_peered":"2022-04-28T14:39:27.471776+0000","last_clean":"2022-04-28T14:39:27.471776+0000","last_became_active":"2022-04-28T14:39:13.961393+0000","last_became_peered":"2022-04-28T14:39:13.961393+0000","last_unstale":"2022-04-28T14:39:27.471776+0000","last_undegraded":"2022-04-28T14:39:27.471776+0000","last_fullsized":"2022-04-28T14:39:27.471776+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612943+0000","last_change":"2022-04-28T14:39:13.619825+0000","last_active":"2022-04-28T14:39:26.612943+0000","last_peered":"2022-04-28T14:39:26.612943+0000","last_clean":"2022-04-28T14:39:26.612943+0000","last_became_active":"2022-04-28T14:39:13.619514+0000","last_became_peered":"2022-04-28T14:39:13.619514+0000","last_unstale":"2022-04-28T14:39:26.612943+0000","last_undegraded":"2022-04-28T14:39:26.612943+0000","last_fullsized":"2022-04-28T14:39:26.612943+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472086+0000","last_change":"2022-04-28T14:39:13.956243+0000","last_active":"2022-04-28T14:39:27.472086+0000","last_peered":"2022-04-28T14:39:27.472086+0000","last_clean":"2022-04-28T14:39:27.472086+0000","last_became_active":"2022-04-28T14:39:13.955924+0000","last_became_peered":"2022-04-28T14:39:13.955924+0000","last_unstale":"2022-04-28T14:39:27.472086+0000","last_undegraded":"2022-04-28T14:39:27.472086+0000","last_fullsized":"2022-04-28T14:39:27.472086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"16'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612191+0000","last_change":"2022-04-28T14:39:13.607250+0000","last_active":"2022-04-28T14:39:26.612191+0000","last_peered":"2022-04-28T14:39:26.612191+0000","last_clean":"2022-04-28T14:39:26.612191+0000","last_became_active":"2022-04-28T14:39:13.606892+0000","last_became_peered":"2022-04-28T14:39:13.606892+0000","last_unstale":"2022-04-28T14:39:26.612191+0000","last_undegraded":"2022-04-28T14:39:26.612191+0000","last_fullsized":"2022-04-28T14:39:26.612191+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471904+0000","last_change":"2022-04-28T14:39:13.958594+0000","last_active":"2022-04-28T14:39:27.471904+0000","last_peered":"2022-04-28T14:39:27.471904+0000","last_clean":"2022-04-28T14:39:27.471904+0000","last_became_active":"2022-04-28T14:39:13.958234+0000","last_became_peered":"2022-04-28T14:39:13.958234+0000","last_unstale":"2022-04-28T14:39:27.471904+0000","last_undegraded":"2022-04-28T14:39:27.471904+0000","last_fullsized":"2022-04-28T14:39:27.471904+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570712+0000","last_change":"2022-04-28T14:39:13.610919+0000","last_active":"2022-04-28T14:39:27.570712+0000","last_peered":"2022-04-28T14:39:27.570712+0000","last_clean":"2022-04-28T14:39:27.570712+0000","last_became_active":"2022-04-28T14:39:13.610535+0000","last_became_peered":"2022-04-28T14:39:13.610535+0000","last_unstale":"2022-04-28T14:39:27.570712+0000","last_undegraded":"2022-04-28T14:39:27.570712+0000","last_fullsized":"2022-04-28T14:39:27.570712+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2022-04-28T14:41:26.135911+0000","last_change":"2022-04-28T14:41:26.135911+0000","last_active":"2022-04-28T14:41:26.135911+0000","last_peered":"2022-04-28T14:41:26.135911+0000","last_clean":"2022-04-28T14:41:26.135911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2022-04-28T14:41:26.135911+0000","last_undegraded":"2022-04-28T14:41:26.135911+0000","last_fullsized":"2022-04-28T14:41:26.135911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:41:26.135911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:41:26.135911+0000","last_clean_scrub_stamp":"2022-04-28T14:41:26.135911+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472675+0000","last_change":"2022-04-28T14:39:13.968427+0000","last_active":"2022-04-28T14:39:27.472675+0000","last_peered":"2022-04-28T14:39:27.472675+0000","last_clean":"2022-04-28T14:39:27.472675+0000","last_became_active":"2022-04-28T14:39:13.968116+0000","last_became_peered":"2022-04-28T14:39:13.968116+0000","last_unstale":"2022-04-28T14:39:27.472675+0000","last_undegraded":"2022-04-28T14:39:27.472675+0000","last_fullsized":"2022-04-28T14:39:27.472675+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613017+0000","last_change":"2022-04-28T14:39:05.390479+0000","last_active":"2022-04-28T14:39:26.613017+0000","last_peered":"2022-04-28T14:39:26.613017+0000","last_clean":"2022-04-28T14:39:26.613017+0000","last_became_active":"2022-04-28T14:39:05.390111+0000","last_became_peered":"2022-04-28T14:39:05.390111+0000","last_unstale":"2022-04-28T14:39:26.613017+0000","last_undegraded":"2022-04-28T14:39:26.613017+0000","last_fullsized":"2022-04-28T14:39:26.613017+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613887+0000","last_change":"2022-04-28T14:39:13.610156+0000","last_active":"2022-04-28T14:39:26.613887+0000","last_peered":"2022-04-28T14:39:26.613887+0000","last_clean":"2022-04-28T14:39:26.613887+0000","last_became_active":"2022-04-28T14:39:13.609823+0000","last_became_peered":"2022-04-28T14:39:13.609823+0000","last_unstale":"2022-04-28T14:39:26.613887+0000","last_undegraded":"2022-04-28T14:39:26.613887+0000","last_fullsized":"2022-04-28T14:39:26.613887+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571286+0000","last_change":"2022-04-28T14:39:13.952310+0000","last_active":"2022-04-28T14:39:27.571286+0000","last_peered":"2022-04-28T14:39:27.571286+0000","last_clean":"2022-04-28T14:39:27.571286+0000","last_became_active":"2022-04-28T14:39:13.951984+0000","last_became_peered":"2022-04-28T14:39:13.951984+0000","last_unstale":"2022-04-28T14:39:27.571286+0000","last_undegraded":"2022-04-28T14:39:27.571286+0000","last_fullsized":"2022-04-28T14:39:27.571286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471981+0000","last_change":"2022-04-28T14:39:05.388548+0000","last_active":"2022-04-28T14:39:27.471981+0000","last_peered":"2022-04-28T14:39:27.471981+0000","last_clean":"2022-04-28T14:39:27.471981+0000","last_became_active":"2022-04-28T14:39:05.388215+0000","last_became_peered":"2022-04-28T14:39:05.388215+0000","last_unstale":"2022-04-28T14:39:27.471981+0000","last_undegraded":"2022-04-28T14:39:27.471981+0000","last_fullsized":"2022-04-28T14:39:27.471981+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472385+0000","last_change":"2022-04-28T14:39:13.627277+0000","last_active":"2022-04-28T14:39:27.472385+0000","last_peered":"2022-04-28T14:39:27.472385+0000","last_clean":"2022-04-28T14:39:27.472385+0000","last_became_active":"2022-04-28T14:39:13.626883+0000","last_became_peered":"2022-04-28T14:39:13.626883+0000","last_unstale":"2022-04-28T14:39:27.472385+0000","last_undegraded":"2022-04-28T14:39:27.472385+0000","last_fullsized":"2022-04-28T14:39:27.472385+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612915+0000","last_change":"2022-04-28T14:39:05.388784+0000","last_active":"2022-04-28T14:39:26.612915+0000","last_peered":"2022-04-28T14:39:26.612915+0000","last_clean":"2022-04-28T14:39:26.612915+0000","last_became_active":"2022-04-28T14:39:05.388043+0000","last_became_peered":"2022-04-28T14:39:05.388043+0000","last_unstale":"2022-04-28T14:39:26.612915+0000","last_undegraded":"2022-04-28T14:39:26.612915+0000","last_fullsized":"2022-04-28T14:39:26.612915+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471127+0000","last_change":"2022-04-28T14:39:13.622411+0000","last_active":"2022-04-28T14:39:27.471127+0000","last_peered":"2022-04-28T14:39:27.471127+0000","last_clean":"2022-04-28T14:39:27.471127+0000","last_became_active":"2022-04-28T14:39:13.621590+0000","last_became_peered":"2022-04-28T14:39:13.621590+0000","last_unstale":"2022-04-28T14:39:27.471127+0000","last_undegraded":"2022-04-28T14:39:27.471127+0000","last_fullsized":"2022-04-28T14:39:27.471127+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570674+0000","last_change":"2022-04-28T14:39:13.955187+0000","last_active":"2022-04-28T14:39:27.570674+0000","last_peered":"2022-04-28T14:39:27.570674+0000","last_clean":"2022-04-28T14:39:27.570674+0000","last_became_active":"2022-04-28T14:39:13.954831+0000","last_became_peered":"2022-04-28T14:39:13.954831+0000","last_unstale":"2022-04-28T14:39:27.570674+0000","last_undegraded":"2022-04-28T14:39:27.570674+0000","last_fullsized":"2022-04-28T14:39:27.570674+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570547+0000","last_change":"2022-04-28T14:39:05.390881+0000","last_active":"2022-04-28T14:39:27.570547+0000","last_peered":"2022-04-28T14:39:27.570547+0000","last_clean":"2022-04-28T14:39:27.570547+0000","last_became_active":"2022-04-28T14:39:05.390559+0000","last_became_peered":"2022-04-28T14:39:05.390559+0000","last_unstale":"2022-04-28T14:39:27.570547+0000","last_undegraded":"2022-04-28T14:39:27.570547+0000","last_fullsized":"2022-04-28T14:39:27.570547+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"16'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.611802+0000","last_change":"2022-04-28T14:39:13.608628+0000","last_active":"2022-04-28T14:39:26.611802+0000","last_peered":"2022-04-28T14:39:26.611802+0000","last_clean":"2022-04-28T14:39:26.611802+0000","last_became_active":"2022-04-28T14:39:13.608261+0000","last_became_peered":"2022-04-28T14:39:13.608261+0000","last_unstale":"2022-04-28T14:39:26.611802+0000","last_undegraded":"2022-04-28T14:39:26.611802+0000","last_fullsized":"2022-04-28T14:39:26.611802+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.611981+0000","last_change":"2022-04-28T14:39:13.944110+0000","last_active":"2022-04-28T14:39:26.611981+0000","last_peered":"2022-04-28T14:39:26.611981+0000","last_clean":"2022-04-28T14:39:26.611981+0000","last_became_active":"2022-04-28T14:39:13.943780+0000","last_became_peered":"2022-04-28T14:39:13.943780+0000","last_unstale":"2022-04-28T14:39:26.611981+0000","last_undegraded":"2022-04-28T14:39:26.611981+0000","last_fullsized":"2022-04-28T14:39:26.611981+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612264+0000","last_change":"2022-04-28T14:39:05.390962+0000","last_active":"2022-04-28T14:39:26.612264+0000","last_peered":"2022-04-28T14:39:26.612264+0000","last_clean":"2022-04-28T14:39:26.612264+0000","last_became_active":"2022-04-28T14:39:05.390602+0000","last_became_peered":"2022-04-28T14:39:05.390602+0000","last_unstale":"2022-04-28T14:39:26.612264+0000","last_undegraded":"2022-04-28T14:39:26.612264+0000","last_fullsized":"2022-04-28T14:39:26.612264+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:50.546230+0000","last_change":"2022-04-28T14:39:13.614524+0000","last_active":"2022-04-28T14:39:50.546230+0000","last_peered":"2022-04-28T14:39:50.546230+0000","last_clean":"2022-04-28T14:39:50.546230+0000","last_became_active":"2022-04-28T14:39:13.614177+0000","last_became_peered":"2022-04-28T14:39:13.614177+0000","last_unstale":"2022-04-28T14:39:50.546230+0000","last_undegraded":"2022-04-28T14:39:50.546230+0000","last_fullsized":"2022-04-28T14:39:50.546230+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471620+0000","last_change":"2022-04-28T14:39:13.960464+0000","last_active":"2022-04-28T14:39:27.471620+0000","last_peered":"2022-04-28T14:39:27.471620+0000","last_clean":"2022-04-28T14:39:27.471620+0000","last_became_active":"2022-04-28T14:39:13.958817+0000","last_became_peered":"2022-04-28T14:39:13.958817+0000","last_unstale":"2022-04-28T14:39:27.471620+0000","last_undegraded":"2022-04-28T14:39:27.471620+0000","last_fullsized":"2022-04-28T14:39:27.471620+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471425+0000","last_change":"2022-04-28T14:39:05.389329+0000","last_active":"2022-04-28T14:39:27.471425+0000","last_peered":"2022-04-28T14:39:27.471425+0000","last_clean":"2022-04-28T14:39:27.471425+0000","last_became_active":"2022-04-28T14:39:05.389030+0000","last_became_peered":"2022-04-28T14:39:05.389030+0000","last_unstale":"2022-04-28T14:39:27.471425+0000","last_undegraded":"2022-04-28T14:39:27.471425+0000","last_fullsized":"2022-04-28T14:39:27.471425+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471900+0000","last_change":"2022-04-28T14:39:13.624225+0000","last_active":"2022-04-28T14:39:27.471900+0000","last_peered":"2022-04-28T14:39:27.471900+0000","last_clean":"2022-04-28T14:39:27.471900+0000","last_became_active":"2022-04-28T14:39:13.623631+0000","last_became_peered":"2022-04-28T14:39:13.623631+0000","last_unstale":"2022-04-28T14:39:27.471900+0000","last_undegraded":"2022-04-28T14:39:27.471900+0000","last_fullsized":"2022-04-28T14:39:27.471900+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571628+0000","last_change":"2022-04-28T14:39:13.951379+0000","last_active":"2022-04-28T14:39:27.571628+0000","last_peered":"2022-04-28T14:39:27.571628+0000","last_clean":"2022-04-28T14:39:27.571628+0000","last_became_active":"2022-04-28T14:39:13.950657+0000","last_became_peered":"2022-04-28T14:39:13.950657+0000","last_unstale":"2022-04-28T14:39:27.571628+0000","last_undegraded":"2022-04-28T14:39:27.571628+0000","last_fullsized":"2022-04-28T14:39:27.571628+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472646+0000","last_change":"2022-04-28T14:39:05.388553+0000","last_active":"2022-04-28T14:39:27.472646+0000","last_peered":"2022-04-28T14:39:27.472646+0000","last_clean":"2022-04-28T14:39:27.472646+0000","last_became_active":"2022-04-28T14:39:05.388170+0000","last_became_peered":"2022-04-28T14:39:05.388170+0000","last_unstale":"2022-04-28T14:39:27.472646+0000","last_undegraded":"2022-04-28T14:39:27.472646+0000","last_fullsized":"2022-04-28T14:39:27.472646+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472410+0000","last_change":"2022-04-28T14:39:13.627446+0000","last_active":"2022-04-28T14:39:27.472410+0000","last_peered":"2022-04-28T14:39:27.472410+0000","last_clean":"2022-04-28T14:39:27.472410+0000","last_became_active":"2022-04-28T14:39:13.627067+0000","last_became_peered":"2022-04-28T14:39:13.627067+0000","last_unstale":"2022-04-28T14:39:27.472410+0000","last_undegraded":"2022-04-28T14:39:27.472410+0000","last_fullsized":"2022-04-28T14:39:27.472410+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613478+0000","last_change":"2022-04-28T14:39:13.951391+0000","last_active":"2022-04-28T14:39:26.613478+0000","last_peered":"2022-04-28T14:39:26.613478+0000","last_clean":"2022-04-28T14:39:26.613478+0000","last_became_active":"2022-04-28T14:39:13.951063+0000","last_became_peered":"2022-04-28T14:39:13.951063+0000","last_unstale":"2022-04-28T14:39:26.613478+0000","last_undegraded":"2022-04-28T14:39:26.613478+0000","last_fullsized":"2022-04-28T14:39:26.613478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.614095+0000","last_change":"2022-04-28T14:39:05.388412+0000","last_active":"2022-04-28T14:39:26.614095+0000","last_peered":"2022-04-28T14:39:26.614095+0000","last_clean":"2022-04-28T14:39:26.614095+0000","last_became_active":"2022-04-28T14:39:05.388067+0000","last_became_peered":"2022-04-28T14:39:05.388067+0000","last_unstale":"2022-04-28T14:39:26.614095+0000","last_undegraded":"2022-04-28T14:39:26.614095+0000","last_fullsized":"2022-04-28T14:39:26.614095+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613253+0000","last_change":"2022-04-28T14:39:13.609546+0000","last_active":"2022-04-28T14:39:26.613253+0000","last_peered":"2022-04-28T14:39:26.613253+0000","last_clean":"2022-04-28T14:39:26.613253+0000","last_became_active":"2022-04-28T14:39:13.609231+0000","last_became_peered":"2022-04-28T14:39:13.609231+0000","last_unstale":"2022-04-28T14:39:26.613253+0000","last_undegraded":"2022-04-28T14:39:26.613253+0000","last_fullsized":"2022-04-28T14:39:26.613253+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612888+0000","last_change":"2022-04-28T14:39:13.971977+0000","last_active":"2022-04-28T14:39:26.612888+0000","last_peered":"2022-04-28T14:39:26.612888+0000","last_clean":"2022-04-28T14:39:26.612888+0000","last_became_active":"2022-04-28T14:39:13.971343+0000","last_became_peered":"2022-04-28T14:39:13.971343+0000","last_unstale":"2022-04-28T14:39:26.612888+0000","last_undegraded":"2022-04-28T14:39:26.612888+0000","last_fullsized":"2022-04-28T14:39:26.612888+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472466+0000","last_change":"2022-04-28T14:39:13.970909+0000","last_active":"2022-04-28T14:39:27.472466+0000","last_peered":"2022-04-28T14:39:27.472466+0000","last_clean":"2022-04-28T14:39:27.472466+0000","last_became_active":"2022-04-28T14:39:13.970599+0000","last_became_peered":"2022-04-28T14:39:13.970599+0000","last_unstale":"2022-04-28T14:39:27.472466+0000","last_undegraded":"2022-04-28T14:39:27.472466+0000","last_fullsized":"2022-04-28T14:39:27.472466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571554+0000","last_change":"2022-04-28T14:39:13.622383+0000","last_active":"2022-04-28T14:39:27.571554+0000","last_peered":"2022-04-28T14:39:27.571554+0000","last_clean":"2022-04-28T14:39:27.571554+0000","last_became_active":"2022-04-28T14:39:13.620810+0000","last_became_peered":"2022-04-28T14:39:13.620810+0000","last_unstale":"2022-04-28T14:39:27.571554+0000","last_undegraded":"2022-04-28T14:39:27.571554+0000","last_fullsized":"2022-04-28T14:39:27.571554+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613227+0000","last_change":"2022-04-28T14:39:13.951426+0000","last_active":"2022-04-28T14:39:26.613227+0000","last_peered":"2022-04-28T14:39:26.613227+0000","last_clean":"2022-04-28T14:39:26.613227+0000","last_became_active":"2022-04-28T14:39:13.951111+0000","last_became_peered":"2022-04-28T14:39:13.951111+0000","last_unstale":"2022-04-28T14:39:26.613227+0000","last_undegraded":"2022-04-28T14:39:26.613227+0000","last_fullsized":"2022-04-28T14:39:26.613227+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571179+0000","last_change":"2022-04-28T14:39:13.622151+0000","last_active":"2022-04-28T14:39:27.571179+0000","last_peered":"2022-04-28T14:39:27.571179+0000","last_clean":"2022-04-28T14:39:27.571179+0000","last_became_active":"2022-04-28T14:39:13.621812+0000","last_became_peered":"2022-04-28T14:39:13.621812+0000","last_unstale":"2022-04-28T14:39:27.571179+0000","last_undegraded":"2022-04-28T14:39:27.571179+0000","last_fullsized":"2022-04-28T14:39:27.571179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571901+0000","last_change":"2022-04-28T14:39:13.961409+0000","last_active":"2022-04-28T14:39:27.571901+0000","last_peered":"2022-04-28T14:39:27.571901+0000","last_clean":"2022-04-28T14:39:27.571901+0000","last_became_active":"2022-04-28T14:39:13.961034+0000","last_became_peered":"2022-04-28T14:39:13.961034+0000","last_unstale":"2022-04-28T14:39:27.571901+0000","last_undegraded":"2022-04-28T14:39:27.571901+0000","last_fullsized":"2022-04-28T14:39:27.571901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472607+0000","last_change":"2022-04-28T14:39:13.627961+0000","last_active":"2022-04-28T14:39:27.472607+0000","last_peered":"2022-04-28T14:39:27.472607+0000","last_clean":"2022-04-28T14:39:27.472607+0000","last_became_active":"2022-04-28T14:39:13.627595+0000","last_became_peered":"2022-04-28T14:39:13.627595+0000","last_unstale":"2022-04-28T14:39:27.472607+0000","last_undegraded":"2022-04-28T14:39:27.472607+0000","last_fullsized":"2022-04-28T14:39:27.472607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472713+0000","last_change":"2022-04-28T14:39:13.973251+0000","last_active":"2022-04-28T14:39:27.472713+0000","last_peered":"2022-04-28T14:39:27.472713+0000","last_clean":"2022-04-28T14:39:27.472713+0000","last_became_active":"2022-04-28T14:39:13.973008+0000","last_became_peered":"2022-04-28T14:39:13.973008+0000","last_unstale":"2022-04-28T14:39:27.472713+0000","last_undegraded":"2022-04-28T14:39:27.472713+0000","last_fullsized":"2022-04-28T14:39:27.472713+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571685+0000","last_change":"2022-04-28T14:39:13.619997+0000","last_active":"2022-04-28T14:39:27.571685+0000","last_peered":"2022-04-28T14:39:27.571685+0000","last_clean":"2022-04-28T14:39:27.571685+0000","last_became_active":"2022-04-28T14:39:13.619739+0000","last_became_peered":"2022-04-28T14:39:13.619739+0000","last_unstale":"2022-04-28T14:39:27.571685+0000","last_undegraded":"2022-04-28T14:39:27.571685+0000","last_fullsized":"2022-04-28T14:39:27.571685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.611914+0000","last_change":"2022-04-28T14:39:13.944278+0000","last_active":"2022-04-28T14:39:26.611914+0000","last_peered":"2022-04-28T14:39:26.611914+0000","last_clean":"2022-04-28T14:39:26.611914+0000","last_became_active":"2022-04-28T14:39:13.943973+0000","last_became_peered":"2022-04-28T14:39:13.943973+0000","last_unstale":"2022-04-28T14:39:26.611914+0000","last_undegraded":"2022-04-28T14:39:26.611914+0000","last_fullsized":"2022-04-28T14:39:26.611914+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471295+0000","last_change":"2022-04-28T14:39:13.622598+0000","last_active":"2022-04-28T14:39:27.471295+0000","last_peered":"2022-04-28T14:39:27.471295+0000","last_clean":"2022-04-28T14:39:27.471295+0000","last_became_active":"2022-04-28T14:39:13.622080+0000","last_became_peered":"2022-04-28T14:39:13.622080+0000","last_unstale":"2022-04-28T14:39:27.471295+0000","last_undegraded":"2022-04-28T14:39:27.471295+0000","last_fullsized":"2022-04-28T14:39:27.471295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612009+0000","last_change":"2022-04-28T14:39:13.952416+0000","last_active":"2022-04-28T14:39:26.612009+0000","last_peered":"2022-04-28T14:39:26.612009+0000","last_clean":"2022-04-28T14:39:26.612009+0000","last_became_active":"2022-04-28T14:39:13.952100+0000","last_became_peered":"2022-04-28T14:39:13.952100+0000","last_unstale":"2022-04-28T14:39:26.612009+0000","last_undegraded":"2022-04-28T14:39:26.612009+0000","last_fullsized":"2022-04-28T14:39:26.612009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612015+0000","last_change":"2022-04-28T14:39:13.602486+0000","last_active":"2022-04-28T14:39:26.612015+0000","last_peered":"2022-04-28T14:39:26.612015+0000","last_clean":"2022-04-28T14:39:26.612015+0000","last_became_active":"2022-04-28T14:39:13.602105+0000","last_became_peered":"2022-04-28T14:39:13.602105+0000","last_unstale":"2022-04-28T14:39:26.612015+0000","last_undegraded":"2022-04-28T14:39:26.612015+0000","last_fullsized":"2022-04-28T14:39:26.612015+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571440+0000","last_change":"2022-04-28T14:39:13.964624+0000","last_active":"2022-04-28T14:39:27.571440+0000","last_peered":"2022-04-28T14:39:27.571440+0000","last_clean":"2022-04-28T14:39:27.571440+0000","last_became_active":"2022-04-28T14:39:13.964305+0000","last_became_peered":"2022-04-28T14:39:13.964305+0000","last_unstale":"2022-04-28T14:39:27.571440+0000","last_undegraded":"2022-04-28T14:39:27.571440+0000","last_fullsized":"2022-04-28T14:39:27.571440+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472092+0000","last_change":"2022-04-28T14:39:13.624420+0000","last_active":"2022-04-28T14:39:27.472092+0000","last_peered":"2022-04-28T14:39:27.472092+0000","last_clean":"2022-04-28T14:39:27.472092+0000","last_became_active":"2022-04-28T14:39:13.623884+0000","last_became_peered":"2022-04-28T14:39:13.623884+0000","last_unstale":"2022-04-28T14:39:27.472092+0000","last_undegraded":"2022-04-28T14:39:27.472092+0000","last_fullsized":"2022-04-28T14:39:27.472092+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471665+0000","last_change":"2022-04-28T14:39:13.960655+0000","last_active":"2022-04-28T14:39:27.471665+0000","last_peered":"2022-04-28T14:39:27.471665+0000","last_clean":"2022-04-28T14:39:27.471665+0000","last_became_active":"2022-04-28T14:39:13.960060+0000","last_became_peered":"2022-04-28T14:39:13.960060+0000","last_unstale":"2022-04-28T14:39:27.471665+0000","last_undegraded":"2022-04-28T14:39:27.471665+0000","last_fullsized":"2022-04-28T14:39:27.471665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472222+0000","last_change":"2022-04-28T14:39:13.624344+0000","last_active":"2022-04-28T14:39:27.472222+0000","last_peered":"2022-04-28T14:39:27.472222+0000","last_clean":"2022-04-28T14:39:27.472222+0000","last_became_active":"2022-04-28T14:39:13.623843+0000","last_became_peered":"2022-04-28T14:39:13.623843+0000","last_unstale":"2022-04-28T14:39:27.472222+0000","last_undegraded":"2022-04-28T14:39:27.472222+0000","last_fullsized":"2022-04-28T14:39:27.472222+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613691+0000","last_change":"2022-04-28T14:39:13.969259+0000","last_active":"2022-04-28T14:39:26.613691+0000","last_peered":"2022-04-28T14:39:26.613691+0000","last_clean":"2022-04-28T14:39:26.613691+0000","last_became_active":"2022-04-28T14:39:13.968448+0000","last_became_peered":"2022-04-28T14:39:13.968448+0000","last_unstale":"2022-04-28T14:39:26.613691+0000","last_undegraded":"2022-04-28T14:39:26.613691+0000","last_fullsized":"2022-04-28T14:39:26.613691+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613353+0000","last_change":"2022-04-28T14:39:13.609457+0000","last_active":"2022-04-28T14:39:26.613353+0000","last_peered":"2022-04-28T14:39:26.613353+0000","last_clean":"2022-04-28T14:39:26.613353+0000","last_became_active":"2022-04-28T14:39:13.609114+0000","last_became_peered":"2022-04-28T14:39:13.609114+0000","last_unstale":"2022-04-28T14:39:26.613353+0000","last_undegraded":"2022-04-28T14:39:26.613353+0000","last_fullsized":"2022-04-28T14:39:26.613353+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472105+0000","last_change":"2022-04-28T14:39:13.960837+0000","last_active":"2022-04-28T14:39:27.472105+0000","last_peered":"2022-04-28T14:39:27.472105+0000","last_clean":"2022-04-28T14:39:27.472105+0000","last_became_active":"2022-04-28T14:39:13.960511+0000","last_became_peered":"2022-04-28T14:39:13.960511+0000","last_unstale":"2022-04-28T14:39:27.472105+0000","last_undegraded":"2022-04-28T14:39:27.472105+0000","last_fullsized":"2022-04-28T14:39:27.472105+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"16'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613128+0000","last_change":"2022-04-28T14:39:13.600840+0000","last_active":"2022-04-28T14:39:26.613128+0000","last_peered":"2022-04-28T14:39:26.613128+0000","last_clean":"2022-04-28T14:39:26.613128+0000","last_became_active":"2022-04-28T14:39:13.600508+0000","last_became_peered":"2022-04-28T14:39:13.600508+0000","last_unstale":"2022-04-28T14:39:26.613128+0000","last_undegraded":"2022-04-28T14:39:26.613128+0000","last_fullsized":"2022-04-28T14:39:26.613128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472329+0000","last_change":"2022-04-28T14:39:13.968364+0000","last_active":"2022-04-28T14:39:27.472329+0000","last_peered":"2022-04-28T14:39:27.472329+0000","last_clean":"2022-04-28T14:39:27.472329+0000","last_became_active":"2022-04-28T14:39:13.968054+0000","last_became_peered":"2022-04-28T14:39:13.968054+0000","last_unstale":"2022-04-28T14:39:27.472329+0000","last_undegraded":"2022-04-28T14:39:27.472329+0000","last_fullsized":"2022-04-28T14:39:27.472329+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"17'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:40.550820+0000","last_change":"2022-04-28T14:39:13.623080+0000","last_active":"2022-04-28T14:39:40.550820+0000","last_peered":"2022-04-28T14:39:40.550820+0000","last_clean":"2022-04-28T14:39:40.550820+0000","last_became_active":"2022-04-28T14:39:13.622568+0000","last_became_peered":"2022-04-28T14:39:13.622568+0000","last_unstale":"2022-04-28T14:39:40.550820+0000","last_undegraded":"2022-04-28T14:39:40.550820+0000","last_fullsized":"2022-04-28T14:39:40.550820+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613319+0000","last_change":"2022-04-28T14:39:13.972567+0000","last_active":"2022-04-28T14:39:26.613319+0000","last_peered":"2022-04-28T14:39:26.613319+0000","last_clean":"2022-04-28T14:39:26.613319+0000","last_became_active":"2022-04-28T14:39:13.972179+0000","last_became_peered":"2022-04-28T14:39:13.972179+0000","last_unstale":"2022-04-28T14:39:26.613319+0000","last_undegraded":"2022-04-28T14:39:26.613319+0000","last_fullsized":"2022-04-28T14:39:26.613319+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"16'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472542+0000","last_change":"2022-04-28T14:39:13.622222+0000","last_active":"2022-04-28T14:39:27.472542+0000","last_peered":"2022-04-28T14:39:27.472542+0000","last_clean":"2022-04-28T14:39:27.472542+0000","last_became_active":"2022-04-28T14:39:13.621872+0000","last_became_peered":"2022-04-28T14:39:13.621872+0000","last_unstale":"2022-04-28T14:39:27.472542+0000","last_undegraded":"2022-04-28T14:39:27.472542+0000","last_fullsized":"2022-04-28T14:39:27.472542+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471304+0000","last_change":"2022-04-28T14:39:13.958395+0000","last_active":"2022-04-28T14:39:27.471304+0000","last_peered":"2022-04-28T14:39:27.471304+0000","last_clean":"2022-04-28T14:39:27.471304+0000","last_became_active":"2022-04-28T14:39:13.957976+0000","last_became_peered":"2022-04-28T14:39:13.957976+0000","last_unstale":"2022-04-28T14:39:27.471304+0000","last_undegraded":"2022-04-28T14:39:27.471304+0000","last_fullsized":"2022-04-28T14:39:27.471304+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"16'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471453+0000","last_change":"2022-04-28T14:39:13.622467+0000","last_active":"2022-04-28T14:39:27.471453+0000","last_peered":"2022-04-28T14:39:27.471453+0000","last_clean":"2022-04-28T14:39:27.471453+0000","last_became_active":"2022-04-28T14:39:13.621838+0000","last_became_peered":"2022-04-28T14:39:13.621838+0000","last_unstale":"2022-04-28T14:39:27.471453+0000","last_undegraded":"2022-04-28T14:39:27.471453+0000","last_fullsized":"2022-04-28T14:39:27.471453+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471018+0000","last_change":"2022-04-28T14:39:13.958646+0000","last_active":"2022-04-28T14:39:27.471018+0000","last_peered":"2022-04-28T14:39:27.471018+0000","last_clean":"2022-04-28T14:39:27.471018+0000","last_became_active":"2022-04-28T14:39:13.957994+0000","last_became_peered":"2022-04-28T14:39:13.957994+0000","last_unstale":"2022-04-28T14:39:27.471018+0000","last_undegraded":"2022-04-28T14:39:27.471018+0000","last_fullsized":"2022-04-28T14:39:27.471018+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612374+0000","last_change":"2022-04-28T14:39:13.614008+0000","last_active":"2022-04-28T14:39:26.612374+0000","last_peered":"2022-04-28T14:39:26.612374+0000","last_clean":"2022-04-28T14:39:26.612374+0000","last_became_active":"2022-04-28T14:39:13.613702+0000","last_became_peered":"2022-04-28T14:39:13.613702+0000","last_unstale":"2022-04-28T14:39:26.612374+0000","last_undegraded":"2022-04-28T14:39:26.612374+0000","last_fullsized":"2022-04-28T14:39:26.612374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571072+0000","last_change":"2022-04-28T14:39:13.950979+0000","last_active":"2022-04-28T14:39:27.571072+0000","last_peered":"2022-04-28T14:39:27.571072+0000","last_clean":"2022-04-28T14:39:27.571072+0000","last_became_active":"2022-04-28T14:39:13.950168+0000","last_became_peered":"2022-04-28T14:39:13.950168+0000","last_unstale":"2022-04-28T14:39:27.571072+0000","last_undegraded":"2022-04-28T14:39:27.571072+0000","last_fullsized":"2022-04-28T14:39:27.571072+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"17'4","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:45.546484+0000","last_change":"2022-04-28T14:39:13.617031+0000","last_active":"2022-04-28T14:39:45.546484+0000","last_peered":"2022-04-28T14:39:45.546484+0000","last_clean":"2022-04-28T14:39:45.546484+0000","last_became_active":"2022-04-28T14:39:13.615420+0000","last_became_peered":"2022-04-28T14:39:13.615420+0000","last_unstale":"2022-04-28T14:39:45.546484+0000","last_undegraded":"2022-04-28T14:39:45.546484+0000","last_fullsized":"2022-04-28T14:39:45.546484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612834+0000","last_change":"2022-04-28T14:39:13.954485+0000","last_active":"2022-04-28T14:39:26.612834+0000","last_peered":"2022-04-28T14:39:26.612834+0000","last_clean":"2022-04-28T14:39:26.612834+0000","last_became_active":"2022-04-28T14:39:13.954179+0000","last_became_peered":"2022-04-28T14:39:13.954179+0000","last_unstale":"2022-04-28T14:39:26.612834+0000","last_undegraded":"2022-04-28T14:39:26.612834+0000","last_fullsized":"2022-04-28T14:39:26.612834+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"16'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612359+0000","last_change":"2022-04-28T14:39:13.608868+0000","last_active":"2022-04-28T14:39:26.612359+0000","last_peered":"2022-04-28T14:39:26.612359+0000","last_clean":"2022-04-28T14:39:26.612359+0000","last_became_active":"2022-04-28T14:39:13.608590+0000","last_became_peered":"2022-04-28T14:39:13.608590+0000","last_unstale":"2022-04-28T14:39:26.612359+0000","last_undegraded":"2022-04-28T14:39:26.612359+0000","last_fullsized":"2022-04-28T14:39:26.612359+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472296+0000","last_change":"2022-04-28T14:39:13.966189+0000","last_active":"2022-04-28T14:39:27.472296+0000","last_peered":"2022-04-28T14:39:27.472296+0000","last_clean":"2022-04-28T14:39:27.472296+0000","last_became_active":"2022-04-28T14:39:13.965877+0000","last_became_peered":"2022-04-28T14:39:13.965877+0000","last_unstale":"2022-04-28T14:39:27.472296+0000","last_undegraded":"2022-04-28T14:39:27.472296+0000","last_fullsized":"2022-04-28T14:39:27.472296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612075+0000","last_change":"2022-04-28T14:39:13.601488+0000","last_active":"2022-04-28T14:39:26.612075+0000","last_peered":"2022-04-28T14:39:26.612075+0000","last_clean":"2022-04-28T14:39:26.612075+0000","last_became_active":"2022-04-28T14:39:13.601122+0000","last_became_peered":"2022-04-28T14:39:13.601122+0000","last_unstale":"2022-04-28T14:39:26.612075+0000","last_undegraded":"2022-04-28T14:39:26.612075+0000","last_fullsized":"2022-04-28T14:39:26.612075+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571425+0000","last_change":"2022-04-28T14:39:13.951897+0000","last_active":"2022-04-28T14:39:27.571425+0000","last_peered":"2022-04-28T14:39:27.571425+0000","last_clean":"2022-04-28T14:39:27.571425+0000","last_became_active":"2022-04-28T14:39:13.951314+0000","last_became_peered":"2022-04-28T14:39:13.951314+0000","last_unstale":"2022-04-28T14:39:27.571425+0000","last_undegraded":"2022-04-28T14:39:27.571425+0000","last_fullsized":"2022-04-28T14:39:27.571425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472538+0000","last_change":"2022-04-28T14:39:13.615041+0000","last_active":"2022-04-28T14:39:27.472538+0000","last_peered":"2022-04-28T14:39:27.472538+0000","last_clean":"2022-04-28T14:39:27.472538+0000","last_became_active":"2022-04-28T14:39:13.614710+0000","last_became_peered":"2022-04-28T14:39:13.614710+0000","last_unstale":"2022-04-28T14:39:27.472538+0000","last_undegraded":"2022-04-28T14:39:27.472538+0000","last_fullsized":"2022-04-28T14:39:27.472538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472245+0000","last_change":"2022-04-28T14:39:13.971986+0000","last_active":"2022-04-28T14:39:27.472245+0000","last_peered":"2022-04-28T14:39:27.472245+0000","last_clean":"2022-04-28T14:39:27.472245+0000","last_became_active":"2022-04-28T14:39:13.971243+0000","last_became_peered":"2022-04-28T14:39:13.971243+0000","last_unstale":"2022-04-28T14:39:27.472245+0000","last_undegraded":"2022-04-28T14:39:27.472245+0000","last_fullsized":"2022-04-28T14:39:27.472245+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613895+0000","last_change":"2022-04-28T14:39:13.613362+0000","last_active":"2022-04-28T14:39:26.613895+0000","last_peered":"2022-04-28T14:39:26.613895+0000","last_clean":"2022-04-28T14:39:26.613895+0000","last_became_active":"2022-04-28T14:39:13.612969+0000","last_became_peered":"2022-04-28T14:39:13.612969+0000","last_unstale":"2022-04-28T14:39:26.613895+0000","last_undegraded":"2022-04-28T14:39:26.613895+0000","last_fullsized":"2022-04-28T14:39:26.613895+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613381+0000","last_change":"2022-04-28T14:39:13.972552+0000","last_active":"2022-04-28T14:39:26.613381+0000","last_peered":"2022-04-28T14:39:26.613381+0000","last_clean":"2022-04-28T14:39:26.613381+0000","last_became_active":"2022-04-28T14:39:13.970887+0000","last_became_peered":"2022-04-28T14:39:13.970887+0000","last_unstale":"2022-04-28T14:39:26.613381+0000","last_undegraded":"2022-04-28T14:39:26.613381+0000","last_fullsized":"2022-04-28T14:39:26.613381+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472602+0000","last_change":"2022-04-28T14:39:13.628138+0000","last_active":"2022-04-28T14:39:27.472602+0000","last_peered":"2022-04-28T14:39:27.472602+0000","last_clean":"2022-04-28T14:39:27.472602+0000","last_became_active":"2022-04-28T14:39:13.627785+0000","last_became_peered":"2022-04-28T14:39:13.627785+0000","last_unstale":"2022-04-28T14:39:27.472602+0000","last_undegraded":"2022-04-28T14:39:27.472602+0000","last_fullsized":"2022-04-28T14:39:27.472602+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612073+0000","last_change":"2022-04-28T14:39:13.955799+0000","last_active":"2022-04-28T14:39:26.612073+0000","last_peered":"2022-04-28T14:39:26.612073+0000","last_clean":"2022-04-28T14:39:26.612073+0000","last_became_active":"2022-04-28T14:39:13.955495+0000","last_became_peered":"2022-04-28T14:39:13.955495+0000","last_unstale":"2022-04-28T14:39:26.612073+0000","last_undegraded":"2022-04-28T14:39:26.612073+0000","last_fullsized":"2022-04-28T14:39:26.612073+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"16'6","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570489+0000","last_change":"2022-04-28T14:39:13.621432+0000","last_active":"2022-04-28T14:39:27.570489+0000","last_peered":"2022-04-28T14:39:27.570489+0000","last_clean":"2022-04-28T14:39:27.570489+0000","last_became_active":"2022-04-28T14:39:13.621080+0000","last_became_peered":"2022-04-28T14:39:13.621080+0000","last_unstale":"2022-04-28T14:39:27.570489+0000","last_undegraded":"2022-04-28T14:39:27.570489+0000","last_fullsized":"2022-04-28T14:39:27.570489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471173+0000","last_change":"2022-04-28T14:39:13.956112+0000","last_active":"2022-04-28T14:39:27.471173+0000","last_peered":"2022-04-28T14:39:27.471173+0000","last_clean":"2022-04-28T14:39:27.471173+0000","last_became_active":"2022-04-28T14:39:13.955792+0000","last_became_peered":"2022-04-28T14:39:13.955792+0000","last_unstale":"2022-04-28T14:39:27.471173+0000","last_undegraded":"2022-04-28T14:39:27.471173+0000","last_fullsized":"2022-04-28T14:39:27.471173+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570897+0000","last_change":"2022-04-28T14:39:13.622128+0000","last_active":"2022-04-28T14:39:27.570897+0000","last_peered":"2022-04-28T14:39:27.570897+0000","last_clean":"2022-04-28T14:39:27.570897+0000","last_became_active":"2022-04-28T14:39:13.621790+0000","last_became_peered":"2022-04-28T14:39:13.621790+0000","last_unstale":"2022-04-28T14:39:27.570897+0000","last_undegraded":"2022-04-28T14:39:27.570897+0000","last_fullsized":"2022-04-28T14:39:27.570897+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471600+0000","last_change":"2022-04-28T14:39:13.967323+0000","last_active":"2022-04-28T14:39:27.471600+0000","last_peered":"2022-04-28T14:39:27.471600+0000","last_clean":"2022-04-28T14:39:27.471600+0000","last_became_active":"2022-04-28T14:39:13.961173+0000","last_became_peered":"2022-04-28T14:39:13.961173+0000","last_unstale":"2022-04-28T14:39:27.471600+0000","last_undegraded":"2022-04-28T14:39:27.471600+0000","last_fullsized":"2022-04-28T14:39:27.471600+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612260+0000","last_change":"2022-04-28T14:39:13.609625+0000","last_active":"2022-04-28T14:39:26.612260+0000","last_peered":"2022-04-28T14:39:26.612260+0000","last_clean":"2022-04-28T14:39:26.612260+0000","last_became_active":"2022-04-28T14:39:13.609062+0000","last_became_peered":"2022-04-28T14:39:13.609062+0000","last_unstale":"2022-04-28T14:39:26.612260+0000","last_undegraded":"2022-04-28T14:39:26.612260+0000","last_fullsized":"2022-04-28T14:39:26.612260+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571045+0000","last_change":"2022-04-28T14:39:13.963123+0000","last_active":"2022-04-28T14:39:27.571045+0000","last_peered":"2022-04-28T14:39:27.571045+0000","last_clean":"2022-04-28T14:39:27.571045+0000","last_became_active":"2022-04-28T14:39:13.962825+0000","last_became_peered":"2022-04-28T14:39:13.962825+0000","last_unstale":"2022-04-28T14:39:27.571045+0000","last_undegraded":"2022-04-28T14:39:27.571045+0000","last_fullsized":"2022-04-28T14:39:27.571045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613087+0000","last_change":"2022-04-28T14:39:13.603083+0000","last_active":"2022-04-28T14:39:26.613087+0000","last_peered":"2022-04-28T14:39:26.613087+0000","last_clean":"2022-04-28T14:39:26.613087+0000","last_became_active":"2022-04-28T14:39:13.602776+0000","last_became_peered":"2022-04-28T14:39:13.602776+0000","last_unstale":"2022-04-28T14:39:26.613087+0000","last_undegraded":"2022-04-28T14:39:26.613087+0000","last_fullsized":"2022-04-28T14:39:26.613087+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571336+0000","last_change":"2022-04-28T14:39:13.971833+0000","last_active":"2022-04-28T14:39:27.571336+0000","last_peered":"2022-04-28T14:39:27.571336+0000","last_clean":"2022-04-28T14:39:27.571336+0000","last_became_active":"2022-04-28T14:39:13.971513+0000","last_became_peered":"2022-04-28T14:39:13.971513+0000","last_unstale":"2022-04-28T14:39:27.571336+0000","last_undegraded":"2022-04-28T14:39:27.571336+0000","last_fullsized":"2022-04-28T14:39:27.571336+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"18'12","reported_seq":24,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-04-28T14:41:25.225938+0000","last_change":"2022-04-28T14:39:13.619098+0000","last_active":"2022-04-28T14:41:25.225938+0000","last_peered":"2022-04-28T14:41:25.225938+0000","last_clean":"2022-04-28T14:41:25.225938+0000","last_became_active":"2022-04-28T14:39:13.618737+0000","last_became_peered":"2022-04-28T14:39:13.618737+0000","last_unstale":"2022-04-28T14:41:25.225938+0000","last_undegraded":"2022-04-28T14:41:25.225938+0000","last_fullsized":"2022-04-28T14:41:25.225938+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4014,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571857+0000","last_change":"2022-04-28T14:39:13.951611+0000","last_active":"2022-04-28T14:39:27.571857+0000","last_peered":"2022-04-28T14:39:27.571857+0000","last_clean":"2022-04-28T14:39:27.571857+0000","last_became_active":"2022-04-28T14:39:13.951102+0000","last_became_peered":"2022-04-28T14:39:13.951102+0000","last_unstale":"2022-04-28T14:39:27.571857+0000","last_undegraded":"2022-04-28T14:39:27.571857+0000","last_fullsized":"2022-04-28T14:39:27.571857+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613671+0000","last_change":"2022-04-28T14:39:13.618476+0000","last_active":"2022-04-28T14:39:26.613671+0000","last_peered":"2022-04-28T14:39:26.613671+0000","last_clean":"2022-04-28T14:39:26.613671+0000","last_became_active":"2022-04-28T14:39:13.617950+0000","last_became_peered":"2022-04-28T14:39:13.617950+0000","last_unstale":"2022-04-28T14:39:26.613671+0000","last_undegraded":"2022-04-28T14:39:26.613671+0000","last_fullsized":"2022-04-28T14:39:26.613671+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.614162+0000","last_change":"2022-04-28T14:39:13.969503+0000","last_active":"2022-04-28T14:39:26.614162+0000","last_peered":"2022-04-28T14:39:26.614162+0000","last_clean":"2022-04-28T14:39:26.614162+0000","last_became_active":"2022-04-28T14:39:13.969200+0000","last_became_peered":"2022-04-28T14:39:13.969200+0000","last_unstale":"2022-04-28T14:39:26.614162+0000","last_undegraded":"2022-04-28T14:39:26.614162+0000","last_fullsized":"2022-04-28T14:39:26.614162+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"16'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613815+0000","last_change":"2022-04-28T14:39:13.613426+0000","last_active":"2022-04-28T14:39:26.613815+0000","last_peered":"2022-04-28T14:39:26.613815+0000","last_clean":"2022-04-28T14:39:26.613815+0000","last_became_active":"2022-04-28T14:39:13.613077+0000","last_became_peered":"2022-04-28T14:39:13.613077+0000","last_unstale":"2022-04-28T14:39:26.613815+0000","last_undegraded":"2022-04-28T14:39:26.613815+0000","last_fullsized":"2022-04-28T14:39:26.613815+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571525+0000","last_change":"2022-04-28T14:39:13.953772+0000","last_active":"2022-04-28T14:39:27.571525+0000","last_peered":"2022-04-28T14:39:27.571525+0000","last_clean":"2022-04-28T14:39:27.571525+0000","last_became_active":"2022-04-28T14:39:13.953478+0000","last_became_peered":"2022-04-28T14:39:13.953478+0000","last_unstale":"2022-04-28T14:39:27.571525+0000","last_undegraded":"2022-04-28T14:39:27.571525+0000","last_fullsized":"2022-04-28T14:39:27.571525+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571816+0000","last_change":"2022-04-28T14:39:13.606445+0000","last_active":"2022-04-28T14:39:27.571816+0000","last_peered":"2022-04-28T14:39:27.571816+0000","last_clean":"2022-04-28T14:39:27.571816+0000","last_became_active":"2022-04-28T14:39:13.606028+0000","last_became_peered":"2022-04-28T14:39:13.606028+0000","last_unstale":"2022-04-28T14:39:27.571816+0000","last_undegraded":"2022-04-28T14:39:27.571816+0000","last_fullsized":"2022-04-28T14:39:27.571816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570549+0000","last_change":"2022-04-28T14:39:13.951780+0000","last_active":"2022-04-28T14:39:27.570549+0000","last_peered":"2022-04-28T14:39:27.570549+0000","last_clean":"2022-04-28T14:39:27.570549+0000","last_became_active":"2022-04-28T14:39:13.951236+0000","last_became_peered":"2022-04-28T14:39:13.951236+0000","last_unstale":"2022-04-28T14:39:27.570549+0000","last_undegraded":"2022-04-28T14:39:27.570549+0000","last_fullsized":"2022-04-28T14:39:27.570549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"16'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570560+0000","last_change":"2022-04-28T14:39:13.621466+0000","last_active":"2022-04-28T14:39:27.570560+0000","last_peered":"2022-04-28T14:39:27.570560+0000","last_clean":"2022-04-28T14:39:27.570560+0000","last_became_active":"2022-04-28T14:39:13.621146+0000","last_became_peered":"2022-04-28T14:39:13.621146+0000","last_unstale":"2022-04-28T14:39:27.570560+0000","last_undegraded":"2022-04-28T14:39:27.570560+0000","last_fullsized":"2022-04-28T14:39:27.570560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471591+0000","last_change":"2022-04-28T14:39:13.960230+0000","last_active":"2022-04-28T14:39:27.471591+0000","last_peered":"2022-04-28T14:39:27.471591+0000","last_clean":"2022-04-28T14:39:27.471591+0000","last_became_active":"2022-04-28T14:39:13.958741+0000","last_became_peered":"2022-04-28T14:39:13.958741+0000","last_unstale":"2022-04-28T14:39:27.471591+0000","last_undegraded":"2022-04-28T14:39:27.471591+0000","last_fullsized":"2022-04-28T14:39:27.471591+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612287+0000","last_change":"2022-04-28T14:39:13.603448+0000","last_active":"2022-04-28T14:39:26.612287+0000","last_peered":"2022-04-28T14:39:26.612287+0000","last_clean":"2022-04-28T14:39:26.612287+0000","last_became_active":"2022-04-28T14:39:13.603117+0000","last_became_peered":"2022-04-28T14:39:13.603117+0000","last_unstale":"2022-04-28T14:39:26.612287+0000","last_undegraded":"2022-04-28T14:39:26.612287+0000","last_fullsized":"2022-04-28T14:39:26.612287+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570986+0000","last_change":"2022-04-28T14:39:13.951179+0000","last_active":"2022-04-28T14:39:27.570986+0000","last_peered":"2022-04-28T14:39:27.570986+0000","last_clean":"2022-04-28T14:39:27.570986+0000","last_became_active":"2022-04-28T14:39:13.950413+0000","last_became_peered":"2022-04-28T14:39:13.950413+0000","last_unstale":"2022-04-28T14:39:27.570986+0000","last_undegraded":"2022-04-28T14:39:27.570986+0000","last_fullsized":"2022-04-28T14:39:27.570986+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612296+0000","last_change":"2022-04-28T14:39:13.609803+0000","last_active":"2022-04-28T14:39:26.612296+0000","last_peered":"2022-04-28T14:39:26.612296+0000","last_clean":"2022-04-28T14:39:26.612296+0000","last_became_active":"2022-04-28T14:39:13.609320+0000","last_became_peered":"2022-04-28T14:39:13.609320+0000","last_unstale":"2022-04-28T14:39:26.612296+0000","last_undegraded":"2022-04-28T14:39:26.612296+0000","last_fullsized":"2022-04-28T14:39:26.612296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612199+0000","last_change":"2022-04-28T14:39:13.953322+0000","last_active":"2022-04-28T14:39:26.612199+0000","last_peered":"2022-04-28T14:39:26.612199+0000","last_clean":"2022-04-28T14:39:26.612199+0000","last_became_active":"2022-04-28T14:39:13.952997+0000","last_became_peered":"2022-04-28T14:39:13.952997+0000","last_unstale":"2022-04-28T14:39:26.612199+0000","last_undegraded":"2022-04-28T14:39:26.612199+0000","last_fullsized":"2022-04-28T14:39:26.612199+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571203+0000","last_change":"2022-04-28T14:39:13.624451+0000","last_active":"2022-04-28T14:39:27.571203+0000","last_peered":"2022-04-28T14:39:27.571203+0000","last_clean":"2022-04-28T14:39:27.571203+0000","last_became_active":"2022-04-28T14:39:13.624118+0000","last_became_peered":"2022-04-28T14:39:13.624118+0000","last_unstale":"2022-04-28T14:39:27.571203+0000","last_undegraded":"2022-04-28T14:39:27.571203+0000","last_fullsized":"2022-04-28T14:39:27.571203+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571069+0000","last_change":"2022-04-28T14:39:13.956657+0000","last_active":"2022-04-28T14:39:27.571069+0000","last_peered":"2022-04-28T14:39:27.571069+0000","last_clean":"2022-04-28T14:39:27.571069+0000","last_became_active":"2022-04-28T14:39:13.956291+0000","last_became_peered":"2022-04-28T14:39:13.956291+0000","last_unstale":"2022-04-28T14:39:27.571069+0000","last_undegraded":"2022-04-28T14:39:27.571069+0000","last_fullsized":"2022-04-28T14:39:27.571069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571781+0000","last_change":"2022-04-28T14:39:13.621131+0000","last_active":"2022-04-28T14:39:27.571781+0000","last_peered":"2022-04-28T14:39:27.571781+0000","last_clean":"2022-04-28T14:39:27.571781+0000","last_became_active":"2022-04-28T14:39:13.620764+0000","last_became_peered":"2022-04-28T14:39:13.620764+0000","last_unstale":"2022-04-28T14:39:27.571781+0000","last_undegraded":"2022-04-28T14:39:27.571781+0000","last_fullsized":"2022-04-28T14:39:27.571781+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612381+0000","last_change":"2022-04-28T14:39:13.971712+0000","last_active":"2022-04-28T14:39:26.612381+0000","last_peered":"2022-04-28T14:39:26.612381+0000","last_clean":"2022-04-28T14:39:26.612381+0000","last_became_active":"2022-04-28T14:39:13.970627+0000","last_became_peered":"2022-04-28T14:39:13.970627+0000","last_unstale":"2022-04-28T14:39:26.612381+0000","last_undegraded":"2022-04-28T14:39:26.612381+0000","last_fullsized":"2022-04-28T14:39:26.612381+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613501+0000","last_change":"2022-04-28T14:39:13.618500+0000","last_active":"2022-04-28T14:39:26.613501+0000","last_peered":"2022-04-28T14:39:26.613501+0000","last_clean":"2022-04-28T14:39:26.613501+0000","last_became_active":"2022-04-28T14:39:13.618171+0000","last_became_peered":"2022-04-28T14:39:13.618171+0000","last_unstale":"2022-04-28T14:39:26.613501+0000","last_undegraded":"2022-04-28T14:39:26.613501+0000","last_fullsized":"2022-04-28T14:39:26.613501+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571555+0000","last_change":"2022-04-28T14:39:13.966833+0000","last_active":"2022-04-28T14:39:27.571555+0000","last_peered":"2022-04-28T14:39:27.571555+0000","last_clean":"2022-04-28T14:39:27.571555+0000","last_became_active":"2022-04-28T14:39:13.963563+0000","last_became_peered":"2022-04-28T14:39:13.963563+0000","last_unstale":"2022-04-28T14:39:27.571555+0000","last_undegraded":"2022-04-28T14:39:27.571555+0000","last_fullsized":"2022-04-28T14:39:27.571555+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571662+0000","last_change":"2022-04-28T14:39:13.622884+0000","last_active":"2022-04-28T14:39:27.571662+0000","last_peered":"2022-04-28T14:39:27.571662+0000","last_clean":"2022-04-28T14:39:27.571662+0000","last_became_active":"2022-04-28T14:39:13.617005+0000","last_became_peered":"2022-04-28T14:39:13.617005+0000","last_unstale":"2022-04-28T14:39:27.571662+0000","last_undegraded":"2022-04-28T14:39:27.571662+0000","last_fullsized":"2022-04-28T14:39:27.571662+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613813+0000","last_change":"2022-04-28T14:39:13.951972+0000","last_active":"2022-04-28T14:39:26.613813+0000","last_peered":"2022-04-28T14:39:26.613813+0000","last_clean":"2022-04-28T14:39:26.613813+0000","last_became_active":"2022-04-28T14:39:13.951647+0000","last_became_peered":"2022-04-28T14:39:13.951647+0000","last_unstale":"2022-04-28T14:39:26.613813+0000","last_undegraded":"2022-04-28T14:39:26.613813+0000","last_fullsized":"2022-04-28T14:39:26.613813+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.614113+0000","last_change":"2022-04-28T14:39:13.619298+0000","last_active":"2022-04-28T14:39:26.614113+0000","last_peered":"2022-04-28T14:39:26.614113+0000","last_clean":"2022-04-28T14:39:26.614113+0000","last_became_active":"2022-04-28T14:39:13.618948+0000","last_became_peered":"2022-04-28T14:39:13.618948+0000","last_unstale":"2022-04-28T14:39:26.614113+0000","last_undegraded":"2022-04-28T14:39:26.614113+0000","last_fullsized":"2022-04-28T14:39:26.614113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":8344,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":16688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705695,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048772,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323068,"statfs":{"total":96636764160,"available":95562821632,"internally_reserved":1073741824,"allocated":192512,"data_stored":53891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 28 14:41:07 2022","interfaces":[{"interface":"back","average":{"1min":0.26900000000000002,"5min":0.33300000000000002,"15min":0.34300000000000003},"min":{"1min":0.13800000000000001,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.50700000000000001,"5min":0.623,"15min":0.623},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.27300000000000002,"5min":0.33200000000000002,"15min":0.34200000000000003},"min":{"1min":0.16800000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.55100000000000005,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.315}]},{"osd":1,"last update":"Thu Apr 28 14:41:07 2022","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":0.32500000000000001,"15min":0.33200000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.47899999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.28599999999999998,"5min":0.34300000000000003,"15min":0.35299999999999998},"min":{"1min":0.155,"5min":0.155,"15min":0.155},"max":{"1min":0.56200000000000006,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Apr 28 14:41:07 2022","interfaces":[{"interface":"back","average":{"1min":0.29499999999999998,"5min":0.35799999999999998,"15min":0.36799999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.376},{"interface":"front","average":{"1min":0.29499999999999998,"5min":0.36899999999999999,"15min":0.38100000000000001},"min":{"1min":0.16200000000000001,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.54200000000000004,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.32300000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705694,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048760,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323080,"statfs":{"total":96636764160,"available":95562833920,"internally_reserved":1073741824,"allocated":180224,"data_stored":48449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 28 14:41:05 2022","interfaces":[{"interface":"back","average":{"1min":0.249,"5min":0.27200000000000002,"15min":0.27600000000000002},"min":{"1min":0.20300000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.27400000000000002,"5min":0.442,"15min":0.442},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.308,"15min":0.314},"min":{"1min":0.222,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.31,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Apr 28 14:41:05 2022","interfaces":[{"interface":"back","average":{"1min":0.24199999999999999,"5min":0.28599999999999998,"15min":0.29299999999999998},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.33300000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.27000000000000002,"5min":0.314,"15min":0.32100000000000001},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.34000000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Apr 28 14:41:05 2022","interfaces":[{"interface":"back","average":{"1min":0.24099999999999999,"5min":0.28699999999999998,"15min":0.29499999999999998},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.28599999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.308},{"interface":"front","average":{"1min":0.25,"5min":0.311,"15min":0.32100000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.29599999999999999,"5min":0.495,"15min":0.495},"last":0.28999999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705695,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":47885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 28 14:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.24399999999999999,"5min":0.31,"15min":0.32100000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.308,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.191},{"interface":"front","average":{"1min":0.24399999999999999,"5min":0.33200000000000002,"15min":0.34599999999999997},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.32400000000000001,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.20399999999999999}]},{"osd":1,"last update":"Thu Apr 28 14:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.26600000000000001,"5min":0.34200000000000003,"15min":0.35499999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.29799999999999999,"5min":0.629,"15min":0.629},"last":0.25},{"interface":"front","average":{"1min":0.26000000000000001,"5min":0.35099999999999998,"15min":0.36599999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.313,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.224}]},{"osd":3,"last update":"Thu Apr 28 14:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.28399999999999997,"5min":0.38900000000000001,"15min":0.40699999999999997},"min":{"1min":0.24299999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.34599999999999997,"5min":1.325,"15min":1.325},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.26800000000000002,"5min":0.373,"15min":0.39100000000000001},"min":{"1min":0.217,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.32300000000000001,"5min":1.302,"15min":1.302},"last":0.219}]}]},{"osd":0,"up_from":9,"seq":38654705695,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":53985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 28 14:41:01 2022","interfaces":[{"interface":"back","average":{"1min":0.26100000000000001,"5min":0.29299999999999998,"15min":0.29899999999999999},"min":{"1min":0.186,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.43099999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.252,"5min":0.309,"15min":0.31900000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.40500000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Apr 28 14:41:01 2022","interfaces":[{"interface":"back","average":{"1min":0.26400000000000001,"5min":0.33000000000000002,"15min":0.34100000000000003},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.443,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.27400000000000002,"5min":0.32500000000000001,"15min":0.33300000000000002},"min":{"1min":0.22800000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.46200000000000002,"5min":0.497,"15min":0.497},"last":0.318}]},{"osd":3,"last update":"Thu Apr 28 14:41:01 2022","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.34399999999999997,"15min":0.35199999999999998},"min":{"1min":0.222,"5min":0.216,"15min":0.216},"max":{"1min":0.48299999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.27900000000000003,"5min":0.35099999999999998,"15min":0.36299999999999999},"min":{"1min":0.19500000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.48999999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.39900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-04-28T14:41:29.201 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2022-04-28T14:41:29.320 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.313+0000 7fe3ad6f7700 1 Processor -- start 2022-04-28T14:41:29.320 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.313+0000 7fe3ad6f7700 1 -- start start 2022-04-28T14:41:29.320 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.314+0000 7fe3ad6f7700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe3a8063e20 0x7fe3a809cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:29.321 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.314+0000 7fe3ad6f7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe3a8099600 0x7fe3a809b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:29.321 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.314+0000 7fe3ad6f7700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a80639d0 con 0x7fe3a8098180 2022-04-28T14:41:29.321 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.314+0000 7fe3ad6f7700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a8099d00 con 0x7fe3a8099600 2022-04-28T14:41:29.321 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.314+0000 7fe3ad6f7700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a8064200 con 0x7fe3a8063e20 2022-04-28T14:41:29.321 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.314+0000 7fe3a67fc700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe3a8099600 0x7fe3a809b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:29.321 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.314+0000 7fe3a77fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe3a8098180 0x7fe3a813b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39848/0 (socket says 172.21.15.22:39848) 2022-04-28T14:41:29.321 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.314+0000 7fe3a77fe700 1 -- 172.21.15.22:0/2029367171 learned_addr learned my addr 172.21.15.22:0/2029367171 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:41:29.321 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.314+0000 7fe3a6ffd700 1 --2- 172.21.15.22:0/2029367171 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe3a8063e20 0x7fe3a809cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:29.321 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.315+0000 7fe3a6ffd700 1 -- 172.21.15.22:0/2029367171 >> v2:172.21.15.22:3300/0 conn(0x7fe3a8099600 msgr2=0x7fe3a809b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:29.321 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.315+0000 7fe3a6ffd700 1 --2- 172.21.15.22:0/2029367171 >> v2:172.21.15.22:3300/0 conn(0x7fe3a8099600 0x7fe3a809b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:29.322 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.315+0000 7fe3a6ffd700 1 -- 172.21.15.22:0/2029367171 >> v1:172.21.15.22:6789/0 conn(0x7fe3a8098180 legacy=0x7fe3a813b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:29.322 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.315+0000 7fe3a6ffd700 1 -- 172.21.15.22:0/2029367171 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a809b9c0 con 0x7fe3a8063e20 2022-04-28T14:41:29.322 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.315+0000 7fe3a5ffb700 1 -- 172.21.15.22:0/2029367171 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950676759 0 0) 0x7fe3a80639d0 con 0x7fe3a8098180 2022-04-28T14:41:29.322 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.315+0000 7fe3a67fc700 1 --2- 172.21.15.22:0/2029367171 >> v2:172.21.15.22:3300/0 conn(0x7fe3a8099600 0x7fe3a809b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:29.322 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.315+0000 7fe3a6ffd700 1 --2- 172.21.15.22:0/2029367171 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe3a8063e20 0x7fe3a809cea0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fe398009760 tx=0x7fe398009060).ready entity=mon.1 client_cookie=fbd6de34bfd52ec8 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:29.322 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.315+0000 7fe3a5ffb700 1 -- 172.21.15.22:0/2029367171 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39800b590 con 0x7fe3a8063e20 2022-04-28T14:41:29.322 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.315+0000 7fe3a5ffb700 1 -- 172.21.15.22:0/2029367171 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39800b6f0 con 0x7fe3a8063e20 2022-04-28T14:41:29.322 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.315+0000 7fe3a5ffb700 1 -- 172.21.15.22:0/2029367171 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39800ba70 con 0x7fe3a8063e20 2022-04-28T14:41:29.322 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.315+0000 7fe3ad6f7700 1 -- 172.21.15.22:0/2029367171 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe3a8063e20 msgr2=0x7fe3a809cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:29.323 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.315+0000 7fe3ad6f7700 1 --2- 172.21.15.22:0/2029367171 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe3a8063e20 0x7fe3a809cea0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fe398009760 tx=0x7fe398009060).stop 2022-04-28T14:41:29.323 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.315+0000 7fe3ad6f7700 1 -- 172.21.15.22:0/2029367171 shutdown_connections 2022-04-28T14:41:29.323 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.315+0000 7fe3ad6f7700 1 --2- 172.21.15.22:0/2029367171 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe3a8063e20 0x7fe3a809cea0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:29.323 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.315+0000 7fe3ad6f7700 1 --2- 172.21.15.22:0/2029367171 >> v2:172.21.15.22:3300/0 conn(0x7fe3a8099600 0x7fe3a809b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:29.323 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.315+0000 7fe3ad6f7700 1 -- 172.21.15.22:0/2029367171 >> 172.21.15.22:0/2029367171 conn(0x7fe3a80aaf80 msgr2=0x7fe3a80ab390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:29.323 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.315+0000 7fe3ad6f7700 1 -- 172.21.15.22:0/2029367171 shutdown_connections 2022-04-28T14:41:29.323 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.315+0000 7fe3ad6f7700 1 -- 172.21.15.22:0/2029367171 wait complete. 2022-04-28T14:41:29.326 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.316+0000 7fe3ad6f7700 1 Processor -- start 2022-04-28T14:41:29.326 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.317+0000 7fe3ad6f7700 1 -- start start 2022-04-28T14:41:29.326 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.317+0000 7fe3ad6f7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3a8063e20 0x7fe3a8097100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:29.326 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.317+0000 7fe3ad6f7700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe3a8098180 0x7fe3a814b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:29.326 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.317+0000 7fe3ad6f7700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe3a8099600 0x7fe3a8137740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:29.326 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.317+0000 7fe3ad6f7700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a809e9b0 con 0x7fe3a8063e20 2022-04-28T14:41:29.326 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.317+0000 7fe3ad6f7700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a814c270 con 0x7fe3a8099600 2022-04-28T14:41:29.326 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.317+0000 7fe3ad6f7700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a8097b20 con 0x7fe3a8098180 2022-04-28T14:41:29.327 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.317+0000 7fe3a6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3a8063e20 0x7fe3a8097100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:29.327 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.317+0000 7fe3a6ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3a8063e20 0x7fe3a8097100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50454/0 (socket says 172.21.15.22:50454) 2022-04-28T14:41:29.327 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.317+0000 7fe3a6ffd700 1 -- 172.21.15.22:0/3402188435 learned_addr learned my addr 172.21.15.22:0/3402188435 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:29.327 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.317+0000 7fe3a77fe700 1 --2- 172.21.15.22:0/3402188435 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe3a8099600 0x7fe3a8137740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:29.327 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.317+0000 7fe3a67fc700 1 --2- 172.21.15.22:0/3402188435 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe3a8098180 0x7fe3a814b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:29.327 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.317+0000 7fe3a6ffd700 1 -- 172.21.15.22:0/3402188435 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe3a8098180 msgr2=0x7fe3a814b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:29.327 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.317+0000 7fe3a6ffd700 1 --2- 172.21.15.22:0/3402188435 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe3a8098180 0x7fe3a814b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:29.327 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.318+0000 7fe3a6ffd700 1 -- 172.21.15.22:0/3402188435 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe3a8099600 msgr2=0x7fe3a8137740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:29.327 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.318+0000 7fe3a6ffd700 1 --2- 172.21.15.22:0/3402188435 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe3a8099600 0x7fe3a8137740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:29.328 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.318+0000 7fe3a6ffd700 1 -- 172.21.15.22:0/3402188435 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3900092a0 con 0x7fe3a8063e20 2022-04-28T14:41:29.328 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.318+0000 7fe3a6ffd700 1 --2- 172.21.15.22:0/3402188435 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3a8063e20 0x7fe3a8097100 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fe398009e00 tx=0x7fe398017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:29.328 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.318+0000 7fe39effd700 1 -- 172.21.15.22:0/3402188435 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39800b590 con 0x7fe3a8063e20 2022-04-28T14:41:29.328 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.318+0000 7fe39effd700 1 -- 172.21.15.22:0/3402188435 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39800b860 con 0x7fe3a8063e20 2022-04-28T14:41:29.328 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.318+0000 7fe3ad6f7700 1 -- 172.21.15.22:0/3402188435 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3980092a0 con 0x7fe3a8063e20 2022-04-28T14:41:29.328 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.318+0000 7fe39effd700 1 -- 172.21.15.22:0/3402188435 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39801b690 con 0x7fe3a8063e20 2022-04-28T14:41:29.328 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.318+0000 7fe3ad6f7700 1 -- 172.21.15.22:0/3402188435 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a809fff0 con 0x7fe3a8063e20 2022-04-28T14:41:29.328 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.319+0000 7fe39effd700 1 -- 172.21.15.22:0/3402188435 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7fe39800f070 con 0x7fe3a8063e20 2022-04-28T14:41:29.328 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.319+0000 7fe3ad6f7700 1 -- 172.21.15.22:0/3402188435 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a80a01e0 con 0x7fe3a8063e20 2022-04-28T14:41:29.329 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.319+0000 7fe39effd700 1 -- 172.21.15.22:0/3402188435 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7fe398056970 con 0x7fe3a8063e20 2022-04-28T14:41:29.329 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.323+0000 7fe39effd700 1 -- 172.21.15.22:0/3402188435 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7fe39803a7c0 con 0x7fe3a8063e20 2022-04-28T14:41:29.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.510+0000 7fe3ad6f7700 1 -- 172.21.15.22:0/3402188435 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe3a8066da0 con 0x7fe3a8063e20 2022-04-28T14:41:29.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.510+0000 7fe39effd700 1 -- 172.21.15.22:0/3402188435 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1088 (secure 0 0 0) 0x7fe39803a7c0 con 0x7fe3a8063e20 2022-04-28T14:41:29.515 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:41:29.516 INFO:teuthology.orchestra.run.smithi022.stdout:{"fsid":"3047163a-0285-4058-8e05-ce74c6fbb9c5","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":12,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":7,"monmap":{"epoch":2,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":21,"num_osds":4,"num_up_osds":4,"osd_up_since":1651156740,"num_in_osds":4,"osd_in_since":1651156740,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":136},{"state_name":"unknown","count":1}],"num_pgs":137,"num_pools":4,"num_objects":41,"data_bytes":8344,"bytes_used":4295737344,"bytes_avail":382251319296,"bytes_total":386547056640,"unknown_pgs_ratio":0.0072992700152099133,"write_bytes_sec":12985,"read_op_per_sec":0,"write_op_per_sec":32},"fsmap":{"epoch":14,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"c","status":"up:active","gid":4184}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2022-04-28T14:41:06.287360+0000","services":{}},"progress_events":{}} 2022-04-28T14:41:29.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.512+0000 7fe3ad6f7700 1 -- 172.21.15.22:0/3402188435 >> v1:172.21.15.22:6808/92758 conn(0x7fe38c041b00 legacy=0x7fe38c043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:29.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.512+0000 7fe3ad6f7700 1 -- 172.21.15.22:0/3402188435 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3a8063e20 msgr2=0x7fe3a8097100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:29.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.512+0000 7fe3ad6f7700 1 --2- 172.21.15.22:0/3402188435 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3a8063e20 0x7fe3a8097100 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fe398009e00 tx=0x7fe398017000).stop 2022-04-28T14:41:29.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.512+0000 7fe3ad6f7700 1 -- 172.21.15.22:0/3402188435 shutdown_connections 2022-04-28T14:41:29.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.512+0000 7fe3ad6f7700 1 --2- 172.21.15.22:0/3402188435 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe3a8099600 0x7fe3a8137740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:29.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.512+0000 7fe3ad6f7700 1 --2- 172.21.15.22:0/3402188435 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3a8063e20 0x7fe3a8097100 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:29.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.512+0000 7fe3ad6f7700 1 --2- 172.21.15.22:0/3402188435 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe3a8098180 0x7fe3a814b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:29.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.512+0000 7fe3ad6f7700 1 -- 172.21.15.22:0/3402188435 >> 172.21.15.22:0/3402188435 conn(0x7fe3a80aaf80 msgr2=0x7fe3a8062680 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:29.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.512+0000 7fe3ad6f7700 1 -- 172.21.15.22:0/3402188435 shutdown_connections 2022-04-28T14:41:29.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.512+0000 7fe3ad6f7700 1 -- 172.21.15.22:0/3402188435 wait complete. 2022-04-28T14:41:29.528 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2022-04-28T14:41:29.528 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-04-28T14:41:29.646 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.641+0000 7f9a7d06c700 1 Processor -- start 2022-04-28T14:41:29.646 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.641+0000 7f9a7d06c700 1 -- start start 2022-04-28T14:41:29.655 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.642+0000 7f9a7d06c700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9a780a5450 0x7f9a78067010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:29.655 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.642+0000 7f9a7d06c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9a78135740 0x7f9a7813b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:29.655 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.642+0000 7f9a7d06c700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a780a5cd0 con 0x7f9a7813be70 2022-04-28T14:41:29.656 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.642+0000 7f9a7d06c700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a780a5830 con 0x7f9a780a5450 2022-04-28T14:41:29.656 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.642+0000 7f9a7d06c700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7813c350 con 0x7f9a78135740 2022-04-28T14:41:29.656 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.642+0000 7f9a7659c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9a78135740 0x7f9a7813b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:29.656 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.642+0000 7f9a7659c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9a78135740 0x7f9a7813b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:47814/0 (socket says 172.21.15.22:47814) 2022-04-28T14:41:29.656 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.642+0000 7f9a7659c700 1 -- 172.21.15.22:0/1515923424 learned_addr learned my addr 172.21.15.22:0/1515923424 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:29.657 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.642+0000 7f9a76d9d700 1 --2- 172.21.15.22:0/1515923424 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9a780a5450 0x7f9a78067010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:29.657 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.642+0000 7f9a7659c700 1 -- 172.21.15.22:0/1515923424 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9a780a5450 msgr2=0x7f9a78067010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:29.657 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.642+0000 7f9a7659c700 1 --2- 172.21.15.22:0/1515923424 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9a780a5450 0x7f9a78067010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:29.657 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.642+0000 7f9a7659c700 1 -- 172.21.15.22:0/1515923424 >> v1:172.21.15.22:6789/0 conn(0x7f9a7813be70 legacy=0x7f9a781381e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:29.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.642+0000 7f9a7659c700 1 -- 172.21.15.22:0/1515923424 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7813c5f0 con 0x7f9a78135740 2022-04-28T14:41:29.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.642+0000 7f9a75d9b700 1 -- 172.21.15.22:0/1515923424 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 83260997 0 0) 0x7f9a780a5cd0 con 0x7f9a7813be70 2022-04-28T14:41:29.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.642+0000 7f9a76d9d700 1 --2- 172.21.15.22:0/1515923424 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9a780a5450 0x7f9a78067010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:29.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.642+0000 7f9a7659c700 1 --2- 172.21.15.22:0/1515923424 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9a78135740 0x7f9a7813b980 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f9a68009830 tx=0x7f9a680090f0).ready entity=mon.2 client_cookie=930bec219b4b528 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:29.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.642+0000 7f9a75d9b700 1 -- 172.21.15.22:0/1515923424 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6800b580 con 0x7f9a78135740 2022-04-28T14:41:29.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.642+0000 7f9a75d9b700 1 -- 172.21.15.22:0/1515923424 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6800b6e0 con 0x7f9a78135740 2022-04-28T14:41:29.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.642+0000 7f9a75d9b700 1 -- 172.21.15.22:0/1515923424 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6800ba60 con 0x7f9a78135740 2022-04-28T14:41:29.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.643+0000 7f9a7d06c700 1 -- 172.21.15.22:0/1515923424 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9a78135740 msgr2=0x7f9a7813b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:29.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.643+0000 7f9a7d06c700 1 --2- 172.21.15.22:0/1515923424 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9a78135740 0x7f9a7813b980 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f9a68009830 tx=0x7f9a680090f0).stop 2022-04-28T14:41:29.660 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.643+0000 7f9a7d06c700 1 -- 172.21.15.22:0/1515923424 shutdown_connections 2022-04-28T14:41:29.660 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.643+0000 7f9a7d06c700 1 --2- 172.21.15.22:0/1515923424 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9a780a5450 0x7f9a78067010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:29.660 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.643+0000 7f9a7d06c700 1 --2- 172.21.15.22:0/1515923424 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9a78135740 0x7f9a7813b980 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:29.660 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.643+0000 7f9a7d06c700 1 -- 172.21.15.22:0/1515923424 >> 172.21.15.22:0/1515923424 conn(0x7f9a78069860 msgr2=0x7f9a78069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:29.661 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.643+0000 7f9a7d06c700 1 -- 172.21.15.22:0/1515923424 shutdown_connections 2022-04-28T14:41:29.661 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.643+0000 7f9a7d06c700 1 -- 172.21.15.22:0/1515923424 wait complete. 2022-04-28T14:41:29.661 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.644+0000 7f9a7d06c700 1 Processor -- start 2022-04-28T14:41:29.661 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.644+0000 7f9a7d06c700 1 -- start start 2022-04-28T14:41:29.661 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.645+0000 7f9a7d06c700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9a780a5450 0x7f9a781170b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:29.662 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.645+0000 7f9a7d06c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9a78135740 0x7f9a78114ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:29.662 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.645+0000 7f9a7d06c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a7813be70 0x7f9a7814b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:29.662 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.645+0000 7f9a7d06c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a78116210 con 0x7f9a7813be70 2022-04-28T14:41:29.662 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.645+0000 7f9a7d06c700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a781169d0 con 0x7f9a780a5450 2022-04-28T14:41:29.663 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.645+0000 7f9a7d06c700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a78115950 con 0x7f9a78135740 2022-04-28T14:41:29.663 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.645+0000 7f9a7759e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a7813be70 0x7f9a7814b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:29.663 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.645+0000 7f9a7659c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9a78135740 0x7f9a78114ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:29.663 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.645+0000 7f9a7759e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a7813be70 0x7f9a7814b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50472/0 (socket says 172.21.15.22:50472) 2022-04-28T14:41:29.663 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.645+0000 7f9a7759e700 1 -- 172.21.15.22:0/1462191626 learned_addr learned my addr 172.21.15.22:0/1462191626 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:29.664 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.645+0000 7f9a7659c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9a78135740 0x7f9a78114ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:47822/0 (socket says 172.21.15.22:47822) 2022-04-28T14:41:29.664 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.645+0000 7f9a76d9d700 1 --2- 172.21.15.22:0/1462191626 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9a780a5450 0x7f9a781170b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:29.664 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.645+0000 7f9a7659c700 1 -- 172.21.15.22:0/1462191626 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9a780a5450 msgr2=0x7f9a781170b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:29.664 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.645+0000 7f9a7659c700 1 --2- 172.21.15.22:0/1462191626 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9a780a5450 0x7f9a781170b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:29.665 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.645+0000 7f9a7659c700 1 -- 172.21.15.22:0/1462191626 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a7813be70 msgr2=0x7f9a7814b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:29.665 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.645+0000 7f9a7659c700 1 --2- 172.21.15.22:0/1462191626 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a7813be70 0x7f9a7814b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:29.665 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.645+0000 7f9a7659c700 1 -- 172.21.15.22:0/1462191626 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6c0092a0 con 0x7f9a78135740 2022-04-28T14:41:29.665 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.645+0000 7f9a7759e700 1 --2- 172.21.15.22:0/1462191626 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a7813be70 0x7f9a7814b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:29.666 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.645+0000 7f9a76d9d700 1 --2- 172.21.15.22:0/1462191626 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9a780a5450 0x7f9a781170b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:29.666 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.645+0000 7f9a7659c700 1 --2- 172.21.15.22:0/1462191626 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9a78135740 0x7f9a78114ff0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f9a68014000 tx=0x7f9a68017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:29.666 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.645+0000 7f9a5effd700 1 -- 172.21.15.22:0/1462191626 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a68000bc0 con 0x7f9a78135740 2022-04-28T14:41:29.666 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.646+0000 7f9a5effd700 1 -- 172.21.15.22:0/1462191626 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6800b850 con 0x7f9a78135740 2022-04-28T14:41:29.666 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.646+0000 7f9a7d06c700 1 -- 172.21.15.22:0/1462191626 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a68009370 con 0x7f9a78135740 2022-04-28T14:41:29.667 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.646+0000 7f9a5effd700 1 -- 172.21.15.22:0/1462191626 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a68000d20 con 0x7f9a78135740 2022-04-28T14:41:29.667 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.646+0000 7f9a7d06c700 1 -- 172.21.15.22:0/1462191626 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a78114800 con 0x7f9a78135740 2022-04-28T14:41:29.667 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.646+0000 7f9a5effd700 1 -- 172.21.15.22:0/1462191626 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f9a6802c070 con 0x7f9a78135740 2022-04-28T14:41:29.667 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.646+0000 7f9a7d06c700 1 -- 172.21.15.22:0/1462191626 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a7809f510 con 0x7f9a78135740 2022-04-28T14:41:29.667 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.647+0000 7f9a5effd700 1 -- 172.21.15.22:0/1462191626 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f9a68057210 con 0x7f9a78135740 2022-04-28T14:41:29.668 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.650+0000 7f9a5effd700 1 -- 172.21.15.22:0/1462191626 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f9a68026680 con 0x7f9a78135740 2022-04-28T14:41:29.789 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.784+0000 7f9a7d06c700 1 -- 172.21.15.22:0/1462191626 --> v1:172.21.15.22:6808/92758 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9a78046540 con 0x7f9a58041b00 2022-04-28T14:41:29.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.792+0000 7f9a5effd700 1 -- 172.21.15.22:0/1462191626 <== mgr.14100 v1:172.21.15.22:6808/92758 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+325715 (unknown 2965378022 0 3275540707) 0x7f9a78046540 con 0x7f9a58041b00 2022-04-28T14:41:29.801 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:41:29.804 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.795+0000 7f9a7d06c700 1 -- 172.21.15.22:0/1462191626 >> v1:172.21.15.22:6808/92758 conn(0x7f9a58041b00 legacy=0x7f9a58043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:29.805 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.795+0000 7f9a7d06c700 1 -- 172.21.15.22:0/1462191626 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9a78135740 msgr2=0x7f9a78114ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:29.805 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.795+0000 7f9a7d06c700 1 --2- 172.21.15.22:0/1462191626 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9a78135740 0x7f9a78114ff0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f9a68014000 tx=0x7f9a68017000).stop 2022-04-28T14:41:29.805 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.795+0000 7f9a7d06c700 1 -- 172.21.15.22:0/1462191626 shutdown_connections 2022-04-28T14:41:29.805 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.795+0000 7f9a7d06c700 1 --2- 172.21.15.22:0/1462191626 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a7813be70 0x7f9a7814b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:29.805 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.795+0000 7f9a7d06c700 1 --2- 172.21.15.22:0/1462191626 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9a780a5450 0x7f9a781170b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:29.805 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.795+0000 7f9a7d06c700 1 --2- 172.21.15.22:0/1462191626 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9a78135740 0x7f9a78114ff0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:29.806 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.795+0000 7f9a7d06c700 1 -- 172.21.15.22:0/1462191626 >> 172.21.15.22:0/1462191626 conn(0x7f9a78069860 msgr2=0x7f9a78135010 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:29.806 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.795+0000 7f9a7d06c700 1 -- 172.21.15.22:0/1462191626 shutdown_connections 2022-04-28T14:41:29.806 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:29.795+0000 7f9a7d06c700 1 -- 172.21.15.22:0/1462191626 wait complete. 2022-04-28T14:41:29.806 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2022-04-28T14:41:29.811 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2022-04-28T14:41:29.142054+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8344,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":272,"acting":272,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":272,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":4195056,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292304,"statfs":{"total":386547056640,"available":382251319296,"internally_reserved":4294967296,"allocated":737280,"data_stored":204210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7688,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":96,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.996465"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613045+0000","last_change":"2022-04-28T14:39:13.943418+0000","last_active":"2022-04-28T14:39:26.613045+0000","last_peered":"2022-04-28T14:39:26.613045+0000","last_clean":"2022-04-28T14:39:26.613045+0000","last_became_active":"2022-04-28T14:39:13.943111+0000","last_became_peered":"2022-04-28T14:39:13.943111+0000","last_unstale":"2022-04-28T14:39:26.613045+0000","last_undegraded":"2022-04-28T14:39:26.613045+0000","last_fullsized":"2022-04-28T14:39:26.613045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"17'9","reported_seq":21,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:45.546840+0000","last_change":"2022-04-28T14:39:13.619263+0000","last_active":"2022-04-28T14:39:45.546840+0000","last_peered":"2022-04-28T14:39:45.546840+0000","last_clean":"2022-04-28T14:39:45.546840+0000","last_became_active":"2022-04-28T14:39:13.618911+0000","last_became_peered":"2022-04-28T14:39:13.618911+0000","last_unstale":"2022-04-28T14:39:45.546840+0000","last_undegraded":"2022-04-28T14:39:45.546840+0000","last_fullsized":"2022-04-28T14:39:45.546840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2190,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571479+0000","last_change":"2022-04-28T14:39:13.964730+0000","last_active":"2022-04-28T14:39:27.571479+0000","last_peered":"2022-04-28T14:39:27.571479+0000","last_clean":"2022-04-28T14:39:27.571479+0000","last_became_active":"2022-04-28T14:39:13.964405+0000","last_became_peered":"2022-04-28T14:39:13.964405+0000","last_unstale":"2022-04-28T14:39:27.571479+0000","last_undegraded":"2022-04-28T14:39:27.571479+0000","last_fullsized":"2022-04-28T14:39:27.571479+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472078+0000","last_change":"2022-04-28T14:39:13.611678+0000","last_active":"2022-04-28T14:39:27.472078+0000","last_peered":"2022-04-28T14:39:27.472078+0000","last_clean":"2022-04-28T14:39:27.472078+0000","last_became_active":"2022-04-28T14:39:13.611166+0000","last_became_peered":"2022-04-28T14:39:13.611166+0000","last_unstale":"2022-04-28T14:39:27.472078+0000","last_undegraded":"2022-04-28T14:39:27.472078+0000","last_fullsized":"2022-04-28T14:39:27.472078+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471323+0000","last_change":"2022-04-28T14:39:13.960149+0000","last_active":"2022-04-28T14:39:27.471323+0000","last_peered":"2022-04-28T14:39:27.471323+0000","last_clean":"2022-04-28T14:39:27.471323+0000","last_became_active":"2022-04-28T14:39:13.959509+0000","last_became_peered":"2022-04-28T14:39:13.959509+0000","last_unstale":"2022-04-28T14:39:27.471323+0000","last_undegraded":"2022-04-28T14:39:27.471323+0000","last_fullsized":"2022-04-28T14:39:27.471323+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471488+0000","last_change":"2022-04-28T14:39:13.610970+0000","last_active":"2022-04-28T14:39:27.471488+0000","last_peered":"2022-04-28T14:39:27.471488+0000","last_clean":"2022-04-28T14:39:27.471488+0000","last_became_active":"2022-04-28T14:39:13.610661+0000","last_became_peered":"2022-04-28T14:39:13.610661+0000","last_unstale":"2022-04-28T14:39:27.471488+0000","last_undegraded":"2022-04-28T14:39:27.471488+0000","last_fullsized":"2022-04-28T14:39:27.471488+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612470+0000","last_change":"2022-04-28T14:39:13.963240+0000","last_active":"2022-04-28T14:39:26.612470+0000","last_peered":"2022-04-28T14:39:26.612470+0000","last_clean":"2022-04-28T14:39:26.612470+0000","last_became_active":"2022-04-28T14:39:13.961860+0000","last_became_peered":"2022-04-28T14:39:13.961860+0000","last_unstale":"2022-04-28T14:39:26.612470+0000","last_undegraded":"2022-04-28T14:39:26.612470+0000","last_fullsized":"2022-04-28T14:39:26.612470+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471032+0000","last_change":"2022-04-28T14:39:13.607628+0000","last_active":"2022-04-28T14:39:27.471032+0000","last_peered":"2022-04-28T14:39:27.471032+0000","last_clean":"2022-04-28T14:39:27.471032+0000","last_became_active":"2022-04-28T14:39:13.607234+0000","last_became_peered":"2022-04-28T14:39:13.607234+0000","last_unstale":"2022-04-28T14:39:27.471032+0000","last_undegraded":"2022-04-28T14:39:27.471032+0000","last_fullsized":"2022-04-28T14:39:27.471032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613294+0000","last_change":"2022-04-28T14:39:13.972780+0000","last_active":"2022-04-28T14:39:26.613294+0000","last_peered":"2022-04-28T14:39:26.613294+0000","last_clean":"2022-04-28T14:39:26.613294+0000","last_became_active":"2022-04-28T14:39:13.972189+0000","last_became_peered":"2022-04-28T14:39:13.972189+0000","last_unstale":"2022-04-28T14:39:26.613294+0000","last_undegraded":"2022-04-28T14:39:26.613294+0000","last_fullsized":"2022-04-28T14:39:26.613294+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"17'7","reported_seq":19,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:55.547282+0000","last_change":"2022-04-28T14:39:13.615060+0000","last_active":"2022-04-28T14:39:55.547282+0000","last_peered":"2022-04-28T14:39:55.547282+0000","last_clean":"2022-04-28T14:39:55.547282+0000","last_became_active":"2022-04-28T14:39:13.614686+0000","last_became_peered":"2022-04-28T14:39:13.614686+0000","last_unstale":"2022-04-28T14:39:55.547282+0000","last_undegraded":"2022-04-28T14:39:55.547282+0000","last_fullsized":"2022-04-28T14:39:55.547282+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571597+0000","last_change":"2022-04-28T14:39:13.963855+0000","last_active":"2022-04-28T14:39:27.571597+0000","last_peered":"2022-04-28T14:39:27.571597+0000","last_clean":"2022-04-28T14:39:27.571597+0000","last_became_active":"2022-04-28T14:39:13.963518+0000","last_became_peered":"2022-04-28T14:39:13.963518+0000","last_unstale":"2022-04-28T14:39:27.571597+0000","last_undegraded":"2022-04-28T14:39:27.571597+0000","last_fullsized":"2022-04-28T14:39:27.571597+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571370+0000","last_change":"2022-04-28T14:39:13.623926+0000","last_active":"2022-04-28T14:39:27.571370+0000","last_peered":"2022-04-28T14:39:27.571370+0000","last_clean":"2022-04-28T14:39:27.571370+0000","last_became_active":"2022-04-28T14:39:13.623608+0000","last_became_peered":"2022-04-28T14:39:13.623608+0000","last_unstale":"2022-04-28T14:39:27.571370+0000","last_undegraded":"2022-04-28T14:39:27.571370+0000","last_fullsized":"2022-04-28T14:39:27.571370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471959+0000","last_change":"2022-04-28T14:39:13.968270+0000","last_active":"2022-04-28T14:39:27.471959+0000","last_peered":"2022-04-28T14:39:27.471959+0000","last_clean":"2022-04-28T14:39:27.471959+0000","last_became_active":"2022-04-28T14:39:13.967894+0000","last_became_peered":"2022-04-28T14:39:13.967894+0000","last_unstale":"2022-04-28T14:39:27.471959+0000","last_undegraded":"2022-04-28T14:39:27.471959+0000","last_fullsized":"2022-04-28T14:39:27.471959+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"16'4","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613553+0000","last_change":"2022-04-28T14:39:13.613942+0000","last_active":"2022-04-28T14:39:26.613553+0000","last_peered":"2022-04-28T14:39:26.613553+0000","last_clean":"2022-04-28T14:39:26.613553+0000","last_became_active":"2022-04-28T14:39:13.613151+0000","last_became_peered":"2022-04-28T14:39:13.613151+0000","last_unstale":"2022-04-28T14:39:26.613553+0000","last_undegraded":"2022-04-28T14:39:26.613553+0000","last_fullsized":"2022-04-28T14:39:26.613553+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571448+0000","last_change":"2022-04-28T14:39:13.972010+0000","last_active":"2022-04-28T14:39:27.571448+0000","last_peered":"2022-04-28T14:39:27.571448+0000","last_clean":"2022-04-28T14:39:27.571448+0000","last_became_active":"2022-04-28T14:39:13.971680+0000","last_became_peered":"2022-04-28T14:39:13.971680+0000","last_unstale":"2022-04-28T14:39:27.571448+0000","last_undegraded":"2022-04-28T14:39:27.571448+0000","last_fullsized":"2022-04-28T14:39:27.571448+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"18'4","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-04-28T14:41:24.308238+0000","last_change":"2022-04-28T14:39:13.608578+0000","last_active":"2022-04-28T14:41:24.308238+0000","last_peered":"2022-04-28T14:41:24.308238+0000","last_clean":"2022-04-28T14:41:24.308238+0000","last_became_active":"2022-04-28T14:39:13.608208+0000","last_became_peered":"2022-04-28T14:39:13.608208+0000","last_unstale":"2022-04-28T14:41:24.308238+0000","last_undegraded":"2022-04-28T14:41:24.308238+0000","last_fullsized":"2022-04-28T14:41:24.308238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570627+0000","last_change":"2022-04-28T14:39:13.959741+0000","last_active":"2022-04-28T14:39:27.570627+0000","last_peered":"2022-04-28T14:39:27.570627+0000","last_clean":"2022-04-28T14:39:27.570627+0000","last_became_active":"2022-04-28T14:39:13.959445+0000","last_became_peered":"2022-04-28T14:39:13.959445+0000","last_unstale":"2022-04-28T14:39:27.570627+0000","last_undegraded":"2022-04-28T14:39:27.570627+0000","last_fullsized":"2022-04-28T14:39:27.570627+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571628+0000","last_change":"2022-04-28T14:39:13.615947+0000","last_active":"2022-04-28T14:39:27.571628+0000","last_peered":"2022-04-28T14:39:27.571628+0000","last_clean":"2022-04-28T14:39:27.571628+0000","last_became_active":"2022-04-28T14:39:13.615589+0000","last_became_peered":"2022-04-28T14:39:13.615589+0000","last_unstale":"2022-04-28T14:39:27.571628+0000","last_undegraded":"2022-04-28T14:39:27.571628+0000","last_fullsized":"2022-04-28T14:39:27.571628+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472066+0000","last_change":"2022-04-28T14:39:13.966950+0000","last_active":"2022-04-28T14:39:27.472066+0000","last_peered":"2022-04-28T14:39:27.472066+0000","last_clean":"2022-04-28T14:39:27.472066+0000","last_became_active":"2022-04-28T14:39:13.961621+0000","last_became_peered":"2022-04-28T14:39:13.961621+0000","last_unstale":"2022-04-28T14:39:27.472066+0000","last_undegraded":"2022-04-28T14:39:27.472066+0000","last_fullsized":"2022-04-28T14:39:27.472066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"16'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471758+0000","last_change":"2022-04-28T14:39:13.614233+0000","last_active":"2022-04-28T14:39:27.471758+0000","last_peered":"2022-04-28T14:39:27.471758+0000","last_clean":"2022-04-28T14:39:27.471758+0000","last_became_active":"2022-04-28T14:39:13.613890+0000","last_became_peered":"2022-04-28T14:39:13.613890+0000","last_unstale":"2022-04-28T14:39:27.471758+0000","last_undegraded":"2022-04-28T14:39:27.471758+0000","last_fullsized":"2022-04-28T14:39:27.471758+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612160+0000","last_change":"2022-04-28T14:39:13.953204+0000","last_active":"2022-04-28T14:39:26.612160+0000","last_peered":"2022-04-28T14:39:26.612160+0000","last_clean":"2022-04-28T14:39:26.612160+0000","last_became_active":"2022-04-28T14:39:13.952884+0000","last_became_peered":"2022-04-28T14:39:13.952884+0000","last_unstale":"2022-04-28T14:39:26.612160+0000","last_undegraded":"2022-04-28T14:39:26.612160+0000","last_fullsized":"2022-04-28T14:39:26.612160+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570672+0000","last_change":"2022-04-28T14:39:13.616607+0000","last_active":"2022-04-28T14:39:27.570672+0000","last_peered":"2022-04-28T14:39:27.570672+0000","last_clean":"2022-04-28T14:39:27.570672+0000","last_became_active":"2022-04-28T14:39:13.616264+0000","last_became_peered":"2022-04-28T14:39:13.616264+0000","last_unstale":"2022-04-28T14:39:27.570672+0000","last_undegraded":"2022-04-28T14:39:27.570672+0000","last_fullsized":"2022-04-28T14:39:27.570672+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471370+0000","last_change":"2022-04-28T14:39:13.958559+0000","last_active":"2022-04-28T14:39:27.471370+0000","last_peered":"2022-04-28T14:39:27.471370+0000","last_clean":"2022-04-28T14:39:27.471370+0000","last_became_active":"2022-04-28T14:39:13.958048+0000","last_became_peered":"2022-04-28T14:39:13.958048+0000","last_unstale":"2022-04-28T14:39:27.471370+0000","last_undegraded":"2022-04-28T14:39:27.471370+0000","last_fullsized":"2022-04-28T14:39:27.471370+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.611804+0000","last_change":"2022-04-28T14:39:13.599319+0000","last_active":"2022-04-28T14:39:26.611804+0000","last_peered":"2022-04-28T14:39:26.611804+0000","last_clean":"2022-04-28T14:39:26.611804+0000","last_became_active":"2022-04-28T14:39:13.598926+0000","last_became_peered":"2022-04-28T14:39:13.598926+0000","last_unstale":"2022-04-28T14:39:26.611804+0000","last_undegraded":"2022-04-28T14:39:26.611804+0000","last_fullsized":"2022-04-28T14:39:26.611804+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613237+0000","last_change":"2022-04-28T14:39:13.953566+0000","last_active":"2022-04-28T14:39:26.613237+0000","last_peered":"2022-04-28T14:39:26.613237+0000","last_clean":"2022-04-28T14:39:26.613237+0000","last_became_active":"2022-04-28T14:39:13.953248+0000","last_became_peered":"2022-04-28T14:39:13.953248+0000","last_unstale":"2022-04-28T14:39:26.613237+0000","last_undegraded":"2022-04-28T14:39:26.613237+0000","last_fullsized":"2022-04-28T14:39:26.613237+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571788+0000","last_change":"2022-04-28T14:39:13.621471+0000","last_active":"2022-04-28T14:39:27.571788+0000","last_peered":"2022-04-28T14:39:27.571788+0000","last_clean":"2022-04-28T14:39:27.571788+0000","last_became_active":"2022-04-28T14:39:13.621155+0000","last_became_peered":"2022-04-28T14:39:13.621155+0000","last_unstale":"2022-04-28T14:39:27.571788+0000","last_undegraded":"2022-04-28T14:39:27.571788+0000","last_fullsized":"2022-04-28T14:39:27.571788+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571693+0000","last_change":"2022-04-28T14:39:13.961895+0000","last_active":"2022-04-28T14:39:27.571693+0000","last_peered":"2022-04-28T14:39:27.571693+0000","last_clean":"2022-04-28T14:39:27.571693+0000","last_became_active":"2022-04-28T14:39:13.961160+0000","last_became_peered":"2022-04-28T14:39:13.961160+0000","last_unstale":"2022-04-28T14:39:27.571693+0000","last_undegraded":"2022-04-28T14:39:27.571693+0000","last_fullsized":"2022-04-28T14:39:27.571693+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613450+0000","last_change":"2022-04-28T14:39:13.608696+0000","last_active":"2022-04-28T14:39:26.613450+0000","last_peered":"2022-04-28T14:39:26.613450+0000","last_clean":"2022-04-28T14:39:26.613450+0000","last_became_active":"2022-04-28T14:39:13.608335+0000","last_became_peered":"2022-04-28T14:39:13.608335+0000","last_unstale":"2022-04-28T14:39:26.613450+0000","last_undegraded":"2022-04-28T14:39:26.613450+0000","last_fullsized":"2022-04-28T14:39:26.613450+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571286+0000","last_change":"2022-04-28T14:39:13.959179+0000","last_active":"2022-04-28T14:39:27.571286+0000","last_peered":"2022-04-28T14:39:27.571286+0000","last_clean":"2022-04-28T14:39:27.571286+0000","last_became_active":"2022-04-28T14:39:13.958838+0000","last_became_peered":"2022-04-28T14:39:13.958838+0000","last_unstale":"2022-04-28T14:39:27.571286+0000","last_undegraded":"2022-04-28T14:39:27.571286+0000","last_fullsized":"2022-04-28T14:39:27.571286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613402+0000","last_change":"2022-04-28T14:39:13.618291+0000","last_active":"2022-04-28T14:39:26.613402+0000","last_peered":"2022-04-28T14:39:26.613402+0000","last_clean":"2022-04-28T14:39:26.613402+0000","last_became_active":"2022-04-28T14:39:13.617912+0000","last_became_peered":"2022-04-28T14:39:13.617912+0000","last_unstale":"2022-04-28T14:39:26.613402+0000","last_undegraded":"2022-04-28T14:39:26.613402+0000","last_fullsized":"2022-04-28T14:39:26.613402+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472379+0000","last_change":"2022-04-28T14:39:13.966352+0000","last_active":"2022-04-28T14:39:27.472379+0000","last_peered":"2022-04-28T14:39:27.472379+0000","last_clean":"2022-04-28T14:39:27.472379+0000","last_became_active":"2022-04-28T14:39:13.966039+0000","last_became_peered":"2022-04-28T14:39:13.966039+0000","last_unstale":"2022-04-28T14:39:27.472379+0000","last_undegraded":"2022-04-28T14:39:27.472379+0000","last_fullsized":"2022-04-28T14:39:27.472379+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612474+0000","last_change":"2022-04-28T14:39:13.601416+0000","last_active":"2022-04-28T14:39:26.612474+0000","last_peered":"2022-04-28T14:39:26.612474+0000","last_clean":"2022-04-28T14:39:26.612474+0000","last_became_active":"2022-04-28T14:39:13.601028+0000","last_became_peered":"2022-04-28T14:39:13.601028+0000","last_unstale":"2022-04-28T14:39:26.612474+0000","last_undegraded":"2022-04-28T14:39:26.612474+0000","last_fullsized":"2022-04-28T14:39:26.612474+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471411+0000","last_change":"2022-04-28T14:39:13.958313+0000","last_active":"2022-04-28T14:39:27.471411+0000","last_peered":"2022-04-28T14:39:27.471411+0000","last_clean":"2022-04-28T14:39:27.471411+0000","last_became_active":"2022-04-28T14:39:13.956853+0000","last_became_peered":"2022-04-28T14:39:13.956853+0000","last_unstale":"2022-04-28T14:39:27.471411+0000","last_undegraded":"2022-04-28T14:39:27.471411+0000","last_fullsized":"2022-04-28T14:39:27.471411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471645+0000","last_change":"2022-04-28T14:39:13.613340+0000","last_active":"2022-04-28T14:39:27.471645+0000","last_peered":"2022-04-28T14:39:27.471645+0000","last_clean":"2022-04-28T14:39:27.471645+0000","last_became_active":"2022-04-28T14:39:13.612902+0000","last_became_peered":"2022-04-28T14:39:13.612902+0000","last_unstale":"2022-04-28T14:39:27.471645+0000","last_undegraded":"2022-04-28T14:39:27.471645+0000","last_fullsized":"2022-04-28T14:39:27.471645+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471776+0000","last_change":"2022-04-28T14:39:13.966772+0000","last_active":"2022-04-28T14:39:27.471776+0000","last_peered":"2022-04-28T14:39:27.471776+0000","last_clean":"2022-04-28T14:39:27.471776+0000","last_became_active":"2022-04-28T14:39:13.961393+0000","last_became_peered":"2022-04-28T14:39:13.961393+0000","last_unstale":"2022-04-28T14:39:27.471776+0000","last_undegraded":"2022-04-28T14:39:27.471776+0000","last_fullsized":"2022-04-28T14:39:27.471776+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612943+0000","last_change":"2022-04-28T14:39:13.619825+0000","last_active":"2022-04-28T14:39:26.612943+0000","last_peered":"2022-04-28T14:39:26.612943+0000","last_clean":"2022-04-28T14:39:26.612943+0000","last_became_active":"2022-04-28T14:39:13.619514+0000","last_became_peered":"2022-04-28T14:39:13.619514+0000","last_unstale":"2022-04-28T14:39:26.612943+0000","last_undegraded":"2022-04-28T14:39:26.612943+0000","last_fullsized":"2022-04-28T14:39:26.612943+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472086+0000","last_change":"2022-04-28T14:39:13.956243+0000","last_active":"2022-04-28T14:39:27.472086+0000","last_peered":"2022-04-28T14:39:27.472086+0000","last_clean":"2022-04-28T14:39:27.472086+0000","last_became_active":"2022-04-28T14:39:13.955924+0000","last_became_peered":"2022-04-28T14:39:13.955924+0000","last_unstale":"2022-04-28T14:39:27.472086+0000","last_undegraded":"2022-04-28T14:39:27.472086+0000","last_fullsized":"2022-04-28T14:39:27.472086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"16'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612191+0000","last_change":"2022-04-28T14:39:13.607250+0000","last_active":"2022-04-28T14:39:26.612191+0000","last_peered":"2022-04-28T14:39:26.612191+0000","last_clean":"2022-04-28T14:39:26.612191+0000","last_became_active":"2022-04-28T14:39:13.606892+0000","last_became_peered":"2022-04-28T14:39:13.606892+0000","last_unstale":"2022-04-28T14:39:26.612191+0000","last_undegraded":"2022-04-28T14:39:26.612191+0000","last_fullsized":"2022-04-28T14:39:26.612191+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471904+0000","last_change":"2022-04-28T14:39:13.958594+0000","last_active":"2022-04-28T14:39:27.471904+0000","last_peered":"2022-04-28T14:39:27.471904+0000","last_clean":"2022-04-28T14:39:27.471904+0000","last_became_active":"2022-04-28T14:39:13.958234+0000","last_became_peered":"2022-04-28T14:39:13.958234+0000","last_unstale":"2022-04-28T14:39:27.471904+0000","last_undegraded":"2022-04-28T14:39:27.471904+0000","last_fullsized":"2022-04-28T14:39:27.471904+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570712+0000","last_change":"2022-04-28T14:39:13.610919+0000","last_active":"2022-04-28T14:39:27.570712+0000","last_peered":"2022-04-28T14:39:27.570712+0000","last_clean":"2022-04-28T14:39:27.570712+0000","last_became_active":"2022-04-28T14:39:13.610535+0000","last_became_peered":"2022-04-28T14:39:13.610535+0000","last_unstale":"2022-04-28T14:39:27.570712+0000","last_undegraded":"2022-04-28T14:39:27.570712+0000","last_fullsized":"2022-04-28T14:39:27.570712+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2022-04-28T14:41:26.135911+0000","last_change":"2022-04-28T14:41:26.135911+0000","last_active":"2022-04-28T14:41:26.135911+0000","last_peered":"2022-04-28T14:41:26.135911+0000","last_clean":"2022-04-28T14:41:26.135911+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2022-04-28T14:41:26.135911+0000","last_undegraded":"2022-04-28T14:41:26.135911+0000","last_fullsized":"2022-04-28T14:41:26.135911+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:41:26.135911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:41:26.135911+0000","last_clean_scrub_stamp":"2022-04-28T14:41:26.135911+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472675+0000","last_change":"2022-04-28T14:39:13.968427+0000","last_active":"2022-04-28T14:39:27.472675+0000","last_peered":"2022-04-28T14:39:27.472675+0000","last_clean":"2022-04-28T14:39:27.472675+0000","last_became_active":"2022-04-28T14:39:13.968116+0000","last_became_peered":"2022-04-28T14:39:13.968116+0000","last_unstale":"2022-04-28T14:39:27.472675+0000","last_undegraded":"2022-04-28T14:39:27.472675+0000","last_fullsized":"2022-04-28T14:39:27.472675+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613017+0000","last_change":"2022-04-28T14:39:05.390479+0000","last_active":"2022-04-28T14:39:26.613017+0000","last_peered":"2022-04-28T14:39:26.613017+0000","last_clean":"2022-04-28T14:39:26.613017+0000","last_became_active":"2022-04-28T14:39:05.390111+0000","last_became_peered":"2022-04-28T14:39:05.390111+0000","last_unstale":"2022-04-28T14:39:26.613017+0000","last_undegraded":"2022-04-28T14:39:26.613017+0000","last_fullsized":"2022-04-28T14:39:26.613017+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613887+0000","last_change":"2022-04-28T14:39:13.610156+0000","last_active":"2022-04-28T14:39:26.613887+0000","last_peered":"2022-04-28T14:39:26.613887+0000","last_clean":"2022-04-28T14:39:26.613887+0000","last_became_active":"2022-04-28T14:39:13.609823+0000","last_became_peered":"2022-04-28T14:39:13.609823+0000","last_unstale":"2022-04-28T14:39:26.613887+0000","last_undegraded":"2022-04-28T14:39:26.613887+0000","last_fullsized":"2022-04-28T14:39:26.613887+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571286+0000","last_change":"2022-04-28T14:39:13.952310+0000","last_active":"2022-04-28T14:39:27.571286+0000","last_peered":"2022-04-28T14:39:27.571286+0000","last_clean":"2022-04-28T14:39:27.571286+0000","last_became_active":"2022-04-28T14:39:13.951984+0000","last_became_peered":"2022-04-28T14:39:13.951984+0000","last_unstale":"2022-04-28T14:39:27.571286+0000","last_undegraded":"2022-04-28T14:39:27.571286+0000","last_fullsized":"2022-04-28T14:39:27.571286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471981+0000","last_change":"2022-04-28T14:39:05.388548+0000","last_active":"2022-04-28T14:39:27.471981+0000","last_peered":"2022-04-28T14:39:27.471981+0000","last_clean":"2022-04-28T14:39:27.471981+0000","last_became_active":"2022-04-28T14:39:05.388215+0000","last_became_peered":"2022-04-28T14:39:05.388215+0000","last_unstale":"2022-04-28T14:39:27.471981+0000","last_undegraded":"2022-04-28T14:39:27.471981+0000","last_fullsized":"2022-04-28T14:39:27.471981+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472385+0000","last_change":"2022-04-28T14:39:13.627277+0000","last_active":"2022-04-28T14:39:27.472385+0000","last_peered":"2022-04-28T14:39:27.472385+0000","last_clean":"2022-04-28T14:39:27.472385+0000","last_became_active":"2022-04-28T14:39:13.626883+0000","last_became_peered":"2022-04-28T14:39:13.626883+0000","last_unstale":"2022-04-28T14:39:27.472385+0000","last_undegraded":"2022-04-28T14:39:27.472385+0000","last_fullsized":"2022-04-28T14:39:27.472385+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612915+0000","last_change":"2022-04-28T14:39:05.388784+0000","last_active":"2022-04-28T14:39:26.612915+0000","last_peered":"2022-04-28T14:39:26.612915+0000","last_clean":"2022-04-28T14:39:26.612915+0000","last_became_active":"2022-04-28T14:39:05.388043+0000","last_became_peered":"2022-04-28T14:39:05.388043+0000","last_unstale":"2022-04-28T14:39:26.612915+0000","last_undegraded":"2022-04-28T14:39:26.612915+0000","last_fullsized":"2022-04-28T14:39:26.612915+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471127+0000","last_change":"2022-04-28T14:39:13.622411+0000","last_active":"2022-04-28T14:39:27.471127+0000","last_peered":"2022-04-28T14:39:27.471127+0000","last_clean":"2022-04-28T14:39:27.471127+0000","last_became_active":"2022-04-28T14:39:13.621590+0000","last_became_peered":"2022-04-28T14:39:13.621590+0000","last_unstale":"2022-04-28T14:39:27.471127+0000","last_undegraded":"2022-04-28T14:39:27.471127+0000","last_fullsized":"2022-04-28T14:39:27.471127+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570674+0000","last_change":"2022-04-28T14:39:13.955187+0000","last_active":"2022-04-28T14:39:27.570674+0000","last_peered":"2022-04-28T14:39:27.570674+0000","last_clean":"2022-04-28T14:39:27.570674+0000","last_became_active":"2022-04-28T14:39:13.954831+0000","last_became_peered":"2022-04-28T14:39:13.954831+0000","last_unstale":"2022-04-28T14:39:27.570674+0000","last_undegraded":"2022-04-28T14:39:27.570674+0000","last_fullsized":"2022-04-28T14:39:27.570674+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570547+0000","last_change":"2022-04-28T14:39:05.390881+0000","last_active":"2022-04-28T14:39:27.570547+0000","last_peered":"2022-04-28T14:39:27.570547+0000","last_clean":"2022-04-28T14:39:27.570547+0000","last_became_active":"2022-04-28T14:39:05.390559+0000","last_became_peered":"2022-04-28T14:39:05.390559+0000","last_unstale":"2022-04-28T14:39:27.570547+0000","last_undegraded":"2022-04-28T14:39:27.570547+0000","last_fullsized":"2022-04-28T14:39:27.570547+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"16'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.611802+0000","last_change":"2022-04-28T14:39:13.608628+0000","last_active":"2022-04-28T14:39:26.611802+0000","last_peered":"2022-04-28T14:39:26.611802+0000","last_clean":"2022-04-28T14:39:26.611802+0000","last_became_active":"2022-04-28T14:39:13.608261+0000","last_became_peered":"2022-04-28T14:39:13.608261+0000","last_unstale":"2022-04-28T14:39:26.611802+0000","last_undegraded":"2022-04-28T14:39:26.611802+0000","last_fullsized":"2022-04-28T14:39:26.611802+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.611981+0000","last_change":"2022-04-28T14:39:13.944110+0000","last_active":"2022-04-28T14:39:26.611981+0000","last_peered":"2022-04-28T14:39:26.611981+0000","last_clean":"2022-04-28T14:39:26.611981+0000","last_became_active":"2022-04-28T14:39:13.943780+0000","last_became_peered":"2022-04-28T14:39:13.943780+0000","last_unstale":"2022-04-28T14:39:26.611981+0000","last_undegraded":"2022-04-28T14:39:26.611981+0000","last_fullsized":"2022-04-28T14:39:26.611981+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612264+0000","last_change":"2022-04-28T14:39:05.390962+0000","last_active":"2022-04-28T14:39:26.612264+0000","last_peered":"2022-04-28T14:39:26.612264+0000","last_clean":"2022-04-28T14:39:26.612264+0000","last_became_active":"2022-04-28T14:39:05.390602+0000","last_became_peered":"2022-04-28T14:39:05.390602+0000","last_unstale":"2022-04-28T14:39:26.612264+0000","last_undegraded":"2022-04-28T14:39:26.612264+0000","last_fullsized":"2022-04-28T14:39:26.612264+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:50.546230+0000","last_change":"2022-04-28T14:39:13.614524+0000","last_active":"2022-04-28T14:39:50.546230+0000","last_peered":"2022-04-28T14:39:50.546230+0000","last_clean":"2022-04-28T14:39:50.546230+0000","last_became_active":"2022-04-28T14:39:13.614177+0000","last_became_peered":"2022-04-28T14:39:13.614177+0000","last_unstale":"2022-04-28T14:39:50.546230+0000","last_undegraded":"2022-04-28T14:39:50.546230+0000","last_fullsized":"2022-04-28T14:39:50.546230+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471620+0000","last_change":"2022-04-28T14:39:13.960464+0000","last_active":"2022-04-28T14:39:27.471620+0000","last_peered":"2022-04-28T14:39:27.471620+0000","last_clean":"2022-04-28T14:39:27.471620+0000","last_became_active":"2022-04-28T14:39:13.958817+0000","last_became_peered":"2022-04-28T14:39:13.958817+0000","last_unstale":"2022-04-28T14:39:27.471620+0000","last_undegraded":"2022-04-28T14:39:27.471620+0000","last_fullsized":"2022-04-28T14:39:27.471620+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471425+0000","last_change":"2022-04-28T14:39:05.389329+0000","last_active":"2022-04-28T14:39:27.471425+0000","last_peered":"2022-04-28T14:39:27.471425+0000","last_clean":"2022-04-28T14:39:27.471425+0000","last_became_active":"2022-04-28T14:39:05.389030+0000","last_became_peered":"2022-04-28T14:39:05.389030+0000","last_unstale":"2022-04-28T14:39:27.471425+0000","last_undegraded":"2022-04-28T14:39:27.471425+0000","last_fullsized":"2022-04-28T14:39:27.471425+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471900+0000","last_change":"2022-04-28T14:39:13.624225+0000","last_active":"2022-04-28T14:39:27.471900+0000","last_peered":"2022-04-28T14:39:27.471900+0000","last_clean":"2022-04-28T14:39:27.471900+0000","last_became_active":"2022-04-28T14:39:13.623631+0000","last_became_peered":"2022-04-28T14:39:13.623631+0000","last_unstale":"2022-04-28T14:39:27.471900+0000","last_undegraded":"2022-04-28T14:39:27.471900+0000","last_fullsized":"2022-04-28T14:39:27.471900+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571628+0000","last_change":"2022-04-28T14:39:13.951379+0000","last_active":"2022-04-28T14:39:27.571628+0000","last_peered":"2022-04-28T14:39:27.571628+0000","last_clean":"2022-04-28T14:39:27.571628+0000","last_became_active":"2022-04-28T14:39:13.950657+0000","last_became_peered":"2022-04-28T14:39:13.950657+0000","last_unstale":"2022-04-28T14:39:27.571628+0000","last_undegraded":"2022-04-28T14:39:27.571628+0000","last_fullsized":"2022-04-28T14:39:27.571628+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472646+0000","last_change":"2022-04-28T14:39:05.388553+0000","last_active":"2022-04-28T14:39:27.472646+0000","last_peered":"2022-04-28T14:39:27.472646+0000","last_clean":"2022-04-28T14:39:27.472646+0000","last_became_active":"2022-04-28T14:39:05.388170+0000","last_became_peered":"2022-04-28T14:39:05.388170+0000","last_unstale":"2022-04-28T14:39:27.472646+0000","last_undegraded":"2022-04-28T14:39:27.472646+0000","last_fullsized":"2022-04-28T14:39:27.472646+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472410+0000","last_change":"2022-04-28T14:39:13.627446+0000","last_active":"2022-04-28T14:39:27.472410+0000","last_peered":"2022-04-28T14:39:27.472410+0000","last_clean":"2022-04-28T14:39:27.472410+0000","last_became_active":"2022-04-28T14:39:13.627067+0000","last_became_peered":"2022-04-28T14:39:13.627067+0000","last_unstale":"2022-04-28T14:39:27.472410+0000","last_undegraded":"2022-04-28T14:39:27.472410+0000","last_fullsized":"2022-04-28T14:39:27.472410+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613478+0000","last_change":"2022-04-28T14:39:13.951391+0000","last_active":"2022-04-28T14:39:26.613478+0000","last_peered":"2022-04-28T14:39:26.613478+0000","last_clean":"2022-04-28T14:39:26.613478+0000","last_became_active":"2022-04-28T14:39:13.951063+0000","last_became_peered":"2022-04-28T14:39:13.951063+0000","last_unstale":"2022-04-28T14:39:26.613478+0000","last_undegraded":"2022-04-28T14:39:26.613478+0000","last_fullsized":"2022-04-28T14:39:26.613478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.614095+0000","last_change":"2022-04-28T14:39:05.388412+0000","last_active":"2022-04-28T14:39:26.614095+0000","last_peered":"2022-04-28T14:39:26.614095+0000","last_clean":"2022-04-28T14:39:26.614095+0000","last_became_active":"2022-04-28T14:39:05.388067+0000","last_became_peered":"2022-04-28T14:39:05.388067+0000","last_unstale":"2022-04-28T14:39:26.614095+0000","last_undegraded":"2022-04-28T14:39:26.614095+0000","last_fullsized":"2022-04-28T14:39:26.614095+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613253+0000","last_change":"2022-04-28T14:39:13.609546+0000","last_active":"2022-04-28T14:39:26.613253+0000","last_peered":"2022-04-28T14:39:26.613253+0000","last_clean":"2022-04-28T14:39:26.613253+0000","last_became_active":"2022-04-28T14:39:13.609231+0000","last_became_peered":"2022-04-28T14:39:13.609231+0000","last_unstale":"2022-04-28T14:39:26.613253+0000","last_undegraded":"2022-04-28T14:39:26.613253+0000","last_fullsized":"2022-04-28T14:39:26.613253+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612888+0000","last_change":"2022-04-28T14:39:13.971977+0000","last_active":"2022-04-28T14:39:26.612888+0000","last_peered":"2022-04-28T14:39:26.612888+0000","last_clean":"2022-04-28T14:39:26.612888+0000","last_became_active":"2022-04-28T14:39:13.971343+0000","last_became_peered":"2022-04-28T14:39:13.971343+0000","last_unstale":"2022-04-28T14:39:26.612888+0000","last_undegraded":"2022-04-28T14:39:26.612888+0000","last_fullsized":"2022-04-28T14:39:26.612888+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472466+0000","last_change":"2022-04-28T14:39:13.970909+0000","last_active":"2022-04-28T14:39:27.472466+0000","last_peered":"2022-04-28T14:39:27.472466+0000","last_clean":"2022-04-28T14:39:27.472466+0000","last_became_active":"2022-04-28T14:39:13.970599+0000","last_became_peered":"2022-04-28T14:39:13.970599+0000","last_unstale":"2022-04-28T14:39:27.472466+0000","last_undegraded":"2022-04-28T14:39:27.472466+0000","last_fullsized":"2022-04-28T14:39:27.472466+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571554+0000","last_change":"2022-04-28T14:39:13.622383+0000","last_active":"2022-04-28T14:39:27.571554+0000","last_peered":"2022-04-28T14:39:27.571554+0000","last_clean":"2022-04-28T14:39:27.571554+0000","last_became_active":"2022-04-28T14:39:13.620810+0000","last_became_peered":"2022-04-28T14:39:13.620810+0000","last_unstale":"2022-04-28T14:39:27.571554+0000","last_undegraded":"2022-04-28T14:39:27.571554+0000","last_fullsized":"2022-04-28T14:39:27.571554+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613227+0000","last_change":"2022-04-28T14:39:13.951426+0000","last_active":"2022-04-28T14:39:26.613227+0000","last_peered":"2022-04-28T14:39:26.613227+0000","last_clean":"2022-04-28T14:39:26.613227+0000","last_became_active":"2022-04-28T14:39:13.951111+0000","last_became_peered":"2022-04-28T14:39:13.951111+0000","last_unstale":"2022-04-28T14:39:26.613227+0000","last_undegraded":"2022-04-28T14:39:26.613227+0000","last_fullsized":"2022-04-28T14:39:26.613227+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571179+0000","last_change":"2022-04-28T14:39:13.622151+0000","last_active":"2022-04-28T14:39:27.571179+0000","last_peered":"2022-04-28T14:39:27.571179+0000","last_clean":"2022-04-28T14:39:27.571179+0000","last_became_active":"2022-04-28T14:39:13.621812+0000","last_became_peered":"2022-04-28T14:39:13.621812+0000","last_unstale":"2022-04-28T14:39:27.571179+0000","last_undegraded":"2022-04-28T14:39:27.571179+0000","last_fullsized":"2022-04-28T14:39:27.571179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571901+0000","last_change":"2022-04-28T14:39:13.961409+0000","last_active":"2022-04-28T14:39:27.571901+0000","last_peered":"2022-04-28T14:39:27.571901+0000","last_clean":"2022-04-28T14:39:27.571901+0000","last_became_active":"2022-04-28T14:39:13.961034+0000","last_became_peered":"2022-04-28T14:39:13.961034+0000","last_unstale":"2022-04-28T14:39:27.571901+0000","last_undegraded":"2022-04-28T14:39:27.571901+0000","last_fullsized":"2022-04-28T14:39:27.571901+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472607+0000","last_change":"2022-04-28T14:39:13.627961+0000","last_active":"2022-04-28T14:39:27.472607+0000","last_peered":"2022-04-28T14:39:27.472607+0000","last_clean":"2022-04-28T14:39:27.472607+0000","last_became_active":"2022-04-28T14:39:13.627595+0000","last_became_peered":"2022-04-28T14:39:13.627595+0000","last_unstale":"2022-04-28T14:39:27.472607+0000","last_undegraded":"2022-04-28T14:39:27.472607+0000","last_fullsized":"2022-04-28T14:39:27.472607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472713+0000","last_change":"2022-04-28T14:39:13.973251+0000","last_active":"2022-04-28T14:39:27.472713+0000","last_peered":"2022-04-28T14:39:27.472713+0000","last_clean":"2022-04-28T14:39:27.472713+0000","last_became_active":"2022-04-28T14:39:13.973008+0000","last_became_peered":"2022-04-28T14:39:13.973008+0000","last_unstale":"2022-04-28T14:39:27.472713+0000","last_undegraded":"2022-04-28T14:39:27.472713+0000","last_fullsized":"2022-04-28T14:39:27.472713+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571685+0000","last_change":"2022-04-28T14:39:13.619997+0000","last_active":"2022-04-28T14:39:27.571685+0000","last_peered":"2022-04-28T14:39:27.571685+0000","last_clean":"2022-04-28T14:39:27.571685+0000","last_became_active":"2022-04-28T14:39:13.619739+0000","last_became_peered":"2022-04-28T14:39:13.619739+0000","last_unstale":"2022-04-28T14:39:27.571685+0000","last_undegraded":"2022-04-28T14:39:27.571685+0000","last_fullsized":"2022-04-28T14:39:27.571685+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.611914+0000","last_change":"2022-04-28T14:39:13.944278+0000","last_active":"2022-04-28T14:39:26.611914+0000","last_peered":"2022-04-28T14:39:26.611914+0000","last_clean":"2022-04-28T14:39:26.611914+0000","last_became_active":"2022-04-28T14:39:13.943973+0000","last_became_peered":"2022-04-28T14:39:13.943973+0000","last_unstale":"2022-04-28T14:39:26.611914+0000","last_undegraded":"2022-04-28T14:39:26.611914+0000","last_fullsized":"2022-04-28T14:39:26.611914+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471295+0000","last_change":"2022-04-28T14:39:13.622598+0000","last_active":"2022-04-28T14:39:27.471295+0000","last_peered":"2022-04-28T14:39:27.471295+0000","last_clean":"2022-04-28T14:39:27.471295+0000","last_became_active":"2022-04-28T14:39:13.622080+0000","last_became_peered":"2022-04-28T14:39:13.622080+0000","last_unstale":"2022-04-28T14:39:27.471295+0000","last_undegraded":"2022-04-28T14:39:27.471295+0000","last_fullsized":"2022-04-28T14:39:27.471295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612009+0000","last_change":"2022-04-28T14:39:13.952416+0000","last_active":"2022-04-28T14:39:26.612009+0000","last_peered":"2022-04-28T14:39:26.612009+0000","last_clean":"2022-04-28T14:39:26.612009+0000","last_became_active":"2022-04-28T14:39:13.952100+0000","last_became_peered":"2022-04-28T14:39:13.952100+0000","last_unstale":"2022-04-28T14:39:26.612009+0000","last_undegraded":"2022-04-28T14:39:26.612009+0000","last_fullsized":"2022-04-28T14:39:26.612009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612015+0000","last_change":"2022-04-28T14:39:13.602486+0000","last_active":"2022-04-28T14:39:26.612015+0000","last_peered":"2022-04-28T14:39:26.612015+0000","last_clean":"2022-04-28T14:39:26.612015+0000","last_became_active":"2022-04-28T14:39:13.602105+0000","last_became_peered":"2022-04-28T14:39:13.602105+0000","last_unstale":"2022-04-28T14:39:26.612015+0000","last_undegraded":"2022-04-28T14:39:26.612015+0000","last_fullsized":"2022-04-28T14:39:26.612015+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571440+0000","last_change":"2022-04-28T14:39:13.964624+0000","last_active":"2022-04-28T14:39:27.571440+0000","last_peered":"2022-04-28T14:39:27.571440+0000","last_clean":"2022-04-28T14:39:27.571440+0000","last_became_active":"2022-04-28T14:39:13.964305+0000","last_became_peered":"2022-04-28T14:39:13.964305+0000","last_unstale":"2022-04-28T14:39:27.571440+0000","last_undegraded":"2022-04-28T14:39:27.571440+0000","last_fullsized":"2022-04-28T14:39:27.571440+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472092+0000","last_change":"2022-04-28T14:39:13.624420+0000","last_active":"2022-04-28T14:39:27.472092+0000","last_peered":"2022-04-28T14:39:27.472092+0000","last_clean":"2022-04-28T14:39:27.472092+0000","last_became_active":"2022-04-28T14:39:13.623884+0000","last_became_peered":"2022-04-28T14:39:13.623884+0000","last_unstale":"2022-04-28T14:39:27.472092+0000","last_undegraded":"2022-04-28T14:39:27.472092+0000","last_fullsized":"2022-04-28T14:39:27.472092+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471665+0000","last_change":"2022-04-28T14:39:13.960655+0000","last_active":"2022-04-28T14:39:27.471665+0000","last_peered":"2022-04-28T14:39:27.471665+0000","last_clean":"2022-04-28T14:39:27.471665+0000","last_became_active":"2022-04-28T14:39:13.960060+0000","last_became_peered":"2022-04-28T14:39:13.960060+0000","last_unstale":"2022-04-28T14:39:27.471665+0000","last_undegraded":"2022-04-28T14:39:27.471665+0000","last_fullsized":"2022-04-28T14:39:27.471665+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472222+0000","last_change":"2022-04-28T14:39:13.624344+0000","last_active":"2022-04-28T14:39:27.472222+0000","last_peered":"2022-04-28T14:39:27.472222+0000","last_clean":"2022-04-28T14:39:27.472222+0000","last_became_active":"2022-04-28T14:39:13.623843+0000","last_became_peered":"2022-04-28T14:39:13.623843+0000","last_unstale":"2022-04-28T14:39:27.472222+0000","last_undegraded":"2022-04-28T14:39:27.472222+0000","last_fullsized":"2022-04-28T14:39:27.472222+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613691+0000","last_change":"2022-04-28T14:39:13.969259+0000","last_active":"2022-04-28T14:39:26.613691+0000","last_peered":"2022-04-28T14:39:26.613691+0000","last_clean":"2022-04-28T14:39:26.613691+0000","last_became_active":"2022-04-28T14:39:13.968448+0000","last_became_peered":"2022-04-28T14:39:13.968448+0000","last_unstale":"2022-04-28T14:39:26.613691+0000","last_undegraded":"2022-04-28T14:39:26.613691+0000","last_fullsized":"2022-04-28T14:39:26.613691+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613353+0000","last_change":"2022-04-28T14:39:13.609457+0000","last_active":"2022-04-28T14:39:26.613353+0000","last_peered":"2022-04-28T14:39:26.613353+0000","last_clean":"2022-04-28T14:39:26.613353+0000","last_became_active":"2022-04-28T14:39:13.609114+0000","last_became_peered":"2022-04-28T14:39:13.609114+0000","last_unstale":"2022-04-28T14:39:26.613353+0000","last_undegraded":"2022-04-28T14:39:26.613353+0000","last_fullsized":"2022-04-28T14:39:26.613353+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472105+0000","last_change":"2022-04-28T14:39:13.960837+0000","last_active":"2022-04-28T14:39:27.472105+0000","last_peered":"2022-04-28T14:39:27.472105+0000","last_clean":"2022-04-28T14:39:27.472105+0000","last_became_active":"2022-04-28T14:39:13.960511+0000","last_became_peered":"2022-04-28T14:39:13.960511+0000","last_unstale":"2022-04-28T14:39:27.472105+0000","last_undegraded":"2022-04-28T14:39:27.472105+0000","last_fullsized":"2022-04-28T14:39:27.472105+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"16'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613128+0000","last_change":"2022-04-28T14:39:13.600840+0000","last_active":"2022-04-28T14:39:26.613128+0000","last_peered":"2022-04-28T14:39:26.613128+0000","last_clean":"2022-04-28T14:39:26.613128+0000","last_became_active":"2022-04-28T14:39:13.600508+0000","last_became_peered":"2022-04-28T14:39:13.600508+0000","last_unstale":"2022-04-28T14:39:26.613128+0000","last_undegraded":"2022-04-28T14:39:26.613128+0000","last_fullsized":"2022-04-28T14:39:26.613128+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472329+0000","last_change":"2022-04-28T14:39:13.968364+0000","last_active":"2022-04-28T14:39:27.472329+0000","last_peered":"2022-04-28T14:39:27.472329+0000","last_clean":"2022-04-28T14:39:27.472329+0000","last_became_active":"2022-04-28T14:39:13.968054+0000","last_became_peered":"2022-04-28T14:39:13.968054+0000","last_unstale":"2022-04-28T14:39:27.472329+0000","last_undegraded":"2022-04-28T14:39:27.472329+0000","last_fullsized":"2022-04-28T14:39:27.472329+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"17'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:40.550820+0000","last_change":"2022-04-28T14:39:13.623080+0000","last_active":"2022-04-28T14:39:40.550820+0000","last_peered":"2022-04-28T14:39:40.550820+0000","last_clean":"2022-04-28T14:39:40.550820+0000","last_became_active":"2022-04-28T14:39:13.622568+0000","last_became_peered":"2022-04-28T14:39:13.622568+0000","last_unstale":"2022-04-28T14:39:40.550820+0000","last_undegraded":"2022-04-28T14:39:40.550820+0000","last_fullsized":"2022-04-28T14:39:40.550820+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613319+0000","last_change":"2022-04-28T14:39:13.972567+0000","last_active":"2022-04-28T14:39:26.613319+0000","last_peered":"2022-04-28T14:39:26.613319+0000","last_clean":"2022-04-28T14:39:26.613319+0000","last_became_active":"2022-04-28T14:39:13.972179+0000","last_became_peered":"2022-04-28T14:39:13.972179+0000","last_unstale":"2022-04-28T14:39:26.613319+0000","last_undegraded":"2022-04-28T14:39:26.613319+0000","last_fullsized":"2022-04-28T14:39:26.613319+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"16'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472542+0000","last_change":"2022-04-28T14:39:13.622222+0000","last_active":"2022-04-28T14:39:27.472542+0000","last_peered":"2022-04-28T14:39:27.472542+0000","last_clean":"2022-04-28T14:39:27.472542+0000","last_became_active":"2022-04-28T14:39:13.621872+0000","last_became_peered":"2022-04-28T14:39:13.621872+0000","last_unstale":"2022-04-28T14:39:27.472542+0000","last_undegraded":"2022-04-28T14:39:27.472542+0000","last_fullsized":"2022-04-28T14:39:27.472542+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471304+0000","last_change":"2022-04-28T14:39:13.958395+0000","last_active":"2022-04-28T14:39:27.471304+0000","last_peered":"2022-04-28T14:39:27.471304+0000","last_clean":"2022-04-28T14:39:27.471304+0000","last_became_active":"2022-04-28T14:39:13.957976+0000","last_became_peered":"2022-04-28T14:39:13.957976+0000","last_unstale":"2022-04-28T14:39:27.471304+0000","last_undegraded":"2022-04-28T14:39:27.471304+0000","last_fullsized":"2022-04-28T14:39:27.471304+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"16'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471453+0000","last_change":"2022-04-28T14:39:13.622467+0000","last_active":"2022-04-28T14:39:27.471453+0000","last_peered":"2022-04-28T14:39:27.471453+0000","last_clean":"2022-04-28T14:39:27.471453+0000","last_became_active":"2022-04-28T14:39:13.621838+0000","last_became_peered":"2022-04-28T14:39:13.621838+0000","last_unstale":"2022-04-28T14:39:27.471453+0000","last_undegraded":"2022-04-28T14:39:27.471453+0000","last_fullsized":"2022-04-28T14:39:27.471453+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471018+0000","last_change":"2022-04-28T14:39:13.958646+0000","last_active":"2022-04-28T14:39:27.471018+0000","last_peered":"2022-04-28T14:39:27.471018+0000","last_clean":"2022-04-28T14:39:27.471018+0000","last_became_active":"2022-04-28T14:39:13.957994+0000","last_became_peered":"2022-04-28T14:39:13.957994+0000","last_unstale":"2022-04-28T14:39:27.471018+0000","last_undegraded":"2022-04-28T14:39:27.471018+0000","last_fullsized":"2022-04-28T14:39:27.471018+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612374+0000","last_change":"2022-04-28T14:39:13.614008+0000","last_active":"2022-04-28T14:39:26.612374+0000","last_peered":"2022-04-28T14:39:26.612374+0000","last_clean":"2022-04-28T14:39:26.612374+0000","last_became_active":"2022-04-28T14:39:13.613702+0000","last_became_peered":"2022-04-28T14:39:13.613702+0000","last_unstale":"2022-04-28T14:39:26.612374+0000","last_undegraded":"2022-04-28T14:39:26.612374+0000","last_fullsized":"2022-04-28T14:39:26.612374+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571072+0000","last_change":"2022-04-28T14:39:13.950979+0000","last_active":"2022-04-28T14:39:27.571072+0000","last_peered":"2022-04-28T14:39:27.571072+0000","last_clean":"2022-04-28T14:39:27.571072+0000","last_became_active":"2022-04-28T14:39:13.950168+0000","last_became_peered":"2022-04-28T14:39:13.950168+0000","last_unstale":"2022-04-28T14:39:27.571072+0000","last_undegraded":"2022-04-28T14:39:27.571072+0000","last_fullsized":"2022-04-28T14:39:27.571072+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"17'4","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:45.546484+0000","last_change":"2022-04-28T14:39:13.617031+0000","last_active":"2022-04-28T14:39:45.546484+0000","last_peered":"2022-04-28T14:39:45.546484+0000","last_clean":"2022-04-28T14:39:45.546484+0000","last_became_active":"2022-04-28T14:39:13.615420+0000","last_became_peered":"2022-04-28T14:39:13.615420+0000","last_unstale":"2022-04-28T14:39:45.546484+0000","last_undegraded":"2022-04-28T14:39:45.546484+0000","last_fullsized":"2022-04-28T14:39:45.546484+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612834+0000","last_change":"2022-04-28T14:39:13.954485+0000","last_active":"2022-04-28T14:39:26.612834+0000","last_peered":"2022-04-28T14:39:26.612834+0000","last_clean":"2022-04-28T14:39:26.612834+0000","last_became_active":"2022-04-28T14:39:13.954179+0000","last_became_peered":"2022-04-28T14:39:13.954179+0000","last_unstale":"2022-04-28T14:39:26.612834+0000","last_undegraded":"2022-04-28T14:39:26.612834+0000","last_fullsized":"2022-04-28T14:39:26.612834+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"16'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612359+0000","last_change":"2022-04-28T14:39:13.608868+0000","last_active":"2022-04-28T14:39:26.612359+0000","last_peered":"2022-04-28T14:39:26.612359+0000","last_clean":"2022-04-28T14:39:26.612359+0000","last_became_active":"2022-04-28T14:39:13.608590+0000","last_became_peered":"2022-04-28T14:39:13.608590+0000","last_unstale":"2022-04-28T14:39:26.612359+0000","last_undegraded":"2022-04-28T14:39:26.612359+0000","last_fullsized":"2022-04-28T14:39:26.612359+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472296+0000","last_change":"2022-04-28T14:39:13.966189+0000","last_active":"2022-04-28T14:39:27.472296+0000","last_peered":"2022-04-28T14:39:27.472296+0000","last_clean":"2022-04-28T14:39:27.472296+0000","last_became_active":"2022-04-28T14:39:13.965877+0000","last_became_peered":"2022-04-28T14:39:13.965877+0000","last_unstale":"2022-04-28T14:39:27.472296+0000","last_undegraded":"2022-04-28T14:39:27.472296+0000","last_fullsized":"2022-04-28T14:39:27.472296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612075+0000","last_change":"2022-04-28T14:39:13.601488+0000","last_active":"2022-04-28T14:39:26.612075+0000","last_peered":"2022-04-28T14:39:26.612075+0000","last_clean":"2022-04-28T14:39:26.612075+0000","last_became_active":"2022-04-28T14:39:13.601122+0000","last_became_peered":"2022-04-28T14:39:13.601122+0000","last_unstale":"2022-04-28T14:39:26.612075+0000","last_undegraded":"2022-04-28T14:39:26.612075+0000","last_fullsized":"2022-04-28T14:39:26.612075+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571425+0000","last_change":"2022-04-28T14:39:13.951897+0000","last_active":"2022-04-28T14:39:27.571425+0000","last_peered":"2022-04-28T14:39:27.571425+0000","last_clean":"2022-04-28T14:39:27.571425+0000","last_became_active":"2022-04-28T14:39:13.951314+0000","last_became_peered":"2022-04-28T14:39:13.951314+0000","last_unstale":"2022-04-28T14:39:27.571425+0000","last_undegraded":"2022-04-28T14:39:27.571425+0000","last_fullsized":"2022-04-28T14:39:27.571425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472538+0000","last_change":"2022-04-28T14:39:13.615041+0000","last_active":"2022-04-28T14:39:27.472538+0000","last_peered":"2022-04-28T14:39:27.472538+0000","last_clean":"2022-04-28T14:39:27.472538+0000","last_became_active":"2022-04-28T14:39:13.614710+0000","last_became_peered":"2022-04-28T14:39:13.614710+0000","last_unstale":"2022-04-28T14:39:27.472538+0000","last_undegraded":"2022-04-28T14:39:27.472538+0000","last_fullsized":"2022-04-28T14:39:27.472538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472245+0000","last_change":"2022-04-28T14:39:13.971986+0000","last_active":"2022-04-28T14:39:27.472245+0000","last_peered":"2022-04-28T14:39:27.472245+0000","last_clean":"2022-04-28T14:39:27.472245+0000","last_became_active":"2022-04-28T14:39:13.971243+0000","last_became_peered":"2022-04-28T14:39:13.971243+0000","last_unstale":"2022-04-28T14:39:27.472245+0000","last_undegraded":"2022-04-28T14:39:27.472245+0000","last_fullsized":"2022-04-28T14:39:27.472245+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613895+0000","last_change":"2022-04-28T14:39:13.613362+0000","last_active":"2022-04-28T14:39:26.613895+0000","last_peered":"2022-04-28T14:39:26.613895+0000","last_clean":"2022-04-28T14:39:26.613895+0000","last_became_active":"2022-04-28T14:39:13.612969+0000","last_became_peered":"2022-04-28T14:39:13.612969+0000","last_unstale":"2022-04-28T14:39:26.613895+0000","last_undegraded":"2022-04-28T14:39:26.613895+0000","last_fullsized":"2022-04-28T14:39:26.613895+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613381+0000","last_change":"2022-04-28T14:39:13.972552+0000","last_active":"2022-04-28T14:39:26.613381+0000","last_peered":"2022-04-28T14:39:26.613381+0000","last_clean":"2022-04-28T14:39:26.613381+0000","last_became_active":"2022-04-28T14:39:13.970887+0000","last_became_peered":"2022-04-28T14:39:13.970887+0000","last_unstale":"2022-04-28T14:39:26.613381+0000","last_undegraded":"2022-04-28T14:39:26.613381+0000","last_fullsized":"2022-04-28T14:39:26.613381+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.472602+0000","last_change":"2022-04-28T14:39:13.628138+0000","last_active":"2022-04-28T14:39:27.472602+0000","last_peered":"2022-04-28T14:39:27.472602+0000","last_clean":"2022-04-28T14:39:27.472602+0000","last_became_active":"2022-04-28T14:39:13.627785+0000","last_became_peered":"2022-04-28T14:39:13.627785+0000","last_unstale":"2022-04-28T14:39:27.472602+0000","last_undegraded":"2022-04-28T14:39:27.472602+0000","last_fullsized":"2022-04-28T14:39:27.472602+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612073+0000","last_change":"2022-04-28T14:39:13.955799+0000","last_active":"2022-04-28T14:39:26.612073+0000","last_peered":"2022-04-28T14:39:26.612073+0000","last_clean":"2022-04-28T14:39:26.612073+0000","last_became_active":"2022-04-28T14:39:13.955495+0000","last_became_peered":"2022-04-28T14:39:13.955495+0000","last_unstale":"2022-04-28T14:39:26.612073+0000","last_undegraded":"2022-04-28T14:39:26.612073+0000","last_fullsized":"2022-04-28T14:39:26.612073+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"16'6","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570489+0000","last_change":"2022-04-28T14:39:13.621432+0000","last_active":"2022-04-28T14:39:27.570489+0000","last_peered":"2022-04-28T14:39:27.570489+0000","last_clean":"2022-04-28T14:39:27.570489+0000","last_became_active":"2022-04-28T14:39:13.621080+0000","last_became_peered":"2022-04-28T14:39:13.621080+0000","last_unstale":"2022-04-28T14:39:27.570489+0000","last_undegraded":"2022-04-28T14:39:27.570489+0000","last_fullsized":"2022-04-28T14:39:27.570489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471173+0000","last_change":"2022-04-28T14:39:13.956112+0000","last_active":"2022-04-28T14:39:27.471173+0000","last_peered":"2022-04-28T14:39:27.471173+0000","last_clean":"2022-04-28T14:39:27.471173+0000","last_became_active":"2022-04-28T14:39:13.955792+0000","last_became_peered":"2022-04-28T14:39:13.955792+0000","last_unstale":"2022-04-28T14:39:27.471173+0000","last_undegraded":"2022-04-28T14:39:27.471173+0000","last_fullsized":"2022-04-28T14:39:27.471173+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570897+0000","last_change":"2022-04-28T14:39:13.622128+0000","last_active":"2022-04-28T14:39:27.570897+0000","last_peered":"2022-04-28T14:39:27.570897+0000","last_clean":"2022-04-28T14:39:27.570897+0000","last_became_active":"2022-04-28T14:39:13.621790+0000","last_became_peered":"2022-04-28T14:39:13.621790+0000","last_unstale":"2022-04-28T14:39:27.570897+0000","last_undegraded":"2022-04-28T14:39:27.570897+0000","last_fullsized":"2022-04-28T14:39:27.570897+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471600+0000","last_change":"2022-04-28T14:39:13.967323+0000","last_active":"2022-04-28T14:39:27.471600+0000","last_peered":"2022-04-28T14:39:27.471600+0000","last_clean":"2022-04-28T14:39:27.471600+0000","last_became_active":"2022-04-28T14:39:13.961173+0000","last_became_peered":"2022-04-28T14:39:13.961173+0000","last_unstale":"2022-04-28T14:39:27.471600+0000","last_undegraded":"2022-04-28T14:39:27.471600+0000","last_fullsized":"2022-04-28T14:39:27.471600+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612260+0000","last_change":"2022-04-28T14:39:13.609625+0000","last_active":"2022-04-28T14:39:26.612260+0000","last_peered":"2022-04-28T14:39:26.612260+0000","last_clean":"2022-04-28T14:39:26.612260+0000","last_became_active":"2022-04-28T14:39:13.609062+0000","last_became_peered":"2022-04-28T14:39:13.609062+0000","last_unstale":"2022-04-28T14:39:26.612260+0000","last_undegraded":"2022-04-28T14:39:26.612260+0000","last_fullsized":"2022-04-28T14:39:26.612260+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571045+0000","last_change":"2022-04-28T14:39:13.963123+0000","last_active":"2022-04-28T14:39:27.571045+0000","last_peered":"2022-04-28T14:39:27.571045+0000","last_clean":"2022-04-28T14:39:27.571045+0000","last_became_active":"2022-04-28T14:39:13.962825+0000","last_became_peered":"2022-04-28T14:39:13.962825+0000","last_unstale":"2022-04-28T14:39:27.571045+0000","last_undegraded":"2022-04-28T14:39:27.571045+0000","last_fullsized":"2022-04-28T14:39:27.571045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613087+0000","last_change":"2022-04-28T14:39:13.603083+0000","last_active":"2022-04-28T14:39:26.613087+0000","last_peered":"2022-04-28T14:39:26.613087+0000","last_clean":"2022-04-28T14:39:26.613087+0000","last_became_active":"2022-04-28T14:39:13.602776+0000","last_became_peered":"2022-04-28T14:39:13.602776+0000","last_unstale":"2022-04-28T14:39:26.613087+0000","last_undegraded":"2022-04-28T14:39:26.613087+0000","last_fullsized":"2022-04-28T14:39:26.613087+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571336+0000","last_change":"2022-04-28T14:39:13.971833+0000","last_active":"2022-04-28T14:39:27.571336+0000","last_peered":"2022-04-28T14:39:27.571336+0000","last_clean":"2022-04-28T14:39:27.571336+0000","last_became_active":"2022-04-28T14:39:13.971513+0000","last_became_peered":"2022-04-28T14:39:13.971513+0000","last_unstale":"2022-04-28T14:39:27.571336+0000","last_undegraded":"2022-04-28T14:39:27.571336+0000","last_fullsized":"2022-04-28T14:39:27.571336+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"18'12","reported_seq":24,"reported_epoch":18,"state":"active+clean","last_fresh":"2022-04-28T14:41:25.225938+0000","last_change":"2022-04-28T14:39:13.619098+0000","last_active":"2022-04-28T14:41:25.225938+0000","last_peered":"2022-04-28T14:41:25.225938+0000","last_clean":"2022-04-28T14:41:25.225938+0000","last_became_active":"2022-04-28T14:39:13.618737+0000","last_became_peered":"2022-04-28T14:39:13.618737+0000","last_unstale":"2022-04-28T14:41:25.225938+0000","last_undegraded":"2022-04-28T14:41:25.225938+0000","last_fullsized":"2022-04-28T14:41:25.225938+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4014,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571857+0000","last_change":"2022-04-28T14:39:13.951611+0000","last_active":"2022-04-28T14:39:27.571857+0000","last_peered":"2022-04-28T14:39:27.571857+0000","last_clean":"2022-04-28T14:39:27.571857+0000","last_became_active":"2022-04-28T14:39:13.951102+0000","last_became_peered":"2022-04-28T14:39:13.951102+0000","last_unstale":"2022-04-28T14:39:27.571857+0000","last_undegraded":"2022-04-28T14:39:27.571857+0000","last_fullsized":"2022-04-28T14:39:27.571857+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613671+0000","last_change":"2022-04-28T14:39:13.618476+0000","last_active":"2022-04-28T14:39:26.613671+0000","last_peered":"2022-04-28T14:39:26.613671+0000","last_clean":"2022-04-28T14:39:26.613671+0000","last_became_active":"2022-04-28T14:39:13.617950+0000","last_became_peered":"2022-04-28T14:39:13.617950+0000","last_unstale":"2022-04-28T14:39:26.613671+0000","last_undegraded":"2022-04-28T14:39:26.613671+0000","last_fullsized":"2022-04-28T14:39:26.613671+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.614162+0000","last_change":"2022-04-28T14:39:13.969503+0000","last_active":"2022-04-28T14:39:26.614162+0000","last_peered":"2022-04-28T14:39:26.614162+0000","last_clean":"2022-04-28T14:39:26.614162+0000","last_became_active":"2022-04-28T14:39:13.969200+0000","last_became_peered":"2022-04-28T14:39:13.969200+0000","last_unstale":"2022-04-28T14:39:26.614162+0000","last_undegraded":"2022-04-28T14:39:26.614162+0000","last_fullsized":"2022-04-28T14:39:26.614162+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"16'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613815+0000","last_change":"2022-04-28T14:39:13.613426+0000","last_active":"2022-04-28T14:39:26.613815+0000","last_peered":"2022-04-28T14:39:26.613815+0000","last_clean":"2022-04-28T14:39:26.613815+0000","last_became_active":"2022-04-28T14:39:13.613077+0000","last_became_peered":"2022-04-28T14:39:13.613077+0000","last_unstale":"2022-04-28T14:39:26.613815+0000","last_undegraded":"2022-04-28T14:39:26.613815+0000","last_fullsized":"2022-04-28T14:39:26.613815+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571525+0000","last_change":"2022-04-28T14:39:13.953772+0000","last_active":"2022-04-28T14:39:27.571525+0000","last_peered":"2022-04-28T14:39:27.571525+0000","last_clean":"2022-04-28T14:39:27.571525+0000","last_became_active":"2022-04-28T14:39:13.953478+0000","last_became_peered":"2022-04-28T14:39:13.953478+0000","last_unstale":"2022-04-28T14:39:27.571525+0000","last_undegraded":"2022-04-28T14:39:27.571525+0000","last_fullsized":"2022-04-28T14:39:27.571525+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571816+0000","last_change":"2022-04-28T14:39:13.606445+0000","last_active":"2022-04-28T14:39:27.571816+0000","last_peered":"2022-04-28T14:39:27.571816+0000","last_clean":"2022-04-28T14:39:27.571816+0000","last_became_active":"2022-04-28T14:39:13.606028+0000","last_became_peered":"2022-04-28T14:39:13.606028+0000","last_unstale":"2022-04-28T14:39:27.571816+0000","last_undegraded":"2022-04-28T14:39:27.571816+0000","last_fullsized":"2022-04-28T14:39:27.571816+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570549+0000","last_change":"2022-04-28T14:39:13.951780+0000","last_active":"2022-04-28T14:39:27.570549+0000","last_peered":"2022-04-28T14:39:27.570549+0000","last_clean":"2022-04-28T14:39:27.570549+0000","last_became_active":"2022-04-28T14:39:13.951236+0000","last_became_peered":"2022-04-28T14:39:13.951236+0000","last_unstale":"2022-04-28T14:39:27.570549+0000","last_undegraded":"2022-04-28T14:39:27.570549+0000","last_fullsized":"2022-04-28T14:39:27.570549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"16'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570560+0000","last_change":"2022-04-28T14:39:13.621466+0000","last_active":"2022-04-28T14:39:27.570560+0000","last_peered":"2022-04-28T14:39:27.570560+0000","last_clean":"2022-04-28T14:39:27.570560+0000","last_became_active":"2022-04-28T14:39:13.621146+0000","last_became_peered":"2022-04-28T14:39:13.621146+0000","last_unstale":"2022-04-28T14:39:27.570560+0000","last_undegraded":"2022-04-28T14:39:27.570560+0000","last_fullsized":"2022-04-28T14:39:27.570560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.471591+0000","last_change":"2022-04-28T14:39:13.960230+0000","last_active":"2022-04-28T14:39:27.471591+0000","last_peered":"2022-04-28T14:39:27.471591+0000","last_clean":"2022-04-28T14:39:27.471591+0000","last_became_active":"2022-04-28T14:39:13.958741+0000","last_became_peered":"2022-04-28T14:39:13.958741+0000","last_unstale":"2022-04-28T14:39:27.471591+0000","last_undegraded":"2022-04-28T14:39:27.471591+0000","last_fullsized":"2022-04-28T14:39:27.471591+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612287+0000","last_change":"2022-04-28T14:39:13.603448+0000","last_active":"2022-04-28T14:39:26.612287+0000","last_peered":"2022-04-28T14:39:26.612287+0000","last_clean":"2022-04-28T14:39:26.612287+0000","last_became_active":"2022-04-28T14:39:13.603117+0000","last_became_peered":"2022-04-28T14:39:13.603117+0000","last_unstale":"2022-04-28T14:39:26.612287+0000","last_undegraded":"2022-04-28T14:39:26.612287+0000","last_fullsized":"2022-04-28T14:39:26.612287+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.570986+0000","last_change":"2022-04-28T14:39:13.951179+0000","last_active":"2022-04-28T14:39:27.570986+0000","last_peered":"2022-04-28T14:39:27.570986+0000","last_clean":"2022-04-28T14:39:27.570986+0000","last_became_active":"2022-04-28T14:39:13.950413+0000","last_became_peered":"2022-04-28T14:39:13.950413+0000","last_unstale":"2022-04-28T14:39:27.570986+0000","last_undegraded":"2022-04-28T14:39:27.570986+0000","last_fullsized":"2022-04-28T14:39:27.570986+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612296+0000","last_change":"2022-04-28T14:39:13.609803+0000","last_active":"2022-04-28T14:39:26.612296+0000","last_peered":"2022-04-28T14:39:26.612296+0000","last_clean":"2022-04-28T14:39:26.612296+0000","last_became_active":"2022-04-28T14:39:13.609320+0000","last_became_peered":"2022-04-28T14:39:13.609320+0000","last_unstale":"2022-04-28T14:39:26.612296+0000","last_undegraded":"2022-04-28T14:39:26.612296+0000","last_fullsized":"2022-04-28T14:39:26.612296+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612199+0000","last_change":"2022-04-28T14:39:13.953322+0000","last_active":"2022-04-28T14:39:26.612199+0000","last_peered":"2022-04-28T14:39:26.612199+0000","last_clean":"2022-04-28T14:39:26.612199+0000","last_became_active":"2022-04-28T14:39:13.952997+0000","last_became_peered":"2022-04-28T14:39:13.952997+0000","last_unstale":"2022-04-28T14:39:26.612199+0000","last_undegraded":"2022-04-28T14:39:26.612199+0000","last_fullsized":"2022-04-28T14:39:26.612199+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571203+0000","last_change":"2022-04-28T14:39:13.624451+0000","last_active":"2022-04-28T14:39:27.571203+0000","last_peered":"2022-04-28T14:39:27.571203+0000","last_clean":"2022-04-28T14:39:27.571203+0000","last_became_active":"2022-04-28T14:39:13.624118+0000","last_became_peered":"2022-04-28T14:39:13.624118+0000","last_unstale":"2022-04-28T14:39:27.571203+0000","last_undegraded":"2022-04-28T14:39:27.571203+0000","last_fullsized":"2022-04-28T14:39:27.571203+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571069+0000","last_change":"2022-04-28T14:39:13.956657+0000","last_active":"2022-04-28T14:39:27.571069+0000","last_peered":"2022-04-28T14:39:27.571069+0000","last_clean":"2022-04-28T14:39:27.571069+0000","last_became_active":"2022-04-28T14:39:13.956291+0000","last_became_peered":"2022-04-28T14:39:13.956291+0000","last_unstale":"2022-04-28T14:39:27.571069+0000","last_undegraded":"2022-04-28T14:39:27.571069+0000","last_fullsized":"2022-04-28T14:39:27.571069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571781+0000","last_change":"2022-04-28T14:39:13.621131+0000","last_active":"2022-04-28T14:39:27.571781+0000","last_peered":"2022-04-28T14:39:27.571781+0000","last_clean":"2022-04-28T14:39:27.571781+0000","last_became_active":"2022-04-28T14:39:13.620764+0000","last_became_peered":"2022-04-28T14:39:13.620764+0000","last_unstale":"2022-04-28T14:39:27.571781+0000","last_undegraded":"2022-04-28T14:39:27.571781+0000","last_fullsized":"2022-04-28T14:39:27.571781+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.612381+0000","last_change":"2022-04-28T14:39:13.971712+0000","last_active":"2022-04-28T14:39:26.612381+0000","last_peered":"2022-04-28T14:39:26.612381+0000","last_clean":"2022-04-28T14:39:26.612381+0000","last_became_active":"2022-04-28T14:39:13.970627+0000","last_became_peered":"2022-04-28T14:39:13.970627+0000","last_unstale":"2022-04-28T14:39:26.612381+0000","last_undegraded":"2022-04-28T14:39:26.612381+0000","last_fullsized":"2022-04-28T14:39:26.612381+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613501+0000","last_change":"2022-04-28T14:39:13.618500+0000","last_active":"2022-04-28T14:39:26.613501+0000","last_peered":"2022-04-28T14:39:26.613501+0000","last_clean":"2022-04-28T14:39:26.613501+0000","last_became_active":"2022-04-28T14:39:13.618171+0000","last_became_peered":"2022-04-28T14:39:13.618171+0000","last_unstale":"2022-04-28T14:39:26.613501+0000","last_undegraded":"2022-04-28T14:39:26.613501+0000","last_fullsized":"2022-04-28T14:39:26.613501+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571555+0000","last_change":"2022-04-28T14:39:13.966833+0000","last_active":"2022-04-28T14:39:27.571555+0000","last_peered":"2022-04-28T14:39:27.571555+0000","last_clean":"2022-04-28T14:39:27.571555+0000","last_became_active":"2022-04-28T14:39:13.963563+0000","last_became_peered":"2022-04-28T14:39:13.963563+0000","last_unstale":"2022-04-28T14:39:27.571555+0000","last_undegraded":"2022-04-28T14:39:27.571555+0000","last_fullsized":"2022-04-28T14:39:27.571555+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:27.571662+0000","last_change":"2022-04-28T14:39:13.622884+0000","last_active":"2022-04-28T14:39:27.571662+0000","last_peered":"2022-04-28T14:39:27.571662+0000","last_clean":"2022-04-28T14:39:27.571662+0000","last_became_active":"2022-04-28T14:39:13.617005+0000","last_became_peered":"2022-04-28T14:39:13.617005+0000","last_unstale":"2022-04-28T14:39:27.571662+0000","last_undegraded":"2022-04-28T14:39:27.571662+0000","last_fullsized":"2022-04-28T14:39:27.571662+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.613813+0000","last_change":"2022-04-28T14:39:13.951972+0000","last_active":"2022-04-28T14:39:26.613813+0000","last_peered":"2022-04-28T14:39:26.613813+0000","last_clean":"2022-04-28T14:39:26.613813+0000","last_became_active":"2022-04-28T14:39:13.951647+0000","last_became_peered":"2022-04-28T14:39:13.951647+0000","last_unstale":"2022-04-28T14:39:26.613813+0000","last_undegraded":"2022-04-28T14:39:26.613813+0000","last_fullsized":"2022-04-28T14:39:26.613813+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":15,"reported_epoch":17,"state":"active+clean","last_fresh":"2022-04-28T14:39:26.614113+0000","last_change":"2022-04-28T14:39:13.619298+0000","last_active":"2022-04-28T14:39:26.614113+0000","last_peered":"2022-04-28T14:39:26.614113+0000","last_clean":"2022-04-28T14:39:26.614113+0000","last_became_active":"2022-04-28T14:39:13.618948+0000","last_became_peered":"2022-04-28T14:39:13.618948+0000","last_unstale":"2022-04-28T14:39:26.614113+0000","last_undegraded":"2022-04-28T14:39:26.614113+0000","last_fullsized":"2022-04-28T14:39:26.614113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":8344,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":16688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705695,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048772,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323068,"statfs":{"total":96636764160,"available":95562821632,"internally_reserved":1073741824,"allocated":192512,"data_stored":53891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 28 14:41:07 2022","interfaces":[{"interface":"back","average":{"1min":0.26900000000000002,"5min":0.33300000000000002,"15min":0.34300000000000003},"min":{"1min":0.13800000000000001,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.50700000000000001,"5min":0.623,"15min":0.623},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.27300000000000002,"5min":0.33200000000000002,"15min":0.34200000000000003},"min":{"1min":0.16800000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.55100000000000005,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.315}]},{"osd":1,"last update":"Thu Apr 28 14:41:07 2022","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":0.32500000000000001,"15min":0.33200000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.47899999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.28599999999999998,"5min":0.34300000000000003,"15min":0.35299999999999998},"min":{"1min":0.155,"5min":0.155,"15min":0.155},"max":{"1min":0.56200000000000006,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Apr 28 14:41:07 2022","interfaces":[{"interface":"back","average":{"1min":0.29499999999999998,"5min":0.35799999999999998,"15min":0.36799999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.376},{"interface":"front","average":{"1min":0.29499999999999998,"5min":0.36899999999999999,"15min":0.38100000000000001},"min":{"1min":0.16200000000000001,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.54200000000000004,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.32300000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705694,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048760,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323080,"statfs":{"total":96636764160,"available":95562833920,"internally_reserved":1073741824,"allocated":180224,"data_stored":48449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 28 14:41:05 2022","interfaces":[{"interface":"back","average":{"1min":0.249,"5min":0.27200000000000002,"15min":0.27600000000000002},"min":{"1min":0.20300000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.27400000000000002,"5min":0.442,"15min":0.442},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.308,"15min":0.314},"min":{"1min":0.222,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.31,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Apr 28 14:41:05 2022","interfaces":[{"interface":"back","average":{"1min":0.24199999999999999,"5min":0.28599999999999998,"15min":0.29299999999999998},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.33300000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.27000000000000002,"5min":0.314,"15min":0.32100000000000001},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.34000000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Apr 28 14:41:05 2022","interfaces":[{"interface":"back","average":{"1min":0.24099999999999999,"5min":0.28699999999999998,"15min":0.29499999999999998},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.28599999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.308},{"interface":"front","average":{"1min":0.25,"5min":0.311,"15min":0.32100000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.29599999999999999,"5min":0.495,"15min":0.495},"last":0.28999999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705695,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":47885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 28 14:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.24399999999999999,"5min":0.31,"15min":0.32100000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.308,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.191},{"interface":"front","average":{"1min":0.24399999999999999,"5min":0.33200000000000002,"15min":0.34599999999999997},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.32400000000000001,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.20399999999999999}]},{"osd":1,"last update":"Thu Apr 28 14:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.26600000000000001,"5min":0.34200000000000003,"15min":0.35499999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.29799999999999999,"5min":0.629,"15min":0.629},"last":0.25},{"interface":"front","average":{"1min":0.26000000000000001,"5min":0.35099999999999998,"15min":0.36599999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.313,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.224}]},{"osd":3,"last update":"Thu Apr 28 14:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.28399999999999997,"5min":0.38900000000000001,"15min":0.40699999999999997},"min":{"1min":0.24299999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.34599999999999997,"5min":1.325,"15min":1.325},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.26800000000000002,"5min":0.373,"15min":0.39100000000000001},"min":{"1min":0.217,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.32300000000000001,"5min":1.302,"15min":1.302},"last":0.219}]}]},{"osd":0,"up_from":9,"seq":38654705695,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":53985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 28 14:41:01 2022","interfaces":[{"interface":"back","average":{"1min":0.26100000000000001,"5min":0.29299999999999998,"15min":0.29899999999999999},"min":{"1min":0.186,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.43099999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.252,"5min":0.309,"15min":0.31900000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.40500000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Apr 28 14:41:01 2022","interfaces":[{"interface":"back","average":{"1min":0.26400000000000001,"5min":0.33000000000000002,"15min":0.34100000000000003},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.443,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.27400000000000002,"5min":0.32500000000000001,"15min":0.33300000000000002},"min":{"1min":0.22800000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.46200000000000002,"5min":0.497,"15min":0.497},"last":0.318}]},{"osd":3,"last update":"Thu Apr 28 14:41:01 2022","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.34399999999999997,"15min":0.35199999999999998},"min":{"1min":0.222,"5min":0.216,"15min":0.216},"max":{"1min":0.48299999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.27900000000000003,"5min":0.35099999999999998,"15min":0.36299999999999999},"min":{"1min":0.19500000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.48999999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.39900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-04-28T14:41:32.878 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-04-28T14:41:33.013 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.006+0000 7f5f55305700 1 Processor -- start 2022-04-28T14:41:33.013 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.006+0000 7f5f55305700 1 -- start start 2022-04-28T14:41:33.013 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.007+0000 7f5f55305700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5f500a5450 0x7f5f50067010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:33.013 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.007+0000 7f5f55305700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5f50135740 0x7f5f5013b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:33.014 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.007+0000 7f5f55305700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5f5013be70 0x7f5f501381e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:33.014 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.007+0000 7f5f55305700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f500a5cd0 con 0x7f5f500a5450 2022-04-28T14:41:33.014 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.007+0000 7f5f55305700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f500a5830 con 0x7f5f50135740 2022-04-28T14:41:33.014 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.007+0000 7f5f55305700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5013c350 con 0x7f5f5013be70 2022-04-28T14:41:33.014 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.007+0000 7f5f4f7fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5f5013be70 0x7f5f501381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:33.014 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.007+0000 7f5f4effd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5f500a5450 0x7f5f50067010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:33.014 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.007+0000 7f5f4e7fc700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5f50135740 0x7f5f5013b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:33.014 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.007+0000 7f5f4f7fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5f5013be70 0x7f5f501381e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:47830/0 (socket says 172.21.15.22:47830) 2022-04-28T14:41:33.015 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.007+0000 7f5f4f7fe700 1 -- 172.21.15.22:0/1853101569 learned_addr learned my addr 172.21.15.22:0/1853101569 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:33.015 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.007+0000 7f5f4f7fe700 1 -- 172.21.15.22:0/1853101569 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5f50135740 msgr2=0x7f5f5013b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:33.015 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.007+0000 7f5f4f7fe700 1 --2- 172.21.15.22:0/1853101569 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5f50135740 0x7f5f5013b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.015 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.007+0000 7f5f4f7fe700 1 -- 172.21.15.22:0/1853101569 >> v2:172.21.15.22:3300/0 conn(0x7f5f500a5450 msgr2=0x7f5f50067010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:33.015 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.007+0000 7f5f4f7fe700 1 --2- 172.21.15.22:0/1853101569 >> v2:172.21.15.22:3300/0 conn(0x7f5f500a5450 0x7f5f50067010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.015 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.007+0000 7f5f4f7fe700 1 -- 172.21.15.22:0/1853101569 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5013c5f0 con 0x7f5f5013be70 2022-04-28T14:41:33.015 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.007+0000 7f5f4e7fc700 1 --2- 172.21.15.22:0/1853101569 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5f50135740 0x7f5f5013b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:33.015 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.007+0000 7f5f4effd700 1 --2- 172.21.15.22:0/1853101569 >> v2:172.21.15.22:3300/0 conn(0x7f5f500a5450 0x7f5f50067010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:33.015 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.007+0000 7f5f4f7fe700 1 --2- 172.21.15.22:0/1853101569 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5f5013be70 0x7f5f501381e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f5f48009f20 tx=0x7f5f48009840).ready entity=mon.2 client_cookie=26b483908f81a445 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:33.015 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.007+0000 7f5f4dffb700 1 -- 172.21.15.22:0/1853101569 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4800e070 con 0x7f5f5013be70 2022-04-28T14:41:33.016 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.007+0000 7f5f4dffb700 1 -- 172.21.15.22:0/1853101569 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4800b970 con 0x7f5f5013be70 2022-04-28T14:41:33.016 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.007+0000 7f5f4dffb700 1 -- 172.21.15.22:0/1853101569 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4800bcf0 con 0x7f5f5013be70 2022-04-28T14:41:33.016 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.008+0000 7f5f55305700 1 -- 172.21.15.22:0/1853101569 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5f5013be70 msgr2=0x7f5f501381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:33.016 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.008+0000 7f5f55305700 1 --2- 172.21.15.22:0/1853101569 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5f5013be70 0x7f5f501381e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f5f48009f20 tx=0x7f5f48009840).stop 2022-04-28T14:41:33.016 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.008+0000 7f5f55305700 1 -- 172.21.15.22:0/1853101569 shutdown_connections 2022-04-28T14:41:33.016 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.008+0000 7f5f55305700 1 --2- 172.21.15.22:0/1853101569 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5f5013be70 0x7f5f501381e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.016 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.008+0000 7f5f55305700 1 --2- 172.21.15.22:0/1853101569 >> v2:172.21.15.22:3300/0 conn(0x7f5f500a5450 0x7f5f50067010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.016 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.008+0000 7f5f55305700 1 --2- 172.21.15.22:0/1853101569 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5f50135740 0x7f5f5013b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.016 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.008+0000 7f5f55305700 1 -- 172.21.15.22:0/1853101569 >> 172.21.15.22:0/1853101569 conn(0x7f5f50069860 msgr2=0x7f5f50069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:33.017 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.008+0000 7f5f55305700 1 -- 172.21.15.22:0/1853101569 shutdown_connections 2022-04-28T14:41:33.017 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.008+0000 7f5f55305700 1 -- 172.21.15.22:0/1853101569 wait complete. 2022-04-28T14:41:33.019 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.009+0000 7f5f55305700 1 Processor -- start 2022-04-28T14:41:33.019 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.009+0000 7f5f55305700 1 -- start start 2022-04-28T14:41:33.019 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.010+0000 7f5f55305700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f500a5450 0x7f5f50116a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:33.019 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.010+0000 7f5f55305700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5f50135740 0x7f5f50115970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:33.020 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.010+0000 7f5f55305700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5f5013be70 0x7f5f501330b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:33.020 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.010+0000 7f5f55305700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f500a9db0 con 0x7f5f500a5450 2022-04-28T14:41:33.020 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.010+0000 7f5f55305700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f50115e60 con 0x7f5f5013be70 2022-04-28T14:41:33.020 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.010+0000 7f5f55305700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f501145e0 con 0x7f5f50135740 2022-04-28T14:41:33.020 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.010+0000 7f5f4effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f500a5450 0x7f5f50116a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:33.020 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.010+0000 7f5f4f7fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5f5013be70 0x7f5f501330b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:33.020 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.010+0000 7f5f4effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f500a5450 0x7f5f50116a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50480/0 (socket says 172.21.15.22:50480) 2022-04-28T14:41:33.020 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.010+0000 7f5f4effd700 1 -- 172.21.15.22:0/1129344670 learned_addr learned my addr 172.21.15.22:0/1129344670 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:33.020 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.010+0000 7f5f4e7fc700 1 --2- 172.21.15.22:0/1129344670 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5f50135740 0x7f5f50115970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:33.021 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.010+0000 7f5f4f7fe700 1 -- 172.21.15.22:0/1129344670 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5f50135740 msgr2=0x7f5f50115970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:33.021 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.010+0000 7f5f4f7fe700 1 --2- 172.21.15.22:0/1129344670 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5f50135740 0x7f5f50115970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.021 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.010+0000 7f5f4f7fe700 1 -- 172.21.15.22:0/1129344670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f500a5450 msgr2=0x7f5f50116a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:33.021 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.010+0000 7f5f4f7fe700 1 --2- 172.21.15.22:0/1129344670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f500a5450 0x7f5f50116a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.021 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.010+0000 7f5f4f7fe700 1 -- 172.21.15.22:0/1129344670 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f440092a0 con 0x7f5f5013be70 2022-04-28T14:41:33.021 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.010+0000 7f5f4f7fe700 1 --2- 172.21.15.22:0/1129344670 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5f5013be70 0x7f5f501330b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f5f5006bc40 tx=0x7f5f48009840).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:33.021 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.010+0000 7f5f36ffd700 1 -- 172.21.15.22:0/1129344670 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f48007170 con 0x7f5f5013be70 2022-04-28T14:41:33.021 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.011+0000 7f5f36ffd700 1 -- 172.21.15.22:0/1129344670 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f48013e60 con 0x7f5f5013be70 2022-04-28T14:41:33.021 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.011+0000 7f5f55305700 1 -- 172.21.15.22:0/1129344670 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f400092a0 con 0x7f5f5013be70 2022-04-28T14:41:33.022 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.011+0000 7f5f36ffd700 1 -- 172.21.15.22:0/1129344670 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f48007860 con 0x7f5f5013be70 2022-04-28T14:41:33.022 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.011+0000 7f5f55305700 1 -- 172.21.15.22:0/1129344670 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f48009ae0 con 0x7f5f5013be70 2022-04-28T14:41:33.022 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.011+0000 7f5f36ffd700 1 -- 172.21.15.22:0/1129344670 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f5f48025030 con 0x7f5f5013be70 2022-04-28T14:41:33.022 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.011+0000 7f5f55305700 1 -- 172.21.15.22:0/1129344670 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f500a9f20 con 0x7f5f5013be70 2022-04-28T14:41:33.022 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.012+0000 7f5f36ffd700 1 -- 172.21.15.22:0/1129344670 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f5f48056da0 con 0x7f5f5013be70 2022-04-28T14:41:33.022 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.015+0000 7f5f36ffd700 1 -- 172.21.15.22:0/1129344670 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f5f500a9f20 con 0x7f5f5013be70 2022-04-28T14:41:33.156 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.151+0000 7f5f55305700 1 -- 172.21.15.22:0/1129344670 --> v1:172.21.15.22:6808/92758 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5f500a9f20 con 0x7f5f30041b00 2022-04-28T14:41:33.164 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.160+0000 7f5f36ffd700 1 -- 172.21.15.22:0/1129344670 <== mgr.14100 v1:172.21.15.22:6808/92758 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+326297 (unknown 2965378022 0 1305161722) 0x7f5f500a9f20 con 0x7f5f30041b00 2022-04-28T14:41:33.169 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:41:33.171 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.162+0000 7f5f55305700 1 -- 172.21.15.22:0/1129344670 >> v1:172.21.15.22:6808/92758 conn(0x7f5f30041b00 legacy=0x7f5f30043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:33.171 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.162+0000 7f5f55305700 1 -- 172.21.15.22:0/1129344670 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5f5013be70 msgr2=0x7f5f501330b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:33.171 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.162+0000 7f5f55305700 1 --2- 172.21.15.22:0/1129344670 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5f5013be70 0x7f5f501330b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f5f5006bc40 tx=0x7f5f48009840).stop 2022-04-28T14:41:33.171 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.162+0000 7f5f55305700 1 -- 172.21.15.22:0/1129344670 shutdown_connections 2022-04-28T14:41:33.172 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.162+0000 7f5f55305700 1 --2- 172.21.15.22:0/1129344670 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5f5013be70 0x7f5f501330b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.172 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.162+0000 7f5f55305700 1 --2- 172.21.15.22:0/1129344670 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5f500a5450 0x7f5f50116a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.172 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.162+0000 7f5f55305700 1 --2- 172.21.15.22:0/1129344670 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5f50135740 0x7f5f50115970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.172 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.162+0000 7f5f55305700 1 -- 172.21.15.22:0/1129344670 >> 172.21.15.22:0/1129344670 conn(0x7f5f50069860 msgr2=0x7f5f50135030 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:33.172 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.162+0000 7f5f55305700 1 -- 172.21.15.22:0/1129344670 shutdown_connections 2022-04-28T14:41:33.172 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.163+0000 7f5f55305700 1 -- 172.21.15.22:0/1129344670 wait complete. 2022-04-28T14:41:33.172 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2022-04-28T14:41:33.179 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2022-04-28T14:41:33.142794+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8344,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":4195152,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292208,"statfs":{"total":386547056640,"available":382251220992,"internally_reserved":4294967296,"allocated":835584,"data_stored":256148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.996516"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.158657+0000","last_change":"2022-04-28T14:39:13.943418+0000","last_active":"2022-04-28T14:41:27.158657+0000","last_peered":"2022-04-28T14:41:27.158657+0000","last_clean":"2022-04-28T14:41:27.158657+0000","last_became_active":"2022-04-28T14:39:13.943111+0000","last_became_peered":"2022-04-28T14:39:13.943111+0000","last_unstale":"2022-04-28T14:41:27.158657+0000","last_undegraded":"2022-04-28T14:41:27.158657+0000","last_fullsized":"2022-04-28T14:41:27.158657+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"17'9","reported_seq":24,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.161233+0000","last_change":"2022-04-28T14:39:13.619263+0000","last_active":"2022-04-28T14:41:27.161233+0000","last_peered":"2022-04-28T14:41:27.161233+0000","last_clean":"2022-04-28T14:41:27.161233+0000","last_became_active":"2022-04-28T14:39:13.618911+0000","last_became_peered":"2022-04-28T14:39:13.618911+0000","last_unstale":"2022-04-28T14:41:27.161233+0000","last_undegraded":"2022-04-28T14:41:27.161233+0000","last_fullsized":"2022-04-28T14:41:27.161233+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2190,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.681243+0000","last_change":"2022-04-28T14:39:13.964730+0000","last_active":"2022-04-28T14:41:27.681243+0000","last_peered":"2022-04-28T14:41:27.681243+0000","last_clean":"2022-04-28T14:41:27.681243+0000","last_became_active":"2022-04-28T14:39:13.964405+0000","last_became_peered":"2022-04-28T14:39:13.964405+0000","last_unstale":"2022-04-28T14:41:27.681243+0000","last_undegraded":"2022-04-28T14:41:27.681243+0000","last_fullsized":"2022-04-28T14:41:27.681243+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.160597+0000","last_change":"2022-04-28T14:39:13.611678+0000","last_active":"2022-04-28T14:41:27.160597+0000","last_peered":"2022-04-28T14:41:27.160597+0000","last_clean":"2022-04-28T14:41:27.160597+0000","last_became_active":"2022-04-28T14:39:13.611166+0000","last_became_peered":"2022-04-28T14:39:13.611166+0000","last_unstale":"2022-04-28T14:41:27.160597+0000","last_undegraded":"2022-04-28T14:41:27.160597+0000","last_fullsized":"2022-04-28T14:41:27.160597+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.159893+0000","last_change":"2022-04-28T14:39:13.960149+0000","last_active":"2022-04-28T14:41:27.159893+0000","last_peered":"2022-04-28T14:41:27.159893+0000","last_clean":"2022-04-28T14:41:27.159893+0000","last_became_active":"2022-04-28T14:39:13.959509+0000","last_became_peered":"2022-04-28T14:39:13.959509+0000","last_unstale":"2022-04-28T14:41:27.159893+0000","last_undegraded":"2022-04-28T14:41:27.159893+0000","last_fullsized":"2022-04-28T14:41:27.159893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.160000+0000","last_change":"2022-04-28T14:39:13.610970+0000","last_active":"2022-04-28T14:41:27.160000+0000","last_peered":"2022-04-28T14:41:27.160000+0000","last_clean":"2022-04-28T14:41:27.160000+0000","last_became_active":"2022-04-28T14:39:13.610661+0000","last_became_peered":"2022-04-28T14:39:13.610661+0000","last_unstale":"2022-04-28T14:41:27.160000+0000","last_undegraded":"2022-04-28T14:41:27.160000+0000","last_fullsized":"2022-04-28T14:41:27.160000+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.158452+0000","last_change":"2022-04-28T14:39:13.963240+0000","last_active":"2022-04-28T14:41:27.158452+0000","last_peered":"2022-04-28T14:41:27.158452+0000","last_clean":"2022-04-28T14:41:27.158452+0000","last_became_active":"2022-04-28T14:39:13.961860+0000","last_became_peered":"2022-04-28T14:39:13.961860+0000","last_unstale":"2022-04-28T14:41:27.158452+0000","last_undegraded":"2022-04-28T14:41:27.158452+0000","last_fullsized":"2022-04-28T14:41:27.158452+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.159556+0000","last_change":"2022-04-28T14:39:13.607628+0000","last_active":"2022-04-28T14:41:27.159556+0000","last_peered":"2022-04-28T14:41:27.159556+0000","last_clean":"2022-04-28T14:41:27.159556+0000","last_became_active":"2022-04-28T14:39:13.607234+0000","last_became_peered":"2022-04-28T14:39:13.607234+0000","last_unstale":"2022-04-28T14:41:27.159556+0000","last_undegraded":"2022-04-28T14:41:27.159556+0000","last_fullsized":"2022-04-28T14:41:27.159556+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.158207+0000","last_change":"2022-04-28T14:39:13.972780+0000","last_active":"2022-04-28T14:41:27.158207+0000","last_peered":"2022-04-28T14:41:27.158207+0000","last_clean":"2022-04-28T14:41:27.158207+0000","last_became_active":"2022-04-28T14:39:13.972189+0000","last_became_peered":"2022-04-28T14:39:13.972189+0000","last_unstale":"2022-04-28T14:41:27.158207+0000","last_undegraded":"2022-04-28T14:41:27.158207+0000","last_fullsized":"2022-04-28T14:41:27.158207+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"17'7","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.157898+0000","last_change":"2022-04-28T14:39:13.615060+0000","last_active":"2022-04-28T14:41:27.157898+0000","last_peered":"2022-04-28T14:41:27.157898+0000","last_clean":"2022-04-28T14:41:27.157898+0000","last_became_active":"2022-04-28T14:39:13.614686+0000","last_became_peered":"2022-04-28T14:39:13.614686+0000","last_unstale":"2022-04-28T14:41:27.157898+0000","last_undegraded":"2022-04-28T14:41:27.157898+0000","last_fullsized":"2022-04-28T14:41:27.157898+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.682300+0000","last_change":"2022-04-28T14:39:13.963855+0000","last_active":"2022-04-28T14:41:27.682300+0000","last_peered":"2022-04-28T14:41:27.682300+0000","last_clean":"2022-04-28T14:41:27.682300+0000","last_became_active":"2022-04-28T14:39:13.963518+0000","last_became_peered":"2022-04-28T14:39:13.963518+0000","last_unstale":"2022-04-28T14:41:27.682300+0000","last_undegraded":"2022-04-28T14:41:27.682300+0000","last_fullsized":"2022-04-28T14:41:27.682300+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.681719+0000","last_change":"2022-04-28T14:39:13.623926+0000","last_active":"2022-04-28T14:41:27.681719+0000","last_peered":"2022-04-28T14:41:27.681719+0000","last_clean":"2022-04-28T14:41:27.681719+0000","last_became_active":"2022-04-28T14:39:13.623608+0000","last_became_peered":"2022-04-28T14:39:13.623608+0000","last_unstale":"2022-04-28T14:41:27.681719+0000","last_undegraded":"2022-04-28T14:41:27.681719+0000","last_fullsized":"2022-04-28T14:41:27.681719+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.161052+0000","last_change":"2022-04-28T14:39:13.968270+0000","last_active":"2022-04-28T14:41:27.161052+0000","last_peered":"2022-04-28T14:41:27.161052+0000","last_clean":"2022-04-28T14:41:27.161052+0000","last_became_active":"2022-04-28T14:39:13.967894+0000","last_became_peered":"2022-04-28T14:39:13.967894+0000","last_unstale":"2022-04-28T14:41:27.161052+0000","last_undegraded":"2022-04-28T14:41:27.161052+0000","last_fullsized":"2022-04-28T14:41:27.161052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"16'4","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.157523+0000","last_change":"2022-04-28T14:39:13.613942+0000","last_active":"2022-04-28T14:41:27.157523+0000","last_peered":"2022-04-28T14:41:27.157523+0000","last_clean":"2022-04-28T14:41:27.157523+0000","last_became_active":"2022-04-28T14:39:13.613151+0000","last_became_peered":"2022-04-28T14:39:13.613151+0000","last_unstale":"2022-04-28T14:41:27.157523+0000","last_undegraded":"2022-04-28T14:41:27.157523+0000","last_fullsized":"2022-04-28T14:41:27.157523+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.681754+0000","last_change":"2022-04-28T14:39:13.972010+0000","last_active":"2022-04-28T14:41:27.681754+0000","last_peered":"2022-04-28T14:41:27.681754+0000","last_clean":"2022-04-28T14:41:27.681754+0000","last_became_active":"2022-04-28T14:39:13.971680+0000","last_became_peered":"2022-04-28T14:39:13.971680+0000","last_unstale":"2022-04-28T14:41:27.681754+0000","last_undegraded":"2022-04-28T14:41:27.681754+0000","last_fullsized":"2022-04-28T14:41:27.681754+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"18'4","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.157295+0000","last_change":"2022-04-28T14:39:13.608578+0000","last_active":"2022-04-28T14:41:27.157295+0000","last_peered":"2022-04-28T14:41:27.157295+0000","last_clean":"2022-04-28T14:41:27.157295+0000","last_became_active":"2022-04-28T14:39:13.608208+0000","last_became_peered":"2022-04-28T14:39:13.608208+0000","last_unstale":"2022-04-28T14:41:27.157295+0000","last_undegraded":"2022-04-28T14:41:27.157295+0000","last_fullsized":"2022-04-28T14:41:27.157295+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.680745+0000","last_change":"2022-04-28T14:39:13.959741+0000","last_active":"2022-04-28T14:41:27.680745+0000","last_peered":"2022-04-28T14:41:27.680745+0000","last_clean":"2022-04-28T14:41:27.680745+0000","last_became_active":"2022-04-28T14:39:13.959445+0000","last_became_peered":"2022-04-28T14:39:13.959445+0000","last_unstale":"2022-04-28T14:41:27.680745+0000","last_undegraded":"2022-04-28T14:41:27.680745+0000","last_fullsized":"2022-04-28T14:41:27.680745+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'3","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.681592+0000","last_change":"2022-04-28T14:39:13.615947+0000","last_active":"2022-04-28T14:41:27.681592+0000","last_peered":"2022-04-28T14:41:27.681592+0000","last_clean":"2022-04-28T14:41:27.681592+0000","last_became_active":"2022-04-28T14:39:13.615589+0000","last_became_peered":"2022-04-28T14:39:13.615589+0000","last_unstale":"2022-04-28T14:41:27.681592+0000","last_undegraded":"2022-04-28T14:41:27.681592+0000","last_fullsized":"2022-04-28T14:41:27.681592+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.161215+0000","last_change":"2022-04-28T14:39:13.966950+0000","last_active":"2022-04-28T14:41:27.161215+0000","last_peered":"2022-04-28T14:41:27.161215+0000","last_clean":"2022-04-28T14:41:27.161215+0000","last_became_active":"2022-04-28T14:39:13.961621+0000","last_became_peered":"2022-04-28T14:39:13.961621+0000","last_unstale":"2022-04-28T14:41:27.161215+0000","last_undegraded":"2022-04-28T14:41:27.161215+0000","last_fullsized":"2022-04-28T14:41:27.161215+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"16'3","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.160468+0000","last_change":"2022-04-28T14:39:13.614233+0000","last_active":"2022-04-28T14:41:27.160468+0000","last_peered":"2022-04-28T14:41:27.160468+0000","last_clean":"2022-04-28T14:41:27.160468+0000","last_became_active":"2022-04-28T14:39:13.613890+0000","last_became_peered":"2022-04-28T14:39:13.613890+0000","last_unstale":"2022-04-28T14:41:27.160468+0000","last_undegraded":"2022-04-28T14:41:27.160468+0000","last_fullsized":"2022-04-28T14:41:27.160468+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.156641+0000","last_change":"2022-04-28T14:39:13.953204+0000","last_active":"2022-04-28T14:41:27.156641+0000","last_peered":"2022-04-28T14:41:27.156641+0000","last_clean":"2022-04-28T14:41:27.156641+0000","last_became_active":"2022-04-28T14:39:13.952884+0000","last_became_peered":"2022-04-28T14:39:13.952884+0000","last_unstale":"2022-04-28T14:41:27.156641+0000","last_undegraded":"2022-04-28T14:41:27.156641+0000","last_fullsized":"2022-04-28T14:41:27.156641+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.680662+0000","last_change":"2022-04-28T14:39:13.616607+0000","last_active":"2022-04-28T14:41:27.680662+0000","last_peered":"2022-04-28T14:41:27.680662+0000","last_clean":"2022-04-28T14:41:27.680662+0000","last_became_active":"2022-04-28T14:39:13.616264+0000","last_became_peered":"2022-04-28T14:39:13.616264+0000","last_unstale":"2022-04-28T14:41:27.680662+0000","last_undegraded":"2022-04-28T14:41:27.680662+0000","last_fullsized":"2022-04-28T14:41:27.680662+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.159883+0000","last_change":"2022-04-28T14:39:13.958559+0000","last_active":"2022-04-28T14:41:27.159883+0000","last_peered":"2022-04-28T14:41:27.159883+0000","last_clean":"2022-04-28T14:41:27.159883+0000","last_became_active":"2022-04-28T14:39:13.958048+0000","last_became_peered":"2022-04-28T14:39:13.958048+0000","last_unstale":"2022-04-28T14:41:27.159883+0000","last_undegraded":"2022-04-28T14:41:27.159883+0000","last_fullsized":"2022-04-28T14:41:27.159883+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.156320+0000","last_change":"2022-04-28T14:39:13.599319+0000","last_active":"2022-04-28T14:41:27.156320+0000","last_peered":"2022-04-28T14:41:27.156320+0000","last_clean":"2022-04-28T14:41:27.156320+0000","last_became_active":"2022-04-28T14:39:13.598926+0000","last_became_peered":"2022-04-28T14:39:13.598926+0000","last_unstale":"2022-04-28T14:41:27.156320+0000","last_undegraded":"2022-04-28T14:41:27.156320+0000","last_fullsized":"2022-04-28T14:41:27.156320+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.158084+0000","last_change":"2022-04-28T14:39:13.953566+0000","last_active":"2022-04-28T14:41:27.158084+0000","last_peered":"2022-04-28T14:41:27.158084+0000","last_clean":"2022-04-28T14:41:27.158084+0000","last_became_active":"2022-04-28T14:39:13.953248+0000","last_became_peered":"2022-04-28T14:39:13.953248+0000","last_unstale":"2022-04-28T14:41:27.158084+0000","last_undegraded":"2022-04-28T14:41:27.158084+0000","last_fullsized":"2022-04-28T14:41:27.158084+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.682474+0000","last_change":"2022-04-28T14:39:13.621471+0000","last_active":"2022-04-28T14:41:27.682474+0000","last_peered":"2022-04-28T14:41:27.682474+0000","last_clean":"2022-04-28T14:41:27.682474+0000","last_became_active":"2022-04-28T14:39:13.621155+0000","last_became_peered":"2022-04-28T14:39:13.621155+0000","last_unstale":"2022-04-28T14:41:27.682474+0000","last_undegraded":"2022-04-28T14:41:27.682474+0000","last_fullsized":"2022-04-28T14:41:27.682474+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.682396+0000","last_change":"2022-04-28T14:39:13.961895+0000","last_active":"2022-04-28T14:41:27.682396+0000","last_peered":"2022-04-28T14:41:27.682396+0000","last_clean":"2022-04-28T14:41:27.682396+0000","last_became_active":"2022-04-28T14:39:13.961160+0000","last_became_peered":"2022-04-28T14:39:13.961160+0000","last_unstale":"2022-04-28T14:41:27.682396+0000","last_undegraded":"2022-04-28T14:41:27.682396+0000","last_fullsized":"2022-04-28T14:41:27.682396+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.158470+0000","last_change":"2022-04-28T14:39:13.608696+0000","last_active":"2022-04-28T14:41:27.158470+0000","last_peered":"2022-04-28T14:41:27.158470+0000","last_clean":"2022-04-28T14:41:27.158470+0000","last_became_active":"2022-04-28T14:39:13.608335+0000","last_became_peered":"2022-04-28T14:39:13.608335+0000","last_unstale":"2022-04-28T14:41:27.158470+0000","last_undegraded":"2022-04-28T14:41:27.158470+0000","last_fullsized":"2022-04-28T14:41:27.158470+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.681213+0000","last_change":"2022-04-28T14:39:13.959179+0000","last_active":"2022-04-28T14:41:27.681213+0000","last_peered":"2022-04-28T14:41:27.681213+0000","last_clean":"2022-04-28T14:41:27.681213+0000","last_became_active":"2022-04-28T14:39:13.958838+0000","last_became_peered":"2022-04-28T14:39:13.958838+0000","last_unstale":"2022-04-28T14:41:27.681213+0000","last_undegraded":"2022-04-28T14:41:27.681213+0000","last_fullsized":"2022-04-28T14:41:27.681213+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.157629+0000","last_change":"2022-04-28T14:39:13.618291+0000","last_active":"2022-04-28T14:41:27.157629+0000","last_peered":"2022-04-28T14:41:27.157629+0000","last_clean":"2022-04-28T14:41:27.157629+0000","last_became_active":"2022-04-28T14:39:13.617912+0000","last_became_peered":"2022-04-28T14:39:13.617912+0000","last_unstale":"2022-04-28T14:41:27.157629+0000","last_undegraded":"2022-04-28T14:41:27.157629+0000","last_fullsized":"2022-04-28T14:41:27.157629+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.161501+0000","last_change":"2022-04-28T14:39:13.966352+0000","last_active":"2022-04-28T14:41:27.161501+0000","last_peered":"2022-04-28T14:41:27.161501+0000","last_clean":"2022-04-28T14:41:27.161501+0000","last_became_active":"2022-04-28T14:39:13.966039+0000","last_became_peered":"2022-04-28T14:39:13.966039+0000","last_unstale":"2022-04-28T14:41:27.161501+0000","last_undegraded":"2022-04-28T14:41:27.161501+0000","last_fullsized":"2022-04-28T14:41:27.161501+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.157198+0000","last_change":"2022-04-28T14:39:13.601416+0000","last_active":"2022-04-28T14:41:27.157198+0000","last_peered":"2022-04-28T14:41:27.157198+0000","last_clean":"2022-04-28T14:41:27.157198+0000","last_became_active":"2022-04-28T14:39:13.601028+0000","last_became_peered":"2022-04-28T14:39:13.601028+0000","last_unstale":"2022-04-28T14:41:27.157198+0000","last_undegraded":"2022-04-28T14:41:27.157198+0000","last_fullsized":"2022-04-28T14:41:27.157198+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.160314+0000","last_change":"2022-04-28T14:39:13.958313+0000","last_active":"2022-04-28T14:41:27.160314+0000","last_peered":"2022-04-28T14:41:27.160314+0000","last_clean":"2022-04-28T14:41:27.160314+0000","last_became_active":"2022-04-28T14:39:13.956853+0000","last_became_peered":"2022-04-28T14:39:13.956853+0000","last_unstale":"2022-04-28T14:41:27.160314+0000","last_undegraded":"2022-04-28T14:41:27.160314+0000","last_fullsized":"2022-04-28T14:41:27.160314+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.160972+0000","last_change":"2022-04-28T14:39:13.613340+0000","last_active":"2022-04-28T14:41:27.160972+0000","last_peered":"2022-04-28T14:41:27.160972+0000","last_clean":"2022-04-28T14:41:27.160972+0000","last_became_active":"2022-04-28T14:39:13.612902+0000","last_became_peered":"2022-04-28T14:39:13.612902+0000","last_unstale":"2022-04-28T14:41:27.160972+0000","last_undegraded":"2022-04-28T14:41:27.160972+0000","last_fullsized":"2022-04-28T14:41:27.160972+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.161124+0000","last_change":"2022-04-28T14:39:13.966772+0000","last_active":"2022-04-28T14:41:27.161124+0000","last_peered":"2022-04-28T14:41:27.161124+0000","last_clean":"2022-04-28T14:41:27.161124+0000","last_became_active":"2022-04-28T14:39:13.961393+0000","last_became_peered":"2022-04-28T14:39:13.961393+0000","last_unstale":"2022-04-28T14:41:27.161124+0000","last_undegraded":"2022-04-28T14:41:27.161124+0000","last_fullsized":"2022-04-28T14:41:27.161124+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.158610+0000","last_change":"2022-04-28T14:39:13.619825+0000","last_active":"2022-04-28T14:41:27.158610+0000","last_peered":"2022-04-28T14:41:27.158610+0000","last_clean":"2022-04-28T14:41:27.158610+0000","last_became_active":"2022-04-28T14:39:13.619514+0000","last_became_peered":"2022-04-28T14:39:13.619514+0000","last_unstale":"2022-04-28T14:41:27.158610+0000","last_undegraded":"2022-04-28T14:41:27.158610+0000","last_fullsized":"2022-04-28T14:41:27.158610+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.160147+0000","last_change":"2022-04-28T14:39:13.956243+0000","last_active":"2022-04-28T14:41:27.160147+0000","last_peered":"2022-04-28T14:41:27.160147+0000","last_clean":"2022-04-28T14:41:27.160147+0000","last_became_active":"2022-04-28T14:39:13.955924+0000","last_became_peered":"2022-04-28T14:39:13.955924+0000","last_unstale":"2022-04-28T14:41:27.160147+0000","last_undegraded":"2022-04-28T14:41:27.160147+0000","last_fullsized":"2022-04-28T14:41:27.160147+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"16'3","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.156924+0000","last_change":"2022-04-28T14:39:13.607250+0000","last_active":"2022-04-28T14:41:27.156924+0000","last_peered":"2022-04-28T14:41:27.156924+0000","last_clean":"2022-04-28T14:41:27.156924+0000","last_became_active":"2022-04-28T14:39:13.606892+0000","last_became_peered":"2022-04-28T14:39:13.606892+0000","last_unstale":"2022-04-28T14:41:27.156924+0000","last_undegraded":"2022-04-28T14:41:27.156924+0000","last_fullsized":"2022-04-28T14:41:27.156924+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.160122+0000","last_change":"2022-04-28T14:39:13.958594+0000","last_active":"2022-04-28T14:41:27.160122+0000","last_peered":"2022-04-28T14:41:27.160122+0000","last_clean":"2022-04-28T14:41:27.160122+0000","last_became_active":"2022-04-28T14:39:13.958234+0000","last_became_peered":"2022-04-28T14:39:13.958234+0000","last_unstale":"2022-04-28T14:41:27.160122+0000","last_undegraded":"2022-04-28T14:41:27.160122+0000","last_fullsized":"2022-04-28T14:41:27.160122+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.680729+0000","last_change":"2022-04-28T14:39:13.610919+0000","last_active":"2022-04-28T14:41:27.680729+0000","last_peered":"2022-04-28T14:41:27.680729+0000","last_clean":"2022-04-28T14:41:27.680729+0000","last_became_active":"2022-04-28T14:39:13.610535+0000","last_became_peered":"2022-04-28T14:39:13.610535+0000","last_unstale":"2022-04-28T14:41:27.680729+0000","last_undegraded":"2022-04-28T14:41:27.680729+0000","last_fullsized":"2022-04-28T14:41:27.680729+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"20'1","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.302191+0000","last_change":"2022-04-28T14:41:27.162797+0000","last_active":"2022-04-28T14:41:27.302191+0000","last_peered":"2022-04-28T14:41:27.302191+0000","last_clean":"2022-04-28T14:41:27.302191+0000","last_became_active":"2022-04-28T14:41:27.162449+0000","last_became_peered":"2022-04-28T14:41:27.162449+0000","last_unstale":"2022-04-28T14:41:27.302191+0000","last_undegraded":"2022-04-28T14:41:27.302191+0000","last_fullsized":"2022-04-28T14:41:27.302191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:41:26.135911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:41:26.135911+0000","last_clean_scrub_stamp":"2022-04-28T14:41:26.135911+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.162055+0000","last_change":"2022-04-28T14:39:13.968427+0000","last_active":"2022-04-28T14:41:27.162055+0000","last_peered":"2022-04-28T14:41:27.162055+0000","last_clean":"2022-04-28T14:41:27.162055+0000","last_became_active":"2022-04-28T14:39:13.968116+0000","last_became_peered":"2022-04-28T14:39:13.968116+0000","last_unstale":"2022-04-28T14:41:27.162055+0000","last_undegraded":"2022-04-28T14:41:27.162055+0000","last_fullsized":"2022-04-28T14:41:27.162055+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.158056+0000","last_change":"2022-04-28T14:39:05.390479+0000","last_active":"2022-04-28T14:41:27.158056+0000","last_peered":"2022-04-28T14:41:27.158056+0000","last_clean":"2022-04-28T14:41:27.158056+0000","last_became_active":"2022-04-28T14:39:05.390111+0000","last_became_peered":"2022-04-28T14:39:05.390111+0000","last_unstale":"2022-04-28T14:41:27.158056+0000","last_undegraded":"2022-04-28T14:41:27.158056+0000","last_fullsized":"2022-04-28T14:41:27.158056+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.158214+0000","last_change":"2022-04-28T14:39:13.610156+0000","last_active":"2022-04-28T14:41:27.158214+0000","last_peered":"2022-04-28T14:41:27.158214+0000","last_clean":"2022-04-28T14:41:27.158214+0000","last_became_active":"2022-04-28T14:39:13.609823+0000","last_became_peered":"2022-04-28T14:39:13.609823+0000","last_unstale":"2022-04-28T14:41:27.158214+0000","last_undegraded":"2022-04-28T14:41:27.158214+0000","last_fullsized":"2022-04-28T14:41:27.158214+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.681610+0000","last_change":"2022-04-28T14:39:13.952310+0000","last_active":"2022-04-28T14:41:27.681610+0000","last_peered":"2022-04-28T14:41:27.681610+0000","last_clean":"2022-04-28T14:41:27.681610+0000","last_became_active":"2022-04-28T14:39:13.951984+0000","last_became_peered":"2022-04-28T14:39:13.951984+0000","last_unstale":"2022-04-28T14:41:27.681610+0000","last_undegraded":"2022-04-28T14:41:27.681610+0000","last_fullsized":"2022-04-28T14:41:27.681610+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.161182+0000","last_change":"2022-04-28T14:39:05.388548+0000","last_active":"2022-04-28T14:41:27.161182+0000","last_peered":"2022-04-28T14:41:27.161182+0000","last_clean":"2022-04-28T14:41:27.161182+0000","last_became_active":"2022-04-28T14:39:05.388215+0000","last_became_peered":"2022-04-28T14:39:05.388215+0000","last_unstale":"2022-04-28T14:41:27.161182+0000","last_undegraded":"2022-04-28T14:41:27.161182+0000","last_fullsized":"2022-04-28T14:41:27.161182+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.161838+0000","last_change":"2022-04-28T14:39:13.627277+0000","last_active":"2022-04-28T14:41:27.161838+0000","last_peered":"2022-04-28T14:41:27.161838+0000","last_clean":"2022-04-28T14:41:27.161838+0000","last_became_active":"2022-04-28T14:39:13.626883+0000","last_became_peered":"2022-04-28T14:39:13.626883+0000","last_unstale":"2022-04-28T14:41:27.161838+0000","last_undegraded":"2022-04-28T14:41:27.161838+0000","last_fullsized":"2022-04-28T14:41:27.161838+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.157298+0000","last_change":"2022-04-28T14:39:05.388784+0000","last_active":"2022-04-28T14:41:27.157298+0000","last_peered":"2022-04-28T14:41:27.157298+0000","last_clean":"2022-04-28T14:41:27.157298+0000","last_became_active":"2022-04-28T14:39:05.388043+0000","last_became_peered":"2022-04-28T14:39:05.388043+0000","last_unstale":"2022-04-28T14:41:27.157298+0000","last_undegraded":"2022-04-28T14:41:27.157298+0000","last_fullsized":"2022-04-28T14:41:27.157298+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.159668+0000","last_change":"2022-04-28T14:39:13.622411+0000","last_active":"2022-04-28T14:41:27.159668+0000","last_peered":"2022-04-28T14:41:27.159668+0000","last_clean":"2022-04-28T14:41:27.159668+0000","last_became_active":"2022-04-28T14:39:13.621590+0000","last_became_peered":"2022-04-28T14:39:13.621590+0000","last_unstale":"2022-04-28T14:41:27.159668+0000","last_undegraded":"2022-04-28T14:41:27.159668+0000","last_fullsized":"2022-04-28T14:41:27.159668+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.680604+0000","last_change":"2022-04-28T14:39:13.955187+0000","last_active":"2022-04-28T14:41:27.680604+0000","last_peered":"2022-04-28T14:41:27.680604+0000","last_clean":"2022-04-28T14:41:27.680604+0000","last_became_active":"2022-04-28T14:39:13.954831+0000","last_became_peered":"2022-04-28T14:39:13.954831+0000","last_unstale":"2022-04-28T14:41:27.680604+0000","last_undegraded":"2022-04-28T14:41:27.680604+0000","last_fullsized":"2022-04-28T14:41:27.680604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.680544+0000","last_change":"2022-04-28T14:39:05.390881+0000","last_active":"2022-04-28T14:41:27.680544+0000","last_peered":"2022-04-28T14:41:27.680544+0000","last_clean":"2022-04-28T14:41:27.680544+0000","last_became_active":"2022-04-28T14:39:05.390559+0000","last_became_peered":"2022-04-28T14:39:05.390559+0000","last_unstale":"2022-04-28T14:41:27.680544+0000","last_undegraded":"2022-04-28T14:41:27.680544+0000","last_fullsized":"2022-04-28T14:41:27.680544+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"16'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.156358+0000","last_change":"2022-04-28T14:39:13.608628+0000","last_active":"2022-04-28T14:41:27.156358+0000","last_peered":"2022-04-28T14:41:27.156358+0000","last_clean":"2022-04-28T14:41:27.156358+0000","last_became_active":"2022-04-28T14:39:13.608261+0000","last_became_peered":"2022-04-28T14:39:13.608261+0000","last_unstale":"2022-04-28T14:41:27.156358+0000","last_undegraded":"2022-04-28T14:41:27.156358+0000","last_fullsized":"2022-04-28T14:41:27.156358+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.156564+0000","last_change":"2022-04-28T14:39:13.944110+0000","last_active":"2022-04-28T14:41:27.156564+0000","last_peered":"2022-04-28T14:41:27.156564+0000","last_clean":"2022-04-28T14:41:27.156564+0000","last_became_active":"2022-04-28T14:39:13.943780+0000","last_became_peered":"2022-04-28T14:39:13.943780+0000","last_unstale":"2022-04-28T14:41:27.156564+0000","last_undegraded":"2022-04-28T14:41:27.156564+0000","last_fullsized":"2022-04-28T14:41:27.156564+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.156702+0000","last_change":"2022-04-28T14:39:05.390962+0000","last_active":"2022-04-28T14:41:27.156702+0000","last_peered":"2022-04-28T14:41:27.156702+0000","last_clean":"2022-04-28T14:41:27.156702+0000","last_became_active":"2022-04-28T14:39:05.390602+0000","last_became_peered":"2022-04-28T14:39:05.390602+0000","last_unstale":"2022-04-28T14:41:27.156702+0000","last_undegraded":"2022-04-28T14:41:27.156702+0000","last_fullsized":"2022-04-28T14:41:27.156702+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'3","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.161104+0000","last_change":"2022-04-28T14:39:13.614524+0000","last_active":"2022-04-28T14:41:27.161104+0000","last_peered":"2022-04-28T14:41:27.161104+0000","last_clean":"2022-04-28T14:41:27.161104+0000","last_became_active":"2022-04-28T14:39:13.614177+0000","last_became_peered":"2022-04-28T14:39:13.614177+0000","last_unstale":"2022-04-28T14:41:27.161104+0000","last_undegraded":"2022-04-28T14:41:27.161104+0000","last_fullsized":"2022-04-28T14:41:27.161104+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.160373+0000","last_change":"2022-04-28T14:39:13.960464+0000","last_active":"2022-04-28T14:41:27.160373+0000","last_peered":"2022-04-28T14:41:27.160373+0000","last_clean":"2022-04-28T14:41:27.160373+0000","last_became_active":"2022-04-28T14:39:13.958817+0000","last_became_peered":"2022-04-28T14:39:13.958817+0000","last_unstale":"2022-04-28T14:41:27.160373+0000","last_undegraded":"2022-04-28T14:41:27.160373+0000","last_fullsized":"2022-04-28T14:41:27.160373+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.159865+0000","last_change":"2022-04-28T14:39:05.389329+0000","last_active":"2022-04-28T14:41:27.159865+0000","last_peered":"2022-04-28T14:41:27.159865+0000","last_clean":"2022-04-28T14:41:27.159865+0000","last_became_active":"2022-04-28T14:39:05.389030+0000","last_became_peered":"2022-04-28T14:39:05.389030+0000","last_unstale":"2022-04-28T14:41:27.159865+0000","last_undegraded":"2022-04-28T14:41:27.159865+0000","last_fullsized":"2022-04-28T14:41:27.159865+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.160554+0000","last_change":"2022-04-28T14:39:13.624225+0000","last_active":"2022-04-28T14:41:27.160554+0000","last_peered":"2022-04-28T14:41:27.160554+0000","last_clean":"2022-04-28T14:41:27.160554+0000","last_became_active":"2022-04-28T14:39:13.623631+0000","last_became_peered":"2022-04-28T14:39:13.623631+0000","last_unstale":"2022-04-28T14:41:27.160554+0000","last_undegraded":"2022-04-28T14:41:27.160554+0000","last_fullsized":"2022-04-28T14:41:27.160554+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.681526+0000","last_change":"2022-04-28T14:39:13.951379+0000","last_active":"2022-04-28T14:41:27.681526+0000","last_peered":"2022-04-28T14:41:27.681526+0000","last_clean":"2022-04-28T14:41:27.681526+0000","last_became_active":"2022-04-28T14:39:13.950657+0000","last_became_peered":"2022-04-28T14:39:13.950657+0000","last_unstale":"2022-04-28T14:41:27.681526+0000","last_undegraded":"2022-04-28T14:41:27.681526+0000","last_fullsized":"2022-04-28T14:41:27.681526+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.161701+0000","last_change":"2022-04-28T14:39:05.388553+0000","last_active":"2022-04-28T14:41:27.161701+0000","last_peered":"2022-04-28T14:41:27.161701+0000","last_clean":"2022-04-28T14:41:27.161701+0000","last_became_active":"2022-04-28T14:39:05.388170+0000","last_became_peered":"2022-04-28T14:39:05.388170+0000","last_unstale":"2022-04-28T14:41:27.161701+0000","last_undegraded":"2022-04-28T14:41:27.161701+0000","last_fullsized":"2022-04-28T14:41:27.161701+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.161603+0000","last_change":"2022-04-28T14:39:13.627446+0000","last_active":"2022-04-28T14:41:27.161603+0000","last_peered":"2022-04-28T14:41:27.161603+0000","last_clean":"2022-04-28T14:41:27.161603+0000","last_became_active":"2022-04-28T14:39:13.627067+0000","last_became_peered":"2022-04-28T14:39:13.627067+0000","last_unstale":"2022-04-28T14:41:27.161603+0000","last_undegraded":"2022-04-28T14:41:27.161603+0000","last_fullsized":"2022-04-28T14:41:27.161603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.157773+0000","last_change":"2022-04-28T14:39:13.951391+0000","last_active":"2022-04-28T14:41:27.157773+0000","last_peered":"2022-04-28T14:41:27.157773+0000","last_clean":"2022-04-28T14:41:27.157773+0000","last_became_active":"2022-04-28T14:39:13.951063+0000","last_became_peered":"2022-04-28T14:39:13.951063+0000","last_unstale":"2022-04-28T14:41:27.157773+0000","last_undegraded":"2022-04-28T14:41:27.157773+0000","last_fullsized":"2022-04-28T14:41:27.157773+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.157531+0000","last_change":"2022-04-28T14:39:05.388412+0000","last_active":"2022-04-28T14:41:27.157531+0000","last_peered":"2022-04-28T14:41:27.157531+0000","last_clean":"2022-04-28T14:41:27.157531+0000","last_became_active":"2022-04-28T14:39:05.388067+0000","last_became_peered":"2022-04-28T14:39:05.388067+0000","last_unstale":"2022-04-28T14:41:27.157531+0000","last_undegraded":"2022-04-28T14:41:27.157531+0000","last_fullsized":"2022-04-28T14:41:27.157531+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.157425+0000","last_change":"2022-04-28T14:39:13.609546+0000","last_active":"2022-04-28T14:41:27.157425+0000","last_peered":"2022-04-28T14:41:27.157425+0000","last_clean":"2022-04-28T14:41:27.157425+0000","last_became_active":"2022-04-28T14:39:13.609231+0000","last_became_peered":"2022-04-28T14:39:13.609231+0000","last_unstale":"2022-04-28T14:41:27.157425+0000","last_undegraded":"2022-04-28T14:41:27.157425+0000","last_fullsized":"2022-04-28T14:41:27.157425+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.157900+0000","last_change":"2022-04-28T14:39:13.971977+0000","last_active":"2022-04-28T14:41:27.157900+0000","last_peered":"2022-04-28T14:41:27.157900+0000","last_clean":"2022-04-28T14:41:27.157900+0000","last_became_active":"2022-04-28T14:39:13.971343+0000","last_became_peered":"2022-04-28T14:39:13.971343+0000","last_unstale":"2022-04-28T14:41:27.157900+0000","last_undegraded":"2022-04-28T14:41:27.157900+0000","last_fullsized":"2022-04-28T14:41:27.157900+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.161682+0000","last_change":"2022-04-28T14:39:13.970909+0000","last_active":"2022-04-28T14:41:27.161682+0000","last_peered":"2022-04-28T14:41:27.161682+0000","last_clean":"2022-04-28T14:41:27.161682+0000","last_became_active":"2022-04-28T14:39:13.970599+0000","last_became_peered":"2022-04-28T14:39:13.970599+0000","last_unstale":"2022-04-28T14:41:27.161682+0000","last_undegraded":"2022-04-28T14:41:27.161682+0000","last_fullsized":"2022-04-28T14:41:27.161682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.681887+0000","last_change":"2022-04-28T14:39:13.622383+0000","last_active":"2022-04-28T14:41:27.681887+0000","last_peered":"2022-04-28T14:41:27.681887+0000","last_clean":"2022-04-28T14:41:27.681887+0000","last_became_active":"2022-04-28T14:39:13.620810+0000","last_became_peered":"2022-04-28T14:39:13.620810+0000","last_unstale":"2022-04-28T14:41:27.681887+0000","last_undegraded":"2022-04-28T14:41:27.681887+0000","last_fullsized":"2022-04-28T14:41:27.681887+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.157324+0000","last_change":"2022-04-28T14:39:13.951426+0000","last_active":"2022-04-28T14:41:27.157324+0000","last_peered":"2022-04-28T14:41:27.157324+0000","last_clean":"2022-04-28T14:41:27.157324+0000","last_became_active":"2022-04-28T14:39:13.951111+0000","last_became_peered":"2022-04-28T14:39:13.951111+0000","last_unstale":"2022-04-28T14:41:27.157324+0000","last_undegraded":"2022-04-28T14:41:27.157324+0000","last_fullsized":"2022-04-28T14:41:27.157324+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.681660+0000","last_change":"2022-04-28T14:39:13.622151+0000","last_active":"2022-04-28T14:41:27.681660+0000","last_peered":"2022-04-28T14:41:27.681660+0000","last_clean":"2022-04-28T14:41:27.681660+0000","last_became_active":"2022-04-28T14:39:13.621812+0000","last_became_peered":"2022-04-28T14:39:13.621812+0000","last_unstale":"2022-04-28T14:41:27.681660+0000","last_undegraded":"2022-04-28T14:41:27.681660+0000","last_fullsized":"2022-04-28T14:41:27.681660+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.682556+0000","last_change":"2022-04-28T14:39:13.961409+0000","last_active":"2022-04-28T14:41:27.682556+0000","last_peered":"2022-04-28T14:41:27.682556+0000","last_clean":"2022-04-28T14:41:27.682556+0000","last_became_active":"2022-04-28T14:39:13.961034+0000","last_became_peered":"2022-04-28T14:39:13.961034+0000","last_unstale":"2022-04-28T14:41:27.682556+0000","last_undegraded":"2022-04-28T14:41:27.682556+0000","last_fullsized":"2022-04-28T14:41:27.682556+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.161628+0000","last_change":"2022-04-28T14:39:13.627961+0000","last_active":"2022-04-28T14:41:27.161628+0000","last_peered":"2022-04-28T14:41:27.161628+0000","last_clean":"2022-04-28T14:41:27.161628+0000","last_became_active":"2022-04-28T14:39:13.627595+0000","last_became_peered":"2022-04-28T14:39:13.627595+0000","last_unstale":"2022-04-28T14:41:27.161628+0000","last_undegraded":"2022-04-28T14:41:27.161628+0000","last_fullsized":"2022-04-28T14:41:27.161628+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.161888+0000","last_change":"2022-04-28T14:39:13.973251+0000","last_active":"2022-04-28T14:41:27.161888+0000","last_peered":"2022-04-28T14:41:27.161888+0000","last_clean":"2022-04-28T14:41:27.161888+0000","last_became_active":"2022-04-28T14:39:13.973008+0000","last_became_peered":"2022-04-28T14:39:13.973008+0000","last_unstale":"2022-04-28T14:41:27.161888+0000","last_undegraded":"2022-04-28T14:41:27.161888+0000","last_fullsized":"2022-04-28T14:41:27.161888+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"15'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.682411+0000","last_change":"2022-04-28T14:39:13.619997+0000","last_active":"2022-04-28T14:41:27.682411+0000","last_peered":"2022-04-28T14:41:27.682411+0000","last_clean":"2022-04-28T14:41:27.682411+0000","last_became_active":"2022-04-28T14:39:13.619739+0000","last_became_peered":"2022-04-28T14:39:13.619739+0000","last_unstale":"2022-04-28T14:41:27.682411+0000","last_undegraded":"2022-04-28T14:41:27.682411+0000","last_fullsized":"2022-04-28T14:41:27.682411+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.156529+0000","last_change":"2022-04-28T14:39:13.944278+0000","last_active":"2022-04-28T14:41:27.156529+0000","last_peered":"2022-04-28T14:41:27.156529+0000","last_clean":"2022-04-28T14:41:27.156529+0000","last_became_active":"2022-04-28T14:39:13.943973+0000","last_became_peered":"2022-04-28T14:39:13.943973+0000","last_unstale":"2022-04-28T14:41:27.156529+0000","last_undegraded":"2022-04-28T14:41:27.156529+0000","last_fullsized":"2022-04-28T14:41:27.156529+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.159870+0000","last_change":"2022-04-28T14:39:13.622598+0000","last_active":"2022-04-28T14:41:27.159870+0000","last_peered":"2022-04-28T14:41:27.159870+0000","last_clean":"2022-04-28T14:41:27.159870+0000","last_became_active":"2022-04-28T14:39:13.622080+0000","last_became_peered":"2022-04-28T14:39:13.622080+0000","last_unstale":"2022-04-28T14:41:27.159870+0000","last_undegraded":"2022-04-28T14:41:27.159870+0000","last_fullsized":"2022-04-28T14:41:27.159870+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.156423+0000","last_change":"2022-04-28T14:39:13.952416+0000","last_active":"2022-04-28T14:41:27.156423+0000","last_peered":"2022-04-28T14:41:27.156423+0000","last_clean":"2022-04-28T14:41:27.156423+0000","last_became_active":"2022-04-28T14:39:13.952100+0000","last_became_peered":"2022-04-28T14:39:13.952100+0000","last_unstale":"2022-04-28T14:41:27.156423+0000","last_undegraded":"2022-04-28T14:41:27.156423+0000","last_fullsized":"2022-04-28T14:41:27.156423+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.156610+0000","last_change":"2022-04-28T14:39:13.602486+0000","last_active":"2022-04-28T14:41:27.156610+0000","last_peered":"2022-04-28T14:41:27.156610+0000","last_clean":"2022-04-28T14:41:27.156610+0000","last_became_active":"2022-04-28T14:39:13.602105+0000","last_became_peered":"2022-04-28T14:39:13.602105+0000","last_unstale":"2022-04-28T14:41:27.156610+0000","last_undegraded":"2022-04-28T14:41:27.156610+0000","last_fullsized":"2022-04-28T14:41:27.156610+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.681375+0000","last_change":"2022-04-28T14:39:13.964624+0000","last_active":"2022-04-28T14:41:27.681375+0000","last_peered":"2022-04-28T14:41:27.681375+0000","last_clean":"2022-04-28T14:41:27.681375+0000","last_became_active":"2022-04-28T14:39:13.964305+0000","last_became_peered":"2022-04-28T14:39:13.964305+0000","last_unstale":"2022-04-28T14:41:27.681375+0000","last_undegraded":"2022-04-28T14:41:27.681375+0000","last_fullsized":"2022-04-28T14:41:27.681375+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.160662+0000","last_change":"2022-04-28T14:39:13.624420+0000","last_active":"2022-04-28T14:41:27.160662+0000","last_peered":"2022-04-28T14:41:27.160662+0000","last_clean":"2022-04-28T14:41:27.160662+0000","last_became_active":"2022-04-28T14:39:13.623884+0000","last_became_peered":"2022-04-28T14:39:13.623884+0000","last_unstale":"2022-04-28T14:41:27.160662+0000","last_undegraded":"2022-04-28T14:41:27.160662+0000","last_fullsized":"2022-04-28T14:41:27.160662+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.160420+0000","last_change":"2022-04-28T14:39:13.960655+0000","last_active":"2022-04-28T14:41:27.160420+0000","last_peered":"2022-04-28T14:41:27.160420+0000","last_clean":"2022-04-28T14:41:27.160420+0000","last_became_active":"2022-04-28T14:39:13.960060+0000","last_became_peered":"2022-04-28T14:39:13.960060+0000","last_unstale":"2022-04-28T14:41:27.160420+0000","last_undegraded":"2022-04-28T14:41:27.160420+0000","last_fullsized":"2022-04-28T14:41:27.160420+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.161304+0000","last_change":"2022-04-28T14:39:13.624344+0000","last_active":"2022-04-28T14:41:27.161304+0000","last_peered":"2022-04-28T14:41:27.161304+0000","last_clean":"2022-04-28T14:41:27.161304+0000","last_became_active":"2022-04-28T14:39:13.623843+0000","last_became_peered":"2022-04-28T14:39:13.623843+0000","last_unstale":"2022-04-28T14:41:27.161304+0000","last_undegraded":"2022-04-28T14:41:27.161304+0000","last_fullsized":"2022-04-28T14:41:27.161304+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.157916+0000","last_change":"2022-04-28T14:39:13.969259+0000","last_active":"2022-04-28T14:41:27.157916+0000","last_peered":"2022-04-28T14:41:27.157916+0000","last_clean":"2022-04-28T14:41:27.157916+0000","last_became_active":"2022-04-28T14:39:13.968448+0000","last_became_peered":"2022-04-28T14:39:13.968448+0000","last_unstale":"2022-04-28T14:41:27.157916+0000","last_undegraded":"2022-04-28T14:41:27.157916+0000","last_fullsized":"2022-04-28T14:41:27.157916+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.157600+0000","last_change":"2022-04-28T14:39:13.609457+0000","last_active":"2022-04-28T14:41:27.157600+0000","last_peered":"2022-04-28T14:41:27.157600+0000","last_clean":"2022-04-28T14:41:27.157600+0000","last_became_active":"2022-04-28T14:39:13.609114+0000","last_became_peered":"2022-04-28T14:39:13.609114+0000","last_unstale":"2022-04-28T14:41:27.157600+0000","last_undegraded":"2022-04-28T14:41:27.157600+0000","last_fullsized":"2022-04-28T14:41:27.157600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.161307+0000","last_change":"2022-04-28T14:39:13.960837+0000","last_active":"2022-04-28T14:41:27.161307+0000","last_peered":"2022-04-28T14:41:27.161307+0000","last_clean":"2022-04-28T14:41:27.161307+0000","last_became_active":"2022-04-28T14:39:13.960511+0000","last_became_peered":"2022-04-28T14:39:13.960511+0000","last_unstale":"2022-04-28T14:41:27.161307+0000","last_undegraded":"2022-04-28T14:41:27.161307+0000","last_fullsized":"2022-04-28T14:41:27.161307+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"16'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.158173+0000","last_change":"2022-04-28T14:39:13.600840+0000","last_active":"2022-04-28T14:41:27.158173+0000","last_peered":"2022-04-28T14:41:27.158173+0000","last_clean":"2022-04-28T14:41:27.158173+0000","last_became_active":"2022-04-28T14:39:13.600508+0000","last_became_peered":"2022-04-28T14:39:13.600508+0000","last_unstale":"2022-04-28T14:41:27.158173+0000","last_undegraded":"2022-04-28T14:41:27.158173+0000","last_fullsized":"2022-04-28T14:41:27.158173+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.161768+0000","last_change":"2022-04-28T14:39:13.968364+0000","last_active":"2022-04-28T14:41:27.161768+0000","last_peered":"2022-04-28T14:41:27.161768+0000","last_clean":"2022-04-28T14:41:27.161768+0000","last_became_active":"2022-04-28T14:39:13.968054+0000","last_became_peered":"2022-04-28T14:39:13.968054+0000","last_unstale":"2022-04-28T14:41:27.161768+0000","last_undegraded":"2022-04-28T14:41:27.161768+0000","last_fullsized":"2022-04-28T14:41:27.161768+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"17'3","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.681999+0000","last_change":"2022-04-28T14:39:13.623080+0000","last_active":"2022-04-28T14:41:27.681999+0000","last_peered":"2022-04-28T14:41:27.681999+0000","last_clean":"2022-04-28T14:41:27.681999+0000","last_became_active":"2022-04-28T14:39:13.622568+0000","last_became_peered":"2022-04-28T14:39:13.622568+0000","last_unstale":"2022-04-28T14:41:27.681999+0000","last_undegraded":"2022-04-28T14:41:27.681999+0000","last_fullsized":"2022-04-28T14:41:27.681999+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.158313+0000","last_change":"2022-04-28T14:39:13.972567+0000","last_active":"2022-04-28T14:41:27.158313+0000","last_peered":"2022-04-28T14:41:27.158313+0000","last_clean":"2022-04-28T14:41:27.158313+0000","last_became_active":"2022-04-28T14:39:13.972179+0000","last_became_peered":"2022-04-28T14:39:13.972179+0000","last_unstale":"2022-04-28T14:41:27.158313+0000","last_undegraded":"2022-04-28T14:41:27.158313+0000","last_fullsized":"2022-04-28T14:41:27.158313+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"16'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.161959+0000","last_change":"2022-04-28T14:39:13.622222+0000","last_active":"2022-04-28T14:41:27.161959+0000","last_peered":"2022-04-28T14:41:27.161959+0000","last_clean":"2022-04-28T14:41:27.161959+0000","last_became_active":"2022-04-28T14:39:13.621872+0000","last_became_peered":"2022-04-28T14:39:13.621872+0000","last_unstale":"2022-04-28T14:41:27.161959+0000","last_undegraded":"2022-04-28T14:41:27.161959+0000","last_fullsized":"2022-04-28T14:41:27.161959+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.159758+0000","last_change":"2022-04-28T14:39:13.958395+0000","last_active":"2022-04-28T14:41:27.159758+0000","last_peered":"2022-04-28T14:41:27.159758+0000","last_clean":"2022-04-28T14:41:27.159758+0000","last_became_active":"2022-04-28T14:39:13.957976+0000","last_became_peered":"2022-04-28T14:39:13.957976+0000","last_unstale":"2022-04-28T14:41:27.159758+0000","last_undegraded":"2022-04-28T14:41:27.159758+0000","last_fullsized":"2022-04-28T14:41:27.159758+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"16'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.160018+0000","last_change":"2022-04-28T14:39:13.622467+0000","last_active":"2022-04-28T14:41:27.160018+0000","last_peered":"2022-04-28T14:41:27.160018+0000","last_clean":"2022-04-28T14:41:27.160018+0000","last_became_active":"2022-04-28T14:39:13.621838+0000","last_became_peered":"2022-04-28T14:39:13.621838+0000","last_unstale":"2022-04-28T14:41:27.160018+0000","last_undegraded":"2022-04-28T14:41:27.160018+0000","last_fullsized":"2022-04-28T14:41:27.160018+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.159346+0000","last_change":"2022-04-28T14:39:13.958646+0000","last_active":"2022-04-28T14:41:27.159346+0000","last_peered":"2022-04-28T14:41:27.159346+0000","last_clean":"2022-04-28T14:41:27.159346+0000","last_became_active":"2022-04-28T14:39:13.957994+0000","last_became_peered":"2022-04-28T14:39:13.957994+0000","last_unstale":"2022-04-28T14:41:27.159346+0000","last_undegraded":"2022-04-28T14:41:27.159346+0000","last_fullsized":"2022-04-28T14:41:27.159346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.158360+0000","last_change":"2022-04-28T14:39:13.614008+0000","last_active":"2022-04-28T14:41:27.158360+0000","last_peered":"2022-04-28T14:41:27.158360+0000","last_clean":"2022-04-28T14:41:27.158360+0000","last_became_active":"2022-04-28T14:39:13.613702+0000","last_became_peered":"2022-04-28T14:39:13.613702+0000","last_unstale":"2022-04-28T14:41:27.158360+0000","last_undegraded":"2022-04-28T14:41:27.158360+0000","last_fullsized":"2022-04-28T14:41:27.158360+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.681155+0000","last_change":"2022-04-28T14:39:13.950979+0000","last_active":"2022-04-28T14:41:27.681155+0000","last_peered":"2022-04-28T14:41:27.681155+0000","last_clean":"2022-04-28T14:41:27.681155+0000","last_became_active":"2022-04-28T14:39:13.950168+0000","last_became_peered":"2022-04-28T14:39:13.950168+0000","last_unstale":"2022-04-28T14:41:27.681155+0000","last_undegraded":"2022-04-28T14:41:27.681155+0000","last_fullsized":"2022-04-28T14:41:27.681155+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"17'4","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.158560+0000","last_change":"2022-04-28T14:39:13.617031+0000","last_active":"2022-04-28T14:41:27.158560+0000","last_peered":"2022-04-28T14:41:27.158560+0000","last_clean":"2022-04-28T14:41:27.158560+0000","last_became_active":"2022-04-28T14:39:13.615420+0000","last_became_peered":"2022-04-28T14:39:13.615420+0000","last_unstale":"2022-04-28T14:41:27.158560+0000","last_undegraded":"2022-04-28T14:41:27.158560+0000","last_fullsized":"2022-04-28T14:41:27.158560+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.158425+0000","last_change":"2022-04-28T14:39:13.954485+0000","last_active":"2022-04-28T14:41:27.158425+0000","last_peered":"2022-04-28T14:41:27.158425+0000","last_clean":"2022-04-28T14:41:27.158425+0000","last_became_active":"2022-04-28T14:39:13.954179+0000","last_became_peered":"2022-04-28T14:39:13.954179+0000","last_unstale":"2022-04-28T14:41:27.158425+0000","last_undegraded":"2022-04-28T14:41:27.158425+0000","last_fullsized":"2022-04-28T14:41:27.158425+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"16'3","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.157603+0000","last_change":"2022-04-28T14:39:13.608868+0000","last_active":"2022-04-28T14:41:27.157603+0000","last_peered":"2022-04-28T14:41:27.157603+0000","last_clean":"2022-04-28T14:41:27.157603+0000","last_became_active":"2022-04-28T14:39:13.608590+0000","last_became_peered":"2022-04-28T14:39:13.608590+0000","last_unstale":"2022-04-28T14:41:27.157603+0000","last_undegraded":"2022-04-28T14:41:27.157603+0000","last_fullsized":"2022-04-28T14:41:27.157603+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.161412+0000","last_change":"2022-04-28T14:39:13.966189+0000","last_active":"2022-04-28T14:41:27.161412+0000","last_peered":"2022-04-28T14:41:27.161412+0000","last_clean":"2022-04-28T14:41:27.161412+0000","last_became_active":"2022-04-28T14:39:13.965877+0000","last_became_peered":"2022-04-28T14:39:13.965877+0000","last_unstale":"2022-04-28T14:41:27.161412+0000","last_undegraded":"2022-04-28T14:41:27.161412+0000","last_fullsized":"2022-04-28T14:41:27.161412+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.156959+0000","last_change":"2022-04-28T14:39:13.601488+0000","last_active":"2022-04-28T14:41:27.156959+0000","last_peered":"2022-04-28T14:41:27.156959+0000","last_clean":"2022-04-28T14:41:27.156959+0000","last_became_active":"2022-04-28T14:39:13.601122+0000","last_became_peered":"2022-04-28T14:39:13.601122+0000","last_unstale":"2022-04-28T14:41:27.156959+0000","last_undegraded":"2022-04-28T14:41:27.156959+0000","last_fullsized":"2022-04-28T14:41:27.156959+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.681888+0000","last_change":"2022-04-28T14:39:13.951897+0000","last_active":"2022-04-28T14:41:27.681888+0000","last_peered":"2022-04-28T14:41:27.681888+0000","last_clean":"2022-04-28T14:41:27.681888+0000","last_became_active":"2022-04-28T14:39:13.951314+0000","last_became_peered":"2022-04-28T14:39:13.951314+0000","last_unstale":"2022-04-28T14:41:27.681888+0000","last_undegraded":"2022-04-28T14:41:27.681888+0000","last_fullsized":"2022-04-28T14:41:27.681888+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.161746+0000","last_change":"2022-04-28T14:39:13.615041+0000","last_active":"2022-04-28T14:41:27.161746+0000","last_peered":"2022-04-28T14:41:27.161746+0000","last_clean":"2022-04-28T14:41:27.161746+0000","last_became_active":"2022-04-28T14:39:13.614710+0000","last_became_peered":"2022-04-28T14:39:13.614710+0000","last_unstale":"2022-04-28T14:41:27.161746+0000","last_undegraded":"2022-04-28T14:41:27.161746+0000","last_fullsized":"2022-04-28T14:41:27.161746+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.161713+0000","last_change":"2022-04-28T14:39:13.971986+0000","last_active":"2022-04-28T14:41:27.161713+0000","last_peered":"2022-04-28T14:41:27.161713+0000","last_clean":"2022-04-28T14:41:27.161713+0000","last_became_active":"2022-04-28T14:39:13.971243+0000","last_became_peered":"2022-04-28T14:39:13.971243+0000","last_unstale":"2022-04-28T14:41:27.161713+0000","last_undegraded":"2022-04-28T14:41:27.161713+0000","last_fullsized":"2022-04-28T14:41:27.161713+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.158313+0000","last_change":"2022-04-28T14:39:13.613362+0000","last_active":"2022-04-28T14:41:27.158313+0000","last_peered":"2022-04-28T14:41:27.158313+0000","last_clean":"2022-04-28T14:41:27.158313+0000","last_became_active":"2022-04-28T14:39:13.612969+0000","last_became_peered":"2022-04-28T14:39:13.612969+0000","last_unstale":"2022-04-28T14:41:27.158313+0000","last_undegraded":"2022-04-28T14:41:27.158313+0000","last_fullsized":"2022-04-28T14:41:27.158313+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.158412+0000","last_change":"2022-04-28T14:39:13.972552+0000","last_active":"2022-04-28T14:41:27.158412+0000","last_peered":"2022-04-28T14:41:27.158412+0000","last_clean":"2022-04-28T14:41:27.158412+0000","last_became_active":"2022-04-28T14:39:13.970887+0000","last_became_peered":"2022-04-28T14:39:13.970887+0000","last_unstale":"2022-04-28T14:41:27.158412+0000","last_undegraded":"2022-04-28T14:41:27.158412+0000","last_fullsized":"2022-04-28T14:41:27.158412+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.161998+0000","last_change":"2022-04-28T14:39:13.628138+0000","last_active":"2022-04-28T14:41:27.161998+0000","last_peered":"2022-04-28T14:41:27.161998+0000","last_clean":"2022-04-28T14:41:27.161998+0000","last_became_active":"2022-04-28T14:39:13.627785+0000","last_became_peered":"2022-04-28T14:39:13.627785+0000","last_unstale":"2022-04-28T14:41:27.161998+0000","last_undegraded":"2022-04-28T14:41:27.161998+0000","last_fullsized":"2022-04-28T14:41:27.161998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.156333+0000","last_change":"2022-04-28T14:39:13.955799+0000","last_active":"2022-04-28T14:41:27.156333+0000","last_peered":"2022-04-28T14:41:27.156333+0000","last_clean":"2022-04-28T14:41:27.156333+0000","last_became_active":"2022-04-28T14:39:13.955495+0000","last_became_peered":"2022-04-28T14:39:13.955495+0000","last_unstale":"2022-04-28T14:41:27.156333+0000","last_undegraded":"2022-04-28T14:41:27.156333+0000","last_fullsized":"2022-04-28T14:41:27.156333+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"16'6","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.680542+0000","last_change":"2022-04-28T14:39:13.621432+0000","last_active":"2022-04-28T14:41:27.680542+0000","last_peered":"2022-04-28T14:41:27.680542+0000","last_clean":"2022-04-28T14:41:27.680542+0000","last_became_active":"2022-04-28T14:39:13.621080+0000","last_became_peered":"2022-04-28T14:39:13.621080+0000","last_unstale":"2022-04-28T14:41:27.680542+0000","last_undegraded":"2022-04-28T14:41:27.680542+0000","last_fullsized":"2022-04-28T14:41:27.680542+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.159789+0000","last_change":"2022-04-28T14:39:13.956112+0000","last_active":"2022-04-28T14:41:27.159789+0000","last_peered":"2022-04-28T14:41:27.159789+0000","last_clean":"2022-04-28T14:41:27.159789+0000","last_became_active":"2022-04-28T14:39:13.955792+0000","last_became_peered":"2022-04-28T14:39:13.955792+0000","last_unstale":"2022-04-28T14:41:27.159789+0000","last_undegraded":"2022-04-28T14:41:27.159789+0000","last_fullsized":"2022-04-28T14:41:27.159789+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.680898+0000","last_change":"2022-04-28T14:39:13.622128+0000","last_active":"2022-04-28T14:41:27.680898+0000","last_peered":"2022-04-28T14:41:27.680898+0000","last_clean":"2022-04-28T14:41:27.680898+0000","last_became_active":"2022-04-28T14:39:13.621790+0000","last_became_peered":"2022-04-28T14:39:13.621790+0000","last_unstale":"2022-04-28T14:41:27.680898+0000","last_undegraded":"2022-04-28T14:41:27.680898+0000","last_fullsized":"2022-04-28T14:41:27.680898+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.160971+0000","last_change":"2022-04-28T14:39:13.967323+0000","last_active":"2022-04-28T14:41:27.160971+0000","last_peered":"2022-04-28T14:41:27.160971+0000","last_clean":"2022-04-28T14:41:27.160971+0000","last_became_active":"2022-04-28T14:39:13.961173+0000","last_became_peered":"2022-04-28T14:39:13.961173+0000","last_unstale":"2022-04-28T14:41:27.160971+0000","last_undegraded":"2022-04-28T14:41:27.160971+0000","last_fullsized":"2022-04-28T14:41:27.160971+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.156568+0000","last_change":"2022-04-28T14:39:13.609625+0000","last_active":"2022-04-28T14:41:27.156568+0000","last_peered":"2022-04-28T14:41:27.156568+0000","last_clean":"2022-04-28T14:41:27.156568+0000","last_became_active":"2022-04-28T14:39:13.609062+0000","last_became_peered":"2022-04-28T14:39:13.609062+0000","last_unstale":"2022-04-28T14:41:27.156568+0000","last_undegraded":"2022-04-28T14:41:27.156568+0000","last_fullsized":"2022-04-28T14:41:27.156568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.680922+0000","last_change":"2022-04-28T14:39:13.963123+0000","last_active":"2022-04-28T14:41:27.680922+0000","last_peered":"2022-04-28T14:41:27.680922+0000","last_clean":"2022-04-28T14:41:27.680922+0000","last_became_active":"2022-04-28T14:39:13.962825+0000","last_became_peered":"2022-04-28T14:39:13.962825+0000","last_unstale":"2022-04-28T14:41:27.680922+0000","last_undegraded":"2022-04-28T14:41:27.680922+0000","last_fullsized":"2022-04-28T14:41:27.680922+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.157406+0000","last_change":"2022-04-28T14:39:13.603083+0000","last_active":"2022-04-28T14:41:27.157406+0000","last_peered":"2022-04-28T14:41:27.157406+0000","last_clean":"2022-04-28T14:41:27.157406+0000","last_became_active":"2022-04-28T14:39:13.602776+0000","last_became_peered":"2022-04-28T14:39:13.602776+0000","last_unstale":"2022-04-28T14:41:27.157406+0000","last_undegraded":"2022-04-28T14:41:27.157406+0000","last_fullsized":"2022-04-28T14:41:27.157406+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.681779+0000","last_change":"2022-04-28T14:39:13.971833+0000","last_active":"2022-04-28T14:41:27.681779+0000","last_peered":"2022-04-28T14:41:27.681779+0000","last_clean":"2022-04-28T14:41:27.681779+0000","last_became_active":"2022-04-28T14:39:13.971513+0000","last_became_peered":"2022-04-28T14:39:13.971513+0000","last_unstale":"2022-04-28T14:41:27.681779+0000","last_undegraded":"2022-04-28T14:41:27.681779+0000","last_fullsized":"2022-04-28T14:41:27.681779+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"18'12","reported_seq":27,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.161185+0000","last_change":"2022-04-28T14:39:13.619098+0000","last_active":"2022-04-28T14:41:27.161185+0000","last_peered":"2022-04-28T14:41:27.161185+0000","last_clean":"2022-04-28T14:41:27.161185+0000","last_became_active":"2022-04-28T14:39:13.618737+0000","last_became_peered":"2022-04-28T14:39:13.618737+0000","last_unstale":"2022-04-28T14:41:27.161185+0000","last_undegraded":"2022-04-28T14:41:27.161185+0000","last_fullsized":"2022-04-28T14:41:27.161185+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4014,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.682303+0000","last_change":"2022-04-28T14:39:13.951611+0000","last_active":"2022-04-28T14:41:27.682303+0000","last_peered":"2022-04-28T14:41:27.682303+0000","last_clean":"2022-04-28T14:41:27.682303+0000","last_became_active":"2022-04-28T14:39:13.951102+0000","last_became_peered":"2022-04-28T14:39:13.951102+0000","last_unstale":"2022-04-28T14:41:27.682303+0000","last_undegraded":"2022-04-28T14:41:27.682303+0000","last_fullsized":"2022-04-28T14:41:27.682303+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.157828+0000","last_change":"2022-04-28T14:39:13.618476+0000","last_active":"2022-04-28T14:41:27.157828+0000","last_peered":"2022-04-28T14:41:27.157828+0000","last_clean":"2022-04-28T14:41:27.157828+0000","last_became_active":"2022-04-28T14:39:13.617950+0000","last_became_peered":"2022-04-28T14:39:13.617950+0000","last_unstale":"2022-04-28T14:41:27.157828+0000","last_undegraded":"2022-04-28T14:41:27.157828+0000","last_fullsized":"2022-04-28T14:41:27.157828+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.157724+0000","last_change":"2022-04-28T14:39:13.969503+0000","last_active":"2022-04-28T14:41:27.157724+0000","last_peered":"2022-04-28T14:41:27.157724+0000","last_clean":"2022-04-28T14:41:27.157724+0000","last_became_active":"2022-04-28T14:39:13.969200+0000","last_became_peered":"2022-04-28T14:39:13.969200+0000","last_unstale":"2022-04-28T14:41:27.157724+0000","last_undegraded":"2022-04-28T14:41:27.157724+0000","last_fullsized":"2022-04-28T14:41:27.157724+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"16'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.158114+0000","last_change":"2022-04-28T14:39:13.613426+0000","last_active":"2022-04-28T14:41:27.158114+0000","last_peered":"2022-04-28T14:41:27.158114+0000","last_clean":"2022-04-28T14:41:27.158114+0000","last_became_active":"2022-04-28T14:39:13.613077+0000","last_became_peered":"2022-04-28T14:39:13.613077+0000","last_unstale":"2022-04-28T14:41:27.158114+0000","last_undegraded":"2022-04-28T14:41:27.158114+0000","last_fullsized":"2022-04-28T14:41:27.158114+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.681985+0000","last_change":"2022-04-28T14:39:13.953772+0000","last_active":"2022-04-28T14:41:27.681985+0000","last_peered":"2022-04-28T14:41:27.681985+0000","last_clean":"2022-04-28T14:41:27.681985+0000","last_became_active":"2022-04-28T14:39:13.953478+0000","last_became_peered":"2022-04-28T14:39:13.953478+0000","last_unstale":"2022-04-28T14:41:27.681985+0000","last_undegraded":"2022-04-28T14:41:27.681985+0000","last_fullsized":"2022-04-28T14:41:27.681985+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.682511+0000","last_change":"2022-04-28T14:39:13.606445+0000","last_active":"2022-04-28T14:41:27.682511+0000","last_peered":"2022-04-28T14:41:27.682511+0000","last_clean":"2022-04-28T14:41:27.682511+0000","last_became_active":"2022-04-28T14:39:13.606028+0000","last_became_peered":"2022-04-28T14:39:13.606028+0000","last_unstale":"2022-04-28T14:41:27.682511+0000","last_undegraded":"2022-04-28T14:41:27.682511+0000","last_fullsized":"2022-04-28T14:41:27.682511+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.680524+0000","last_change":"2022-04-28T14:39:13.951780+0000","last_active":"2022-04-28T14:41:27.680524+0000","last_peered":"2022-04-28T14:41:27.680524+0000","last_clean":"2022-04-28T14:41:27.680524+0000","last_became_active":"2022-04-28T14:39:13.951236+0000","last_became_peered":"2022-04-28T14:39:13.951236+0000","last_unstale":"2022-04-28T14:41:27.680524+0000","last_undegraded":"2022-04-28T14:41:27.680524+0000","last_fullsized":"2022-04-28T14:41:27.680524+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"16'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.680559+0000","last_change":"2022-04-28T14:39:13.621466+0000","last_active":"2022-04-28T14:41:27.680559+0000","last_peered":"2022-04-28T14:41:27.680559+0000","last_clean":"2022-04-28T14:41:27.680559+0000","last_became_active":"2022-04-28T14:39:13.621146+0000","last_became_peered":"2022-04-28T14:39:13.621146+0000","last_unstale":"2022-04-28T14:41:27.680559+0000","last_undegraded":"2022-04-28T14:41:27.680559+0000","last_fullsized":"2022-04-28T14:41:27.680559+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.160021+0000","last_change":"2022-04-28T14:39:13.960230+0000","last_active":"2022-04-28T14:41:27.160021+0000","last_peered":"2022-04-28T14:41:27.160021+0000","last_clean":"2022-04-28T14:41:27.160021+0000","last_became_active":"2022-04-28T14:39:13.958741+0000","last_became_peered":"2022-04-28T14:39:13.958741+0000","last_unstale":"2022-04-28T14:41:27.160021+0000","last_undegraded":"2022-04-28T14:41:27.160021+0000","last_fullsized":"2022-04-28T14:41:27.160021+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.157032+0000","last_change":"2022-04-28T14:39:13.603448+0000","last_active":"2022-04-28T14:41:27.157032+0000","last_peered":"2022-04-28T14:41:27.157032+0000","last_clean":"2022-04-28T14:41:27.157032+0000","last_became_active":"2022-04-28T14:39:13.603117+0000","last_became_peered":"2022-04-28T14:39:13.603117+0000","last_unstale":"2022-04-28T14:41:27.157032+0000","last_undegraded":"2022-04-28T14:41:27.157032+0000","last_fullsized":"2022-04-28T14:41:27.157032+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.681140+0000","last_change":"2022-04-28T14:39:13.951179+0000","last_active":"2022-04-28T14:41:27.681140+0000","last_peered":"2022-04-28T14:41:27.681140+0000","last_clean":"2022-04-28T14:41:27.681140+0000","last_became_active":"2022-04-28T14:39:13.950413+0000","last_became_peered":"2022-04-28T14:39:13.950413+0000","last_unstale":"2022-04-28T14:41:27.681140+0000","last_undegraded":"2022-04-28T14:41:27.681140+0000","last_fullsized":"2022-04-28T14:41:27.681140+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"15'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.156676+0000","last_change":"2022-04-28T14:39:13.609803+0000","last_active":"2022-04-28T14:41:27.156676+0000","last_peered":"2022-04-28T14:41:27.156676+0000","last_clean":"2022-04-28T14:41:27.156676+0000","last_became_active":"2022-04-28T14:39:13.609320+0000","last_became_peered":"2022-04-28T14:39:13.609320+0000","last_unstale":"2022-04-28T14:41:27.156676+0000","last_undegraded":"2022-04-28T14:41:27.156676+0000","last_fullsized":"2022-04-28T14:41:27.156676+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.156469+0000","last_change":"2022-04-28T14:39:13.953322+0000","last_active":"2022-04-28T14:41:27.156469+0000","last_peered":"2022-04-28T14:41:27.156469+0000","last_clean":"2022-04-28T14:41:27.156469+0000","last_became_active":"2022-04-28T14:39:13.952997+0000","last_became_peered":"2022-04-28T14:39:13.952997+0000","last_unstale":"2022-04-28T14:41:27.156469+0000","last_undegraded":"2022-04-28T14:41:27.156469+0000","last_fullsized":"2022-04-28T14:41:27.156469+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"15'1","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.681263+0000","last_change":"2022-04-28T14:39:13.624451+0000","last_active":"2022-04-28T14:41:27.681263+0000","last_peered":"2022-04-28T14:41:27.681263+0000","last_clean":"2022-04-28T14:41:27.681263+0000","last_became_active":"2022-04-28T14:39:13.624118+0000","last_became_peered":"2022-04-28T14:39:13.624118+0000","last_unstale":"2022-04-28T14:41:27.681263+0000","last_undegraded":"2022-04-28T14:41:27.681263+0000","last_fullsized":"2022-04-28T14:41:27.681263+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.681618+0000","last_change":"2022-04-28T14:39:13.956657+0000","last_active":"2022-04-28T14:41:27.681618+0000","last_peered":"2022-04-28T14:41:27.681618+0000","last_clean":"2022-04-28T14:41:27.681618+0000","last_became_active":"2022-04-28T14:39:13.956291+0000","last_became_peered":"2022-04-28T14:39:13.956291+0000","last_unstale":"2022-04-28T14:41:27.681618+0000","last_undegraded":"2022-04-28T14:41:27.681618+0000","last_fullsized":"2022-04-28T14:41:27.681618+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.682162+0000","last_change":"2022-04-28T14:39:13.621131+0000","last_active":"2022-04-28T14:41:27.682162+0000","last_peered":"2022-04-28T14:41:27.682162+0000","last_clean":"2022-04-28T14:41:27.682162+0000","last_became_active":"2022-04-28T14:39:13.620764+0000","last_became_peered":"2022-04-28T14:39:13.620764+0000","last_unstale":"2022-04-28T14:41:27.682162+0000","last_undegraded":"2022-04-28T14:41:27.682162+0000","last_fullsized":"2022-04-28T14:41:27.682162+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.157101+0000","last_change":"2022-04-28T14:39:13.971712+0000","last_active":"2022-04-28T14:41:27.157101+0000","last_peered":"2022-04-28T14:41:27.157101+0000","last_clean":"2022-04-28T14:41:27.157101+0000","last_became_active":"2022-04-28T14:39:13.970627+0000","last_became_peered":"2022-04-28T14:39:13.970627+0000","last_unstale":"2022-04-28T14:41:27.157101+0000","last_undegraded":"2022-04-28T14:41:27.157101+0000","last_fullsized":"2022-04-28T14:41:27.157101+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.157725+0000","last_change":"2022-04-28T14:39:13.618500+0000","last_active":"2022-04-28T14:41:27.157725+0000","last_peered":"2022-04-28T14:41:27.157725+0000","last_clean":"2022-04-28T14:41:27.157725+0000","last_became_active":"2022-04-28T14:39:13.618171+0000","last_became_peered":"2022-04-28T14:39:13.618171+0000","last_unstale":"2022-04-28T14:41:27.157725+0000","last_undegraded":"2022-04-28T14:41:27.157725+0000","last_fullsized":"2022-04-28T14:41:27.157725+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.682258+0000","last_change":"2022-04-28T14:39:13.966833+0000","last_active":"2022-04-28T14:41:27.682258+0000","last_peered":"2022-04-28T14:41:27.682258+0000","last_clean":"2022-04-28T14:41:27.682258+0000","last_became_active":"2022-04-28T14:39:13.963563+0000","last_became_peered":"2022-04-28T14:39:13.963563+0000","last_unstale":"2022-04-28T14:41:27.682258+0000","last_undegraded":"2022-04-28T14:41:27.682258+0000","last_fullsized":"2022-04-28T14:41:27.682258+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.682111+0000","last_change":"2022-04-28T14:39:13.622884+0000","last_active":"2022-04-28T14:41:27.682111+0000","last_peered":"2022-04-28T14:41:27.682111+0000","last_clean":"2022-04-28T14:41:27.682111+0000","last_became_active":"2022-04-28T14:39:13.617005+0000","last_became_peered":"2022-04-28T14:39:13.617005+0000","last_unstale":"2022-04-28T14:41:27.682111+0000","last_undegraded":"2022-04-28T14:41:27.682111+0000","last_fullsized":"2022-04-28T14:41:27.682111+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.158024+0000","last_change":"2022-04-28T14:39:13.951972+0000","last_active":"2022-04-28T14:41:27.158024+0000","last_peered":"2022-04-28T14:41:27.158024+0000","last_clean":"2022-04-28T14:41:27.158024+0000","last_became_active":"2022-04-28T14:39:13.951647+0000","last_became_peered":"2022-04-28T14:39:13.951647+0000","last_unstale":"2022-04-28T14:41:27.158024+0000","last_undegraded":"2022-04-28T14:41:27.158024+0000","last_fullsized":"2022-04-28T14:41:27.158024+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2022-04-28T14:41:27.157631+0000","last_change":"2022-04-28T14:39:13.619298+0000","last_active":"2022-04-28T14:41:27.157631+0000","last_peered":"2022-04-28T14:41:27.157631+0000","last_clean":"2022-04-28T14:41:27.157631+0000","last_became_active":"2022-04-28T14:39:13.618948+0000","last_became_peered":"2022-04-28T14:39:13.618948+0000","last_unstale":"2022-04-28T14:41:27.157631+0000","last_undegraded":"2022-04-28T14:41:27.157631+0000","last_fullsized":"2022-04-28T14:41:27.157631+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":8344,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":16688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705696,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048796,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323044,"statfs":{"total":96636764160,"available":95562797056,"internally_reserved":1073741824,"allocated":217088,"data_stored":67441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 28 14:41:07 2022","interfaces":[{"interface":"back","average":{"1min":0.26900000000000002,"5min":0.33300000000000002,"15min":0.34300000000000003},"min":{"1min":0.13800000000000001,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.50700000000000001,"5min":0.623,"15min":0.623},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.27300000000000002,"5min":0.33200000000000002,"15min":0.34200000000000003},"min":{"1min":0.16800000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.55100000000000005,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.308}]},{"osd":1,"last update":"Thu Apr 28 14:41:07 2022","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":0.32500000000000001,"15min":0.33200000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.47899999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.28599999999999998,"5min":0.34300000000000003,"15min":0.35299999999999998},"min":{"1min":0.155,"5min":0.155,"15min":0.155},"max":{"1min":0.56200000000000006,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Apr 28 14:41:07 2022","interfaces":[{"interface":"back","average":{"1min":0.29499999999999998,"5min":0.35799999999999998,"15min":0.36799999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.29499999999999998,"5min":0.36899999999999999,"15min":0.38100000000000001},"min":{"1min":0.16200000000000001,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.54200000000000004,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.32500000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705695,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048784,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323056,"statfs":{"total":96636764160,"available":95562809344,"internally_reserved":1073741824,"allocated":204800,"data_stored":61245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 28 14:41:05 2022","interfaces":[{"interface":"back","average":{"1min":0.249,"5min":0.27200000000000002,"15min":0.27600000000000002},"min":{"1min":0.20300000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.27400000000000002,"5min":0.442,"15min":0.442},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.308,"15min":0.314},"min":{"1min":0.222,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.31,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Apr 28 14:41:05 2022","interfaces":[{"interface":"back","average":{"1min":0.24199999999999999,"5min":0.28599999999999998,"15min":0.29299999999999998},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.33300000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.27000000000000002,"5min":0.314,"15min":0.32100000000000001},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.34000000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.44500000000000001}]},{"osd":3,"last update":"Thu Apr 28 14:41:05 2022","interfaces":[{"interface":"back","average":{"1min":0.24099999999999999,"5min":0.28699999999999998,"15min":0.29499999999999998},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.28599999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.432},{"interface":"front","average":{"1min":0.25,"5min":0.311,"15min":0.32100000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.29599999999999999,"5min":0.495,"15min":0.495},"last":0.49099999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705696,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048780,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323060,"statfs":{"total":96636764160,"available":95562813440,"internally_reserved":1073741824,"allocated":200704,"data_stored":60681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 28 14:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.24399999999999999,"5min":0.31,"15min":0.32100000000000001},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.308,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.24399999999999999,"5min":0.33200000000000002,"15min":0.34599999999999997},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.32400000000000001,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.28299999999999997}]},{"osd":1,"last update":"Thu Apr 28 14:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.26600000000000001,"5min":0.34200000000000003,"15min":0.35499999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.29799999999999999,"5min":0.629,"15min":0.629},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.26000000000000001,"5min":0.35099999999999998,"15min":0.36599999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.313,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.26500000000000001}]},{"osd":3,"last update":"Thu Apr 28 14:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.28399999999999997,"5min":0.38900000000000001,"15min":0.40699999999999997},"min":{"1min":0.24299999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.34599999999999997,"5min":1.325,"15min":1.325},"last":0.311},{"interface":"front","average":{"1min":0.26800000000000002,"5min":0.373,"15min":0.39100000000000001},"min":{"1min":0.217,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.32300000000000001,"5min":1.302,"15min":1.302},"last":0.246}]}]},{"osd":0,"up_from":9,"seq":38654705696,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1048792,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323048,"statfs":{"total":96636764160,"available":95562801152,"internally_reserved":1073741824,"allocated":212992,"data_stored":66781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 28 14:41:01 2022","interfaces":[{"interface":"back","average":{"1min":0.26100000000000001,"5min":0.29299999999999998,"15min":0.29899999999999999},"min":{"1min":0.186,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.43099999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.252,"5min":0.309,"15min":0.31900000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.40500000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.27900000000000003}]},{"osd":2,"last update":"Thu Apr 28 14:41:01 2022","interfaces":[{"interface":"back","average":{"1min":0.26400000000000001,"5min":0.33000000000000002,"15min":0.34100000000000003},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.443,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.309},{"interface":"front","average":{"1min":0.27400000000000002,"5min":0.32500000000000001,"15min":0.33300000000000002},"min":{"1min":0.22800000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.46200000000000002,"5min":0.497,"15min":0.497},"last":0.24399999999999999}]},{"osd":3,"last update":"Thu Apr 28 14:41:01 2022","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.34399999999999997,"15min":0.35199999999999998},"min":{"1min":0.222,"5min":0.216,"15min":0.216},"max":{"1min":0.48299999999999998,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.27900000000000003,"5min":0.35099999999999998,"15min":0.36299999999999999},"min":{"1min":0.19500000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.48999999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.25700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":6916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-04-28T14:41:33.221 INFO:tasks.ceph.ceph_manager.ceph:clean! 2022-04-28T14:41:33.221 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2022-04-28T14:41:33.222 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2022-04-28T14:41:33.222 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2022-04-28T14:41:33.339 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.334+0000 7fa563a1d700 1 Processor -- start 2022-04-28T14:41:33.339 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.335+0000 7fa563a1d700 1 -- start start 2022-04-28T14:41:33.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.335+0000 7fa563a1d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa55c0a5450 0x7fa55c067010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:33.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.335+0000 7fa563a1d700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa55c140b80 0x7fa55c142f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:33.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.335+0000 7fa563a1d700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa55c0a5cd0 con 0x7fa55c135740 2022-04-28T14:41:33.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.335+0000 7fa563a1d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55c0a5830 con 0x7fa55c0a5450 2022-04-28T14:41:33.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.335+0000 7fa563a1d700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c13c350 con 0x7fa55c140b80 2022-04-28T14:41:33.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.335+0000 7fa5617b9700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa55c0a5450 0x7fa55c067010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:33.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.335+0000 7fa561fba700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa55c140b80 0x7fa55c142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:33.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.335+0000 7fa560fb8700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa55c135740 0x7fa55c13b980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39884/0 (socket says 172.21.15.22:39884) 2022-04-28T14:41:33.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.335+0000 7fa560fb8700 1 -- 172.21.15.22:0/1737316591 learned_addr learned my addr 172.21.15.22:0/1737316591 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:41:33.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.336+0000 7fa5617b9700 1 -- 172.21.15.22:0/1737316591 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa55c140b80 msgr2=0x7fa55c142f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:33.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.336+0000 7fa5617b9700 1 --2- 172.21.15.22:0/1737316591 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa55c140b80 0x7fa55c142f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.336+0000 7fa5617b9700 1 -- 172.21.15.22:0/1737316591 >> v1:172.21.15.22:6789/0 conn(0x7fa55c135740 legacy=0x7fa55c13b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:33.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.336+0000 7fa5617b9700 1 -- 172.21.15.22:0/1737316591 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c13c5f0 con 0x7fa55c0a5450 2022-04-28T14:41:33.344 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.336+0000 7fa54ffff700 1 -- 172.21.15.22:0/1737316591 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3949266154 0 0) 0x7fa55c0a5cd0 con 0x7fa55c135740 2022-04-28T14:41:33.344 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.336+0000 7fa561fba700 1 --2- 172.21.15.22:0/1737316591 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa55c140b80 0x7fa55c142f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:33.344 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.336+0000 7fa5617b9700 1 --2- 172.21.15.22:0/1737316591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa55c0a5450 0x7fa55c067010 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fa550009760 tx=0x7fa550009060).ready entity=mon.0 client_cookie=784330d5a56b6377 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:33.344 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.336+0000 7fa54ffff700 1 -- 172.21.15.22:0/1737316591 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55000f510 con 0x7fa55c0a5450 2022-04-28T14:41:33.344 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.336+0000 7fa54ffff700 1 -- 172.21.15.22:0/1737316591 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55000f670 con 0x7fa55c0a5450 2022-04-28T14:41:33.344 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.336+0000 7fa54ffff700 1 -- 172.21.15.22:0/1737316591 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55000f9f0 con 0x7fa55c0a5450 2022-04-28T14:41:33.344 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.336+0000 7fa563a1d700 1 -- 172.21.15.22:0/1737316591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa55c0a5450 msgr2=0x7fa55c067010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:33.344 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.336+0000 7fa563a1d700 1 --2- 172.21.15.22:0/1737316591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa55c0a5450 0x7fa55c067010 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fa550009760 tx=0x7fa550009060).stop 2022-04-28T14:41:33.344 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.336+0000 7fa563a1d700 1 -- 172.21.15.22:0/1737316591 shutdown_connections 2022-04-28T14:41:33.344 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.336+0000 7fa563a1d700 1 --2- 172.21.15.22:0/1737316591 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa55c140b80 0x7fa55c142f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.345 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.336+0000 7fa563a1d700 1 --2- 172.21.15.22:0/1737316591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa55c0a5450 0x7fa55c067010 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.345 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.336+0000 7fa563a1d700 1 -- 172.21.15.22:0/1737316591 >> 172.21.15.22:0/1737316591 conn(0x7fa55c069860 msgr2=0x7fa55c069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:33.345 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.337+0000 7fa563a1d700 1 -- 172.21.15.22:0/1737316591 shutdown_connections 2022-04-28T14:41:33.345 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.337+0000 7fa563a1d700 1 -- 172.21.15.22:0/1737316591 wait complete. 2022-04-28T14:41:33.345 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.337+0000 7fa563a1d700 1 Processor -- start 2022-04-28T14:41:33.345 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.338+0000 7fa563a1d700 1 -- start start 2022-04-28T14:41:33.347 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.338+0000 7fa563a1d700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa55c0a5450 0x7fa55c137860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:33.347 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.338+0000 7fa563a1d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa55c135740 0x7fa55c14b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:33.348 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.338+0000 7fa563a1d700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa55c140b80 0x7fa55c1365d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:33.348 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.338+0000 7fa563a1d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c14c3c0 con 0x7fa55c135740 2022-04-28T14:41:33.348 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.338+0000 7fa563a1d700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c135cb0 con 0x7fa55c0a5450 2022-04-28T14:41:33.348 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.338+0000 7fa563a1d700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c13da70 con 0x7fa55c140b80 2022-04-28T14:41:33.348 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.338+0000 7fa561fba700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa55c140b80 0x7fa55c1365d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:33.348 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.338+0000 7fa5617b9700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa55c0a5450 0x7fa55c137860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:33.348 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.338+0000 7fa561fba700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa55c140b80 0x7fa55c1365d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:47850/0 (socket says 172.21.15.22:47850) 2022-04-28T14:41:33.348 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.338+0000 7fa561fba700 1 -- 172.21.15.22:0/2498064500 learned_addr learned my addr 172.21.15.22:0/2498064500 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:33.348 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.338+0000 7fa560fb8700 1 --2- 172.21.15.22:0/2498064500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa55c135740 0x7fa55c14b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:33.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.339+0000 7fa561fba700 1 -- 172.21.15.22:0/2498064500 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa55c0a5450 msgr2=0x7fa55c137860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:33.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.339+0000 7fa561fba700 1 --2- 172.21.15.22:0/2498064500 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa55c0a5450 0x7fa55c137860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.339+0000 7fa561fba700 1 -- 172.21.15.22:0/2498064500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa55c135740 msgr2=0x7fa55c14b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:33.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.339+0000 7fa561fba700 1 --2- 172.21.15.22:0/2498064500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa55c135740 0x7fa55c14b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.339+0000 7fa561fba700 1 -- 172.21.15.22:0/2498064500 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa554009a20 con 0x7fa55c140b80 2022-04-28T14:41:33.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.339+0000 7fa561fba700 1 --2- 172.21.15.22:0/2498064500 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa55c140b80 0x7fa55c1365d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fa554009ec0 tx=0x7fa55400b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:33.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.339+0000 7fa54d7fa700 1 -- 172.21.15.22:0/2498064500 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55400cb70 con 0x7fa55c140b80 2022-04-28T14:41:33.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.339+0000 7fa54d7fa700 1 -- 172.21.15.22:0/2498064500 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55400f040 con 0x7fa55c140b80 2022-04-28T14:41:33.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.339+0000 7fa563a1d700 1 -- 172.21.15.22:0/2498064500 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5500092a0 con 0x7fa55c140b80 2022-04-28T14:41:33.350 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.339+0000 7fa54d7fa700 1 -- 172.21.15.22:0/2498064500 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa554013400 con 0x7fa55c140b80 2022-04-28T14:41:33.350 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.339+0000 7fa563a1d700 1 -- 172.21.15.22:0/2498064500 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa55c14b440 con 0x7fa55c140b80 2022-04-28T14:41:33.350 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.340+0000 7fa563a1d700 1 -- 172.21.15.22:0/2498064500 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa55c14b6c0 con 0x7fa55c140b80 2022-04-28T14:41:33.350 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.340+0000 7fa54d7fa700 1 -- 172.21.15.22:0/2498064500 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7fa5540137b0 con 0x7fa55c140b80 2022-04-28T14:41:33.350 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.340+0000 7fa54d7fa700 1 -- 172.21.15.22:0/2498064500 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7fa554055db0 con 0x7fa55c140b80 2022-04-28T14:41:33.350 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.344+0000 7fa54d7fa700 1 -- 172.21.15.22:0/2498064500 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7fa5540363f0 con 0x7fa55c140b80 2022-04-28T14:41:33.510 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.505+0000 7fa563a1d700 1 -- 172.21.15.22:0/2498064500 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa55c046540 con 0x7fa55c140b80 2022-04-28T14:41:33.510 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.506+0000 7fa54d7fa700 1 -- 172.21.15.22:0/2498064500 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fa554039be0 con 0x7fa55c140b80 2022-04-28T14:41:33.511 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:41:33.512 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.507+0000 7fa563a1d700 1 -- 172.21.15.22:0/2498064500 >> v1:172.21.15.22:6808/92758 conn(0x7fa53c041b00 legacy=0x7fa53c043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:33.512 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.507+0000 7fa563a1d700 1 -- 172.21.15.22:0/2498064500 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa55c140b80 msgr2=0x7fa55c1365d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:33.512 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.507+0000 7fa563a1d700 1 --2- 172.21.15.22:0/2498064500 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa55c140b80 0x7fa55c1365d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fa554009ec0 tx=0x7fa55400b040).stop 2022-04-28T14:41:33.512 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.507+0000 7fa563a1d700 1 -- 172.21.15.22:0/2498064500 shutdown_connections 2022-04-28T14:41:33.512 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.507+0000 7fa563a1d700 1 --2- 172.21.15.22:0/2498064500 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa55c140b80 0x7fa55c1365d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.512 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.507+0000 7fa563a1d700 1 --2- 172.21.15.22:0/2498064500 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa55c0a5450 0x7fa55c137860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.512 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.507+0000 7fa563a1d700 1 --2- 172.21.15.22:0/2498064500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa55c135740 0x7fa55c14b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.513 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.507+0000 7fa563a1d700 1 -- 172.21.15.22:0/2498064500 >> 172.21.15.22:0/2498064500 conn(0x7fa55c069860 msgr2=0x7fa55c066b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:33.513 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.507+0000 7fa563a1d700 1 -- 172.21.15.22:0/2498064500 shutdown_connections 2022-04-28T14:41:33.513 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.507+0000 7fa563a1d700 1 -- 172.21.15.22:0/2498064500 wait complete. 2022-04-28T14:41:33.523 INFO:teuthology.orchestra.run.smithi022.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2022-04-28T14:41:33.523 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2022-04-28T14:41:33.524 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-28T14:41:33.642 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.637+0000 7f6adde8e700 1 Processor -- start 2022-04-28T14:41:33.642 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.637+0000 7f6adde8e700 1 -- start start 2022-04-28T14:41:33.645 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.638+0000 7f6adde8e700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6ad8068130 0x7f6ad8066c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:33.645 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.638+0000 7f6adde8e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6ad8068d00 0x7f6ad8061f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:33.645 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.638+0000 7f6adde8e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad8067330 con 0x7f6ad8062420 2022-04-28T14:41:33.645 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.638+0000 7f6adde8e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad80aa710 con 0x7f6ad8068d00 2022-04-28T14:41:33.645 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.638+0000 7f6adde8e700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad80a5bc0 con 0x7f6ad8068130 2022-04-28T14:41:33.645 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.638+0000 7f6ad77fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6ad8068130 0x7f6ad8066c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:33.645 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.638+0000 7f6ad6ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6ad8068d00 0x7f6ad8061f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:33.645 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.638+0000 7f6ad77fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6ad8068130 0x7f6ad8066c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:47854/0 (socket says 172.21.15.22:47854) 2022-04-28T14:41:33.645 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.638+0000 7f6ad77fe700 1 -- 172.21.15.22:0/2757746149 learned_addr learned my addr 172.21.15.22:0/2757746149 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:33.646 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.638+0000 7f6ad6ffd700 1 -- 172.21.15.22:0/2757746149 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6ad8068130 msgr2=0x7f6ad8066c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:33.646 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.638+0000 7f6ad6ffd700 1 --2- 172.21.15.22:0/2757746149 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6ad8068130 0x7f6ad8066c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.646 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.638+0000 7f6ad6ffd700 1 -- 172.21.15.22:0/2757746149 >> v1:172.21.15.22:6789/0 conn(0x7f6ad8062420 legacy=0x7f6ad80628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:33.646 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.638+0000 7f6ad6ffd700 1 -- 172.21.15.22:0/2757746149 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad80aa290 con 0x7f6ad8068d00 2022-04-28T14:41:33.646 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.638+0000 7f6ad67fc700 1 -- 172.21.15.22:0/2757746149 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2376310465 0 0) 0x7f6ad8067330 con 0x7f6ad8062420 2022-04-28T14:41:33.646 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.638+0000 7f6ad77fe700 1 --2- 172.21.15.22:0/2757746149 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6ad8068130 0x7f6ad8066c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:33.646 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.638+0000 7f6ad6ffd700 1 --2- 172.21.15.22:0/2757746149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad8068d00 0x7f6ad8061f30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f6ac8009760 tx=0x7f6ac8009060).ready entity=mon.0 client_cookie=47499075c031322f server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:33.646 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.638+0000 7f6ad67fc700 1 -- 172.21.15.22:0/2757746149 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac800f510 con 0x7f6ad8068d00 2022-04-28T14:41:33.646 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.638+0000 7f6ad67fc700 1 -- 172.21.15.22:0/2757746149 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac800f670 con 0x7f6ad8068d00 2022-04-28T14:41:33.647 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.638+0000 7f6ad67fc700 1 -- 172.21.15.22:0/2757746149 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac800f9f0 con 0x7f6ad8068d00 2022-04-28T14:41:33.647 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.639+0000 7f6adde8e700 1 -- 172.21.15.22:0/2757746149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad8068d00 msgr2=0x7f6ad8061f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:33.647 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.639+0000 7f6adde8e700 1 --2- 172.21.15.22:0/2757746149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad8068d00 0x7f6ad8061f30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f6ac8009760 tx=0x7f6ac8009060).stop 2022-04-28T14:41:33.647 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.639+0000 7f6adde8e700 1 -- 172.21.15.22:0/2757746149 shutdown_connections 2022-04-28T14:41:33.647 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.639+0000 7f6adde8e700 1 --2- 172.21.15.22:0/2757746149 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6ad8068130 0x7f6ad8066c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.647 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.639+0000 7f6adde8e700 1 --2- 172.21.15.22:0/2757746149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad8068d00 0x7f6ad8061f30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.647 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.639+0000 7f6adde8e700 1 -- 172.21.15.22:0/2757746149 >> 172.21.15.22:0/2757746149 conn(0x7f6ad80ae9d0 msgr2=0x7f6ad80aede0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:33.647 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.639+0000 7f6adde8e700 1 -- 172.21.15.22:0/2757746149 shutdown_connections 2022-04-28T14:41:33.647 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.639+0000 7f6adde8e700 1 -- 172.21.15.22:0/2757746149 wait complete. 2022-04-28T14:41:33.647 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.640+0000 7f6adde8e700 1 Processor -- start 2022-04-28T14:41:33.648 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.640+0000 7f6adde8e700 1 -- start start 2022-04-28T14:41:33.650 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.641+0000 7f6adde8e700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6ad8062420 0x7f6ad8096300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:33.651 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.641+0000 7f6adde8e700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6ad8068130 0x7f6ad8094f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:33.651 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.641+0000 7f6adde8e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad8068d00 0x7f6ad814b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:33.651 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.641+0000 7f6adde8e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad8096ca0 con 0x7f6ad8068d00 2022-04-28T14:41:33.651 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.641+0000 7f6adde8e700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad80957d0 con 0x7f6ad8068130 2022-04-28T14:41:33.651 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.641+0000 7f6adde8e700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad8095a90 con 0x7f6ad8062420 2022-04-28T14:41:33.651 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.641+0000 7f6ad77fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6ad8062420 0x7f6ad8096300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:33.652 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.641+0000 7f6ad77fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6ad8062420 0x7f6ad8096300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:47860/0 (socket says 172.21.15.22:47860) 2022-04-28T14:41:33.652 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.641+0000 7f6ad77fe700 1 -- 172.21.15.22:0/339345065 learned_addr learned my addr 172.21.15.22:0/339345065 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:33.652 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.641+0000 7f6ad7fff700 1 --2- 172.21.15.22:0/339345065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad8068d00 0x7f6ad814b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:33.652 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.641+0000 7f6ad6ffd700 1 --2- 172.21.15.22:0/339345065 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6ad8068130 0x7f6ad8094f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:33.652 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.641+0000 7f6ad77fe700 1 -- 172.21.15.22:0/339345065 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6ad8068130 msgr2=0x7f6ad8094f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:33.652 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.641+0000 7f6ad77fe700 1 --2- 172.21.15.22:0/339345065 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6ad8068130 0x7f6ad8094f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.653 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.641+0000 7f6ad77fe700 1 -- 172.21.15.22:0/339345065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad8068d00 msgr2=0x7f6ad814b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:33.653 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.641+0000 7f6ad77fe700 1 --2- 172.21.15.22:0/339345065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad8068d00 0x7f6ad814b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.653 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.641+0000 7f6ad77fe700 1 -- 172.21.15.22:0/339345065 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac0009370 con 0x7f6ad8062420 2022-04-28T14:41:33.653 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.641+0000 7f6ad7fff700 1 --2- 172.21.15.22:0/339345065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad8068d00 0x7f6ad814b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:33.653 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.641+0000 7f6ad77fe700 1 --2- 172.21.15.22:0/339345065 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6ad8062420 0x7f6ad8096300 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f6ac000ea20 tx=0x7f6ac00090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:33.653 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.641+0000 7f6acf7fe700 1 -- 172.21.15.22:0/339345065 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac000ee60 con 0x7f6ad8062420 2022-04-28T14:41:33.653 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.641+0000 7f6acf7fe700 1 -- 172.21.15.22:0/339345065 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac000c8e0 con 0x7f6ad8062420 2022-04-28T14:41:33.654 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.641+0000 7f6adde8e700 1 -- 172.21.15.22:0/339345065 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac80092a0 con 0x7f6ad8062420 2022-04-28T14:41:33.654 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.641+0000 7f6acf7fe700 1 -- 172.21.15.22:0/339345065 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac000cc60 con 0x7f6ad8062420 2022-04-28T14:41:33.654 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.641+0000 7f6adde8e700 1 -- 172.21.15.22:0/339345065 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad8095400 con 0x7f6ad8062420 2022-04-28T14:41:33.654 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.642+0000 7f6adde8e700 1 -- 172.21.15.22:0/339345065 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ad8097970 con 0x7f6ad8062420 2022-04-28T14:41:33.654 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.643+0000 7f6acf7fe700 1 -- 172.21.15.22:0/339345065 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f6ac0022070 con 0x7f6ad8062420 2022-04-28T14:41:33.654 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.643+0000 7f6acf7fe700 1 -- 172.21.15.22:0/339345065 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f6ac0055cf0 con 0x7f6ad8062420 2022-04-28T14:41:33.654 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.646+0000 7f6acf7fe700 1 -- 172.21.15.22:0/339345065 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f6ac00363d0 con 0x7f6ad8062420 2022-04-28T14:41:33.789 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.784+0000 7f6adde8e700 1 -- 172.21.15.22:0/339345065 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ad8097b70 con 0x7f6ad8062420 2022-04-28T14:41:33.790 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.785+0000 7f6acf7fe700 1 -- 172.21.15.22:0/339345065 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+11271 (secure 0 0 0) 0x7f6ac002a090 con 0x7f6ad8062420 2022-04-28T14:41:33.790 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:41:33.790 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":21,"fsid":"3047163a-0285-4058-8e05-ce74c6fbb9c5","created":"2022-04-28T14:38:54.232890+0000","modified":"2022-04-28T14:41:28.150125+0000","last_up_change":"2022-04-28T14:39:00.269721+0000","last_in_change":"2022-04-28T14:39:00.269721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-04-28T14:39:03.639717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-04-28T14:39:12.000229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-04-28T14:39:12.915097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"device_health_metrics","create_time":"2022-04-28T14:41:25.197740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"782ee638-1ada-48d9-9454-f9e0ca8a3135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6800","nonce":87556}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":87556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":87556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":87556}]},"public_addr":"172.21.15.22:6800/87556","cluster_addr":"172.21.15.22:6801/87556","heartbeat_back_addr":"172.21.15.22:6803/87556","heartbeat_front_addr":"172.21.15.22:6802/87556","state":["exists","up"]},{"osd":1,"uuid":"61ca6f96-fb4f-4c0f-b68b-edf1e7011f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":87557}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":87557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":87557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":87557}]},"public_addr":"172.21.15.22:6804/87557","cluster_addr":"172.21.15.22:6805/87557","heartbeat_back_addr":"172.21.15.22:6807/87557","heartbeat_front_addr":"172.21.15.22:6806/87557","state":["exists","up"]},{"osd":2,"uuid":"4b3043b9-50df-4b7f-a55a-ac8e6148c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":87558}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":87558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":87558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":87558}]},"public_addr":"172.21.15.22:6813/87558","cluster_addr":"172.21.15.22:6814/87558","heartbeat_back_addr":"172.21.15.22:6816/87558","heartbeat_front_addr":"172.21.15.22:6815/87558","state":["exists","up"]},{"osd":3,"uuid":"7807bcd1-53f8-44b5-9992-57c328e5b299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":87561}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":87561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":87561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":87561}]},"public_addr":"172.21.15.22:6809/87561","cluster_addr":"172.21.15.22:6810/87561","heartbeat_back_addr":"172.21.15.22:6812/87561","heartbeat_front_addr":"172.21.15.22:6811/87561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:6808/86956":"2022-04-29T14:41:24.302858+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-04-28T14:41:33.791 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.786+0000 7f6adde8e700 1 -- 172.21.15.22:0/339345065 >> v1:172.21.15.22:6808/92758 conn(0x7f6abc041b00 legacy=0x7f6abc043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:33.792 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.786+0000 7f6adde8e700 1 -- 172.21.15.22:0/339345065 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6ad8062420 msgr2=0x7f6ad8096300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:33.792 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.786+0000 7f6adde8e700 1 --2- 172.21.15.22:0/339345065 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6ad8062420 0x7f6ad8096300 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f6ac000ea20 tx=0x7f6ac00090f0).stop 2022-04-28T14:41:33.792 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.786+0000 7f6adde8e700 1 -- 172.21.15.22:0/339345065 shutdown_connections 2022-04-28T14:41:33.792 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.786+0000 7f6adde8e700 1 --2- 172.21.15.22:0/339345065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ad8068d00 0x7f6ad814b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.792 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.786+0000 7f6adde8e700 1 --2- 172.21.15.22:0/339345065 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6ad8062420 0x7f6ad8096300 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.792 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.786+0000 7f6adde8e700 1 --2- 172.21.15.22:0/339345065 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f6ad8068130 0x7f6ad8094f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.792 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.786+0000 7f6adde8e700 1 -- 172.21.15.22:0/339345065 >> 172.21.15.22:0/339345065 conn(0x7f6ad80ae9d0 msgr2=0x7f6ad80aedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:33.792 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.786+0000 7f6adde8e700 1 -- 172.21.15.22:0/339345065 shutdown_connections 2022-04-28T14:41:33.792 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.786+0000 7f6adde8e700 1 -- 172.21.15.22:0/339345065 wait complete. 2022-04-28T14:41:33.803 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2022-04-28T14:39:03.639717+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2022-04-28T14:39:12.000229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2022-04-28T14:39:12.915097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 4, 'pool_name': 'device_health_metrics', 'create_time': '2022-04-28T14:41:25.197740+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2022-04-28T14:41:33.803 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-04-28T14:41:33.925 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.920+0000 7f5aa3ef9700 1 Processor -- start 2022-04-28T14:41:33.925 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.920+0000 7f5aa3ef9700 1 -- start start 2022-04-28T14:41:33.930 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.921+0000 7f5aa3ef9700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5a9c0a19e0 0x7f5a9c0a3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:33.930 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.921+0000 7f5aa3ef9700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5a9c068470 0x7f5a9c143230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:33.930 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.921+0000 7f5aa3ef9700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a9c0abb50 con 0x7f5a9c0af2e0 2022-04-28T14:41:33.930 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.921+0000 7f5aa3ef9700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a9c0a3e50 con 0x7f5a9c0a19e0 2022-04-28T14:41:33.930 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.921+0000 7f5aa3ef9700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c0af6c0 con 0x7f5a9c068470 2022-04-28T14:41:33.931 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.921+0000 7f5aa1c95700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5a9c0af2e0 0x7f5a9c067d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39912/0 (socket says 172.21.15.22:39912) 2022-04-28T14:41:33.931 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.921+0000 7f5aa2496700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5a9c068470 0x7f5a9c143230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:33.931 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.921+0000 7f5aa1c95700 1 -- 172.21.15.22:0/1047554137 learned_addr learned my addr 172.21.15.22:0/1047554137 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:41:33.931 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.921+0000 7f5aa1494700 1 --2- 172.21.15.22:0/1047554137 >> v2:172.21.15.22:3300/0 conn(0x7f5a9c0a19e0 0x7f5a9c0a3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:33.931 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.921+0000 7f5aa0c93700 1 -- 172.21.15.22:0/1047554137 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230781187 0 0) 0x7f5a9c0abb50 con 0x7f5a9c0af2e0 2022-04-28T14:41:33.931 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.921+0000 7f5aa0c93700 1 -- 172.21.15.22:0/1047554137 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a840033f0 con 0x7f5a9c0af2e0 2022-04-28T14:41:33.931 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.921+0000 7f5aa2496700 1 -- 172.21.15.22:0/1047554137 >> v2:172.21.15.22:3300/0 conn(0x7f5a9c0a19e0 msgr2=0x7f5a9c0a3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:33.931 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.921+0000 7f5aa2496700 1 --2- 172.21.15.22:0/1047554137 >> v2:172.21.15.22:3300/0 conn(0x7f5a9c0a19e0 0x7f5a9c0a3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.931 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.921+0000 7f5aa2496700 1 -- 172.21.15.22:0/1047554137 >> v1:172.21.15.22:6789/0 conn(0x7f5a9c0af2e0 legacy=0x7f5a9c067d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:33.932 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.921+0000 7f5aa2496700 1 -- 172.21.15.22:0/1047554137 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9c0a2f30 con 0x7f5a9c068470 2022-04-28T14:41:33.932 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.921+0000 7f5aa1494700 1 --2- 172.21.15.22:0/1047554137 >> v2:172.21.15.22:3300/0 conn(0x7f5a9c0a19e0 0x7f5a9c0a3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:33.932 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.921+0000 7f5aa2496700 1 --2- 172.21.15.22:0/1047554137 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5a9c068470 0x7f5a9c143230 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f5a94009e90 tx=0x7f5a94009780).ready entity=mon.2 client_cookie=23913795976cfe8 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:33.932 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.921+0000 7f5aa0c93700 1 -- 172.21.15.22:0/1047554137 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9400e070 con 0x7f5a9c068470 2022-04-28T14:41:33.932 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.922+0000 7f5aa0c93700 1 -- 172.21.15.22:0/1047554137 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9400ba70 con 0x7f5a9c068470 2022-04-28T14:41:33.932 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.922+0000 7f5aa0c93700 1 -- 172.21.15.22:0/1047554137 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9400bdf0 con 0x7f5a9c068470 2022-04-28T14:41:33.932 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.922+0000 7f5aa3ef9700 1 -- 172.21.15.22:0/1047554137 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5a9c068470 msgr2=0x7f5a9c143230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:33.932 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.922+0000 7f5aa3ef9700 1 --2- 172.21.15.22:0/1047554137 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5a9c068470 0x7f5a9c143230 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f5a94009e90 tx=0x7f5a94009780).stop 2022-04-28T14:41:33.932 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.922+0000 7f5aa3ef9700 1 -- 172.21.15.22:0/1047554137 shutdown_connections 2022-04-28T14:41:33.932 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.922+0000 7f5aa3ef9700 1 --2- 172.21.15.22:0/1047554137 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5a9c068470 0x7f5a9c143230 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.933 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.922+0000 7f5aa3ef9700 1 --2- 172.21.15.22:0/1047554137 >> v2:172.21.15.22:3300/0 conn(0x7f5a9c0a19e0 0x7f5a9c0a3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.933 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.922+0000 7f5aa3ef9700 1 -- 172.21.15.22:0/1047554137 >> 172.21.15.22:0/1047554137 conn(0x7f5a9c0634a0 msgr2=0x7f5a9c0aea10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:33.933 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.922+0000 7f5aa3ef9700 1 -- 172.21.15.22:0/1047554137 shutdown_connections 2022-04-28T14:41:33.933 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.922+0000 7f5aa3ef9700 1 -- 172.21.15.22:0/1047554137 wait complete. 2022-04-28T14:41:33.933 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.923+0000 7f5aa3ef9700 1 Processor -- start 2022-04-28T14:41:33.933 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.923+0000 7f5aa3ef9700 1 -- start start 2022-04-28T14:41:33.933 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.924+0000 7f5aa3ef9700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a9c068470 0x7f5a9c09aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:33.933 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.924+0000 7f5aa3ef9700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5a9c0a19e0 0x7f5a9c1474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:33.933 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.924+0000 7f5aa3ef9700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5a9c0af2e0 0x7f5a9c1479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:33.934 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.924+0000 7f5aa3ef9700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c099c60 con 0x7f5a9c068470 2022-04-28T14:41:33.934 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.924+0000 7f5aa3ef9700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c09a810 con 0x7f5a9c0a19e0 2022-04-28T14:41:33.934 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.924+0000 7f5aa3ef9700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c1483d0 con 0x7f5a9c0af2e0 2022-04-28T14:41:33.934 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.924+0000 7f5aa1c95700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a9c068470 0x7f5a9c09aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:33.934 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.924+0000 7f5aa1c95700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a9c068470 0x7f5a9c09aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50522/0 (socket says 172.21.15.22:50522) 2022-04-28T14:41:33.934 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.924+0000 7f5aa1c95700 1 -- 172.21.15.22:0/1489095956 learned_addr learned my addr 172.21.15.22:0/1489095956 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:33.934 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.924+0000 7f5aa1494700 1 --2- 172.21.15.22:0/1489095956 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5a9c0a19e0 0x7f5a9c1474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:33.934 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.924+0000 7f5aa2496700 1 --2- 172.21.15.22:0/1489095956 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5a9c0af2e0 0x7f5a9c1479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:33.934 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.924+0000 7f5aa1c95700 1 -- 172.21.15.22:0/1489095956 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5a9c0af2e0 msgr2=0x7f5a9c1479a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:33.935 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.924+0000 7f5aa1c95700 1 --2- 172.21.15.22:0/1489095956 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5a9c0af2e0 0x7f5a9c1479a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.935 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.924+0000 7f5aa1c95700 1 -- 172.21.15.22:0/1489095956 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5a9c0a19e0 msgr2=0x7f5a9c1474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:33.935 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.924+0000 7f5aa1c95700 1 --2- 172.21.15.22:0/1489095956 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5a9c0a19e0 0x7f5a9c1474b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:33.935 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.924+0000 7f5aa1c95700 1 -- 172.21.15.22:0/1489095956 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a900092a0 con 0x7f5a9c068470 2022-04-28T14:41:33.935 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.924+0000 7f5aa2496700 1 --2- 172.21.15.22:0/1489095956 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5a9c0af2e0 0x7f5a9c1479a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:33.935 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.924+0000 7f5aa1494700 1 --2- 172.21.15.22:0/1489095956 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5a9c0a19e0 0x7f5a9c1474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:33.935 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.924+0000 7f5aa1c95700 1 --2- 172.21.15.22:0/1489095956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a9c068470 0x7f5a9c09aff0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f5a9800c420 tx=0x7f5a98007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:33.935 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.924+0000 7f5a8dffb700 1 -- 172.21.15.22:0/1489095956 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a980070d0 con 0x7f5a9c068470 2022-04-28T14:41:33.935 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.924+0000 7f5a8dffb700 1 -- 172.21.15.22:0/1489095956 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a98007230 con 0x7f5a9c068470 2022-04-28T14:41:33.936 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.924+0000 7f5aa3ef9700 1 -- 172.21.15.22:0/1489095956 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a94009a20 con 0x7f5a9c068470 2022-04-28T14:41:33.936 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.924+0000 7f5a8dffb700 1 -- 172.21.15.22:0/1489095956 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a980075d0 con 0x7f5a9c068470 2022-04-28T14:41:33.936 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.925+0000 7f5aa3ef9700 1 -- 172.21.15.22:0/1489095956 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a9c097c50 con 0x7f5a9c068470 2022-04-28T14:41:33.936 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.925+0000 7f5aa3ef9700 1 -- 172.21.15.22:0/1489095956 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a9c099dd0 con 0x7f5a9c068470 2022-04-28T14:41:33.936 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.925+0000 7f5a8dffb700 1 -- 172.21.15.22:0/1489095956 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f5a98010070 con 0x7f5a9c068470 2022-04-28T14:41:33.936 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.926+0000 7f5a8dffb700 1 -- 172.21.15.22:0/1489095956 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f5a980548e0 con 0x7f5a9c068470 2022-04-28T14:41:33.937 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:33.929+0000 7f5a8dffb700 1 -- 172.21.15.22:0/1489095956 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f5a98034f20 con 0x7f5a9c068470 2022-04-28T14:41:34.073 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.068+0000 7f5aa3ef9700 1 -- 172.21.15.22:0/1489095956 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5a9c046da0 con 0x7f5a9c068470 2022-04-28T14:41:34.073 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.069+0000 7f5a8dffb700 1 -- 172.21.15.22:0/1489095956 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5a98038710 con 0x7f5a9c068470 2022-04-28T14:41:34.074 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2022-04-28T14:41:34.075 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.070+0000 7f5aa3ef9700 1 -- 172.21.15.22:0/1489095956 >> v1:172.21.15.22:6808/92758 conn(0x7f5a7c041b00 legacy=0x7f5a7c043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:34.075 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.070+0000 7f5aa3ef9700 1 -- 172.21.15.22:0/1489095956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a9c068470 msgr2=0x7f5a9c09aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:34.075 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.070+0000 7f5aa3ef9700 1 --2- 172.21.15.22:0/1489095956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a9c068470 0x7f5a9c09aff0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f5a9800c420 tx=0x7f5a98007c80).stop 2022-04-28T14:41:34.075 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.070+0000 7f5aa3ef9700 1 -- 172.21.15.22:0/1489095956 shutdown_connections 2022-04-28T14:41:34.075 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.070+0000 7f5aa3ef9700 1 --2- 172.21.15.22:0/1489095956 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5a9c0af2e0 0x7f5a9c1479a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:34.075 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.070+0000 7f5aa3ef9700 1 --2- 172.21.15.22:0/1489095956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5a9c068470 0x7f5a9c09aff0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:34.076 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.070+0000 7f5aa3ef9700 1 --2- 172.21.15.22:0/1489095956 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5a9c0a19e0 0x7f5a9c1474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:34.076 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.070+0000 7f5aa3ef9700 1 -- 172.21.15.22:0/1489095956 >> 172.21.15.22:0/1489095956 conn(0x7f5a9c0634a0 msgr2=0x7f5a9c05d990 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:34.076 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.070+0000 7f5aa3ef9700 1 -- 172.21.15.22:0/1489095956 shutdown_connections 2022-04-28T14:41:34.076 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.070+0000 7f5aa3ef9700 1 -- 172.21.15.22:0/1489095956 wait complete. 2022-04-28T14:41:34.086 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-04-28T14:41:34.210 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.203+0000 7f4b79f37700 1 Processor -- start 2022-04-28T14:41:34.211 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.203+0000 7f4b79f37700 1 -- start start 2022-04-28T14:41:34.211 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.203+0000 7f4b79f37700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4b7413bf90 0x7f4b74140a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:34.211 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.203+0000 7f4b79f37700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4b7413c3b0 0x7f4b74142f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:34.211 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.203+0000 7f4b79f37700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b740ac330 con 0x7f4b740a3b00 2022-04-28T14:41:34.211 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.203+0000 7f4b79f37700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b740a3ee0 con 0x7f4b7413bf90 2022-04-28T14:41:34.211 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.203+0000 7f4b79f37700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b740a2ba0 con 0x7f4b7413c3b0 2022-04-28T14:41:34.211 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.203+0000 7f4b72ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4b7413bf90 0x7f4b74140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:34.211 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.203+0000 7f4b73fff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4b7413c3b0 0x7f4b74142f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:34.212 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.203+0000 7f4b72ffd700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4b7413bf90 0x7f4b74140a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50530/0 (socket says 172.21.15.22:50530) 2022-04-28T14:41:34.212 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.203+0000 7f4b737fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4b740a3b00 0x7f4b740aba70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39928/0 (socket says 172.21.15.22:39928) 2022-04-28T14:41:34.212 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.203+0000 7f4b73fff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4b7413c3b0 0x7f4b74142f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48102/0 (socket says 172.21.15.22:48102) 2022-04-28T14:41:34.212 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.203+0000 7f4b72ffd700 1 -- 172.21.15.22:0/207809656 learned_addr learned my addr 172.21.15.22:0/207809656 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:34.213 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.204+0000 7f4b727fc700 1 -- 172.21.15.22:0/207809656 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928845851 0 0) 0x7f4b740ac330 con 0x7f4b740a3b00 2022-04-28T14:41:34.213 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.204+0000 7f4b727fc700 1 -- 172.21.15.22:0/207809656 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b540033f0 con 0x7f4b740a3b00 2022-04-28T14:41:34.213 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.204+0000 7f4b73fff700 1 -- 172.21.15.22:0/207809656 >> v2:172.21.15.22:3300/0 conn(0x7f4b7413bf90 msgr2=0x7f4b74140a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:34.213 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.204+0000 7f4b73fff700 1 --2- 172.21.15.22:0/207809656 >> v2:172.21.15.22:3300/0 conn(0x7f4b7413bf90 0x7f4b74140a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:34.213 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.204+0000 7f4b73fff700 1 -- 172.21.15.22:0/207809656 >> v1:172.21.15.22:6789/0 conn(0x7f4b740a3b00 legacy=0x7f4b740aba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:34.213 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.204+0000 7f4b73fff700 1 -- 172.21.15.22:0/207809656 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b74068cf0 con 0x7f4b7413c3b0 2022-04-28T14:41:34.214 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.204+0000 7f4b72ffd700 1 --2- 172.21.15.22:0/207809656 >> v2:172.21.15.22:3300/0 conn(0x7f4b7413bf90 0x7f4b74140a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:34.214 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.204+0000 7f4b73fff700 1 --2- 172.21.15.22:0/207809656 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4b7413c3b0 0x7f4b74142f80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f4b64009760 tx=0x7f4b64009060).ready entity=mon.1 client_cookie=b98785797a7c8d1e server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:34.214 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.204+0000 7f4b727fc700 1 -- 172.21.15.22:0/207809656 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6400d4a0 con 0x7f4b7413c3b0 2022-04-28T14:41:34.214 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.204+0000 7f4b727fc700 1 -- 172.21.15.22:0/207809656 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6400d600 con 0x7f4b7413c3b0 2022-04-28T14:41:34.214 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.204+0000 7f4b727fc700 1 -- 172.21.15.22:0/207809656 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6400d980 con 0x7f4b7413c3b0 2022-04-28T14:41:34.214 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.205+0000 7f4b79f37700 1 -- 172.21.15.22:0/207809656 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4b7413c3b0 msgr2=0x7f4b74142f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:34.214 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.205+0000 7f4b79f37700 1 --2- 172.21.15.22:0/207809656 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4b7413c3b0 0x7f4b74142f80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f4b64009760 tx=0x7f4b64009060).stop 2022-04-28T14:41:34.214 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.205+0000 7f4b79f37700 1 -- 172.21.15.22:0/207809656 shutdown_connections 2022-04-28T14:41:34.214 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.205+0000 7f4b79f37700 1 --2- 172.21.15.22:0/207809656 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4b7413c3b0 0x7f4b74142f80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:34.214 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.205+0000 7f4b79f37700 1 --2- 172.21.15.22:0/207809656 >> v2:172.21.15.22:3300/0 conn(0x7f4b7413bf90 0x7f4b74140a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:34.215 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.205+0000 7f4b79f37700 1 -- 172.21.15.22:0/207809656 >> 172.21.15.22:0/207809656 conn(0x7f4b74061f30 msgr2=0x7f4b74062340 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:34.215 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.205+0000 7f4b79f37700 1 -- 172.21.15.22:0/207809656 shutdown_connections 2022-04-28T14:41:34.215 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.205+0000 7f4b79f37700 1 -- 172.21.15.22:0/207809656 wait complete. 2022-04-28T14:41:34.215 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.206+0000 7f4b79f37700 1 Processor -- start 2022-04-28T14:41:34.215 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.206+0000 7f4b79f37700 1 -- start start 2022-04-28T14:41:34.218 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.206+0000 7f4b79f37700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b740a3b00 0x7f4b740a75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:34.218 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.206+0000 7f4b79f37700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4b7413bf90 0x7f4b740a8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:34.218 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.206+0000 7f4b79f37700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4b7413c3b0 0x7f4b7414b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:34.218 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.206+0000 7f4b79f37700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b740a8f60 con 0x7f4b740a3b00 2022-04-28T14:41:34.218 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.206+0000 7f4b79f37700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b740ab440 con 0x7f4b7413bf90 2022-04-28T14:41:34.218 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.206+0000 7f4b79f37700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b740a9f00 con 0x7f4b7413c3b0 2022-04-28T14:41:34.219 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.206+0000 7f4b72ffd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4b7413bf90 0x7f4b740a8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:34.219 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.206+0000 7f4b737fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b740a3b00 0x7f4b740a75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:34.219 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.206+0000 7f4b72ffd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4b7413bf90 0x7f4b740a8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48106/0 (socket says 172.21.15.22:48106) 2022-04-28T14:41:34.219 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.206+0000 7f4b72ffd700 1 -- 172.21.15.22:0/3362762640 learned_addr learned my addr 172.21.15.22:0/3362762640 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:34.219 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.206+0000 7f4b73fff700 1 --2- 172.21.15.22:0/3362762640 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4b7413c3b0 0x7f4b7414b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:34.219 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.207+0000 7f4b72ffd700 1 -- 172.21.15.22:0/3362762640 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4b7413c3b0 msgr2=0x7f4b7414b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:34.219 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.207+0000 7f4b72ffd700 1 --2- 172.21.15.22:0/3362762640 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4b7413c3b0 0x7f4b7414b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:34.219 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.207+0000 7f4b72ffd700 1 -- 172.21.15.22:0/3362762640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b740a3b00 msgr2=0x7f4b740a75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:34.219 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.207+0000 7f4b72ffd700 1 --2- 172.21.15.22:0/3362762640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b740a3b00 0x7f4b740a75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:34.219 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.207+0000 7f4b72ffd700 1 -- 172.21.15.22:0/3362762640 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5c009370 con 0x7f4b7413bf90 2022-04-28T14:41:34.219 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.207+0000 7f4b737fe700 1 --2- 172.21.15.22:0/3362762640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b740a3b00 0x7f4b740a75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:34.220 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.207+0000 7f4b72ffd700 1 --2- 172.21.15.22:0/3362762640 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4b7413bf90 0x7f4b740a8a70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f4b5c00ea50 tx=0x7f4b5c0090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:34.220 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.207+0000 7f4b6b7fe700 1 -- 172.21.15.22:0/3362762640 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c00ee90 con 0x7f4b7413bf90 2022-04-28T14:41:34.220 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.207+0000 7f4b6b7fe700 1 -- 172.21.15.22:0/3362762640 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5c00c850 con 0x7f4b7413bf90 2022-04-28T14:41:34.220 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.207+0000 7f4b79f37700 1 -- 172.21.15.22:0/3362762640 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b640092a0 con 0x7f4b7413bf90 2022-04-28T14:41:34.220 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.207+0000 7f4b6b7fe700 1 -- 172.21.15.22:0/3362762640 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c00cbd0 con 0x7f4b7413bf90 2022-04-28T14:41:34.220 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.207+0000 7f4b79f37700 1 -- 172.21.15.22:0/3362762640 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b740a67b0 con 0x7f4b7413bf90 2022-04-28T14:41:34.220 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.208+0000 7f4b6b7fe700 1 -- 172.21.15.22:0/3362762640 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f4b5c022070 con 0x7f4b7413bf90 2022-04-28T14:41:34.220 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.208+0000 7f4b79f37700 1 -- 172.21.15.22:0/3362762640 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b74046da0 con 0x7f4b7413bf90 2022-04-28T14:41:34.220 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.208+0000 7f4b6b7fe700 1 -- 172.21.15.22:0/3362762640 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f4b5c055810 con 0x7f4b7413bf90 2022-04-28T14:41:34.220 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.212+0000 7f4b6b7fe700 1 -- 172.21.15.22:0/3362762640 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f4b5c035e50 con 0x7f4b7413bf90 2022-04-28T14:41:34.355 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.351+0000 7f4b79f37700 1 -- 172.21.15.22:0/3362762640 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4b74069370 con 0x7f4b7413bf90 2022-04-28T14:41:34.356 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.351+0000 7f4b6b7fe700 1 -- 172.21.15.22:0/3362762640 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4b5c016020 con 0x7f4b7413bf90 2022-04-28T14:41:34.356 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2022-04-28T14:41:34.358 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.353+0000 7f4b79f37700 1 -- 172.21.15.22:0/3362762640 >> v1:172.21.15.22:6808/92758 conn(0x7f4b58041b00 legacy=0x7f4b58043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:34.358 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.353+0000 7f4b79f37700 1 -- 172.21.15.22:0/3362762640 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4b7413bf90 msgr2=0x7f4b740a8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:34.358 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.353+0000 7f4b79f37700 1 --2- 172.21.15.22:0/3362762640 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4b7413bf90 0x7f4b740a8a70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f4b5c00ea50 tx=0x7f4b5c0090f0).stop 2022-04-28T14:41:34.358 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.353+0000 7f4b79f37700 1 -- 172.21.15.22:0/3362762640 shutdown_connections 2022-04-28T14:41:34.358 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.353+0000 7f4b79f37700 1 --2- 172.21.15.22:0/3362762640 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4b7413c3b0 0x7f4b7414b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:34.358 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.353+0000 7f4b79f37700 1 --2- 172.21.15.22:0/3362762640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b740a3b00 0x7f4b740a75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:34.358 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.353+0000 7f4b79f37700 1 --2- 172.21.15.22:0/3362762640 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4b7413bf90 0x7f4b740a8a70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:34.359 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.353+0000 7f4b79f37700 1 -- 172.21.15.22:0/3362762640 >> 172.21.15.22:0/3362762640 conn(0x7f4b74061f30 msgr2=0x7f4b7413e280 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:34.359 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.353+0000 7f4b79f37700 1 -- 172.21.15.22:0/3362762640 shutdown_connections 2022-04-28T14:41:34.359 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.353+0000 7f4b79f37700 1 -- 172.21.15.22:0/3362762640 wait complete. 2022-04-28T14:41:34.369 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-04-28T14:41:34.490 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.485+0000 7f288cab5700 1 Processor -- start 2022-04-28T14:41:34.510 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.485+0000 7f288cab5700 1 -- start start 2022-04-28T14:41:34.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.486+0000 7f288cab5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2888131240 0x7f28881316c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:34.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.486+0000 7f288cab5700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f288813cb40 0x7f288813ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:34.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.486+0000 7f288cab5700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2888062ff0 con 0x7f2888062c10 2022-04-28T14:41:34.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.486+0000 7f288cab5700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288809f290 con 0x7f2888131240 2022-04-28T14:41:34.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.486+0000 7f288cab5700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288809f920 con 0x7f288813cb40 2022-04-28T14:41:34.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.486+0000 7f2885d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2888131240 0x7f28881316c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:34.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.486+0000 7f2886d9d700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f288813cb40 0x7f288813ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:34.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.486+0000 7f288659c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2888062c10 0x7f28880a7be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39940/0 (socket says 172.21.15.22:39940) 2022-04-28T14:41:34.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.486+0000 7f2885d9b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2888131240 0x7f28881316c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50546/0 (socket says 172.21.15.22:50546) 2022-04-28T14:41:34.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.486+0000 7f288659c700 1 -- 172.21.15.22:0/1371271408 learned_addr learned my addr 172.21.15.22:0/1371271408 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:41:34.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.486+0000 7f2885d9b700 1 -- 172.21.15.22:0/1371271408 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f288813cb40 msgr2=0x7f288813ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:34.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.486+0000 7f2885d9b700 1 --2- 172.21.15.22:0/1371271408 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f288813cb40 0x7f288813ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:34.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.486+0000 7f2885d9b700 1 -- 172.21.15.22:0/1371271408 >> v1:172.21.15.22:6789/0 conn(0x7f2888062c10 legacy=0x7f28880a7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:34.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.486+0000 7f2885d9b700 1 -- 172.21.15.22:0/1371271408 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288809ebd0 con 0x7f2888131240 2022-04-28T14:41:34.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.486+0000 7f288559a700 1 -- 172.21.15.22:0/1371271408 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2603479430 0 0) 0x7f2888062ff0 con 0x7f2888062c10 2022-04-28T14:41:34.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.486+0000 7f2886d9d700 1 --2- 172.21.15.22:0/1371271408 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f288813cb40 0x7f288813ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:34.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.486+0000 7f2885d9b700 1 --2- 172.21.15.22:0/1371271408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2888131240 0x7f28881316c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f2878009760 tx=0x7f2878009060).ready entity=mon.0 client_cookie=b41cf4f2e1b9ed2f server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:34.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.486+0000 7f288559a700 1 -- 172.21.15.22:0/1371271408 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287800f510 con 0x7f2888131240 2022-04-28T14:41:34.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.486+0000 7f288559a700 1 -- 172.21.15.22:0/1371271408 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287800f670 con 0x7f2888131240 2022-04-28T14:41:34.520 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.486+0000 7f288559a700 1 -- 172.21.15.22:0/1371271408 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287800f9f0 con 0x7f2888131240 2022-04-28T14:41:34.520 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.487+0000 7f288cab5700 1 -- 172.21.15.22:0/1371271408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2888131240 msgr2=0x7f28881316c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:34.520 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.487+0000 7f288cab5700 1 --2- 172.21.15.22:0/1371271408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2888131240 0x7f28881316c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f2878009760 tx=0x7f2878009060).stop 2022-04-28T14:41:34.520 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.487+0000 7f288cab5700 1 -- 172.21.15.22:0/1371271408 shutdown_connections 2022-04-28T14:41:34.520 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.487+0000 7f288cab5700 1 --2- 172.21.15.22:0/1371271408 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f288813cb40 0x7f288813ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:34.520 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.487+0000 7f288cab5700 1 --2- 172.21.15.22:0/1371271408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2888131240 0x7f28881316c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:34.520 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.487+0000 7f288cab5700 1 -- 172.21.15.22:0/1371271408 >> 172.21.15.22:0/1371271408 conn(0x7f2888061f30 msgr2=0x7f2888062340 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:34.520 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.487+0000 7f288cab5700 1 -- 172.21.15.22:0/1371271408 shutdown_connections 2022-04-28T14:41:34.520 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.487+0000 7f288cab5700 1 -- 172.21.15.22:0/1371271408 wait complete. 2022-04-28T14:41:34.520 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.488+0000 7f288cab5700 1 Processor -- start 2022-04-28T14:41:34.521 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.488+0000 7f288cab5700 1 -- start start 2022-04-28T14:41:34.521 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.488+0000 7f288cab5700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2888062c10 0x7f28880a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:34.521 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.488+0000 7f288cab5700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2888131240 0x7f28880a0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:34.521 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.488+0000 7f288cab5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f288813cb40 0x7f2888130230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:34.521 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.489+0000 7f288cab5700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28880a2fc0 con 0x7f288813cb40 2022-04-28T14:41:34.521 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.489+0000 7f288cab5700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2888138ee0 con 0x7f2888062c10 2022-04-28T14:41:34.521 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.489+0000 7f288cab5700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28880a73e0 con 0x7f2888131240 2022-04-28T14:41:34.521 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.489+0000 7f2886d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f288813cb40 0x7f2888130230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:34.521 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.489+0000 7f2885d9b700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2888131240 0x7f28880a0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:34.521 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.489+0000 7f288659c700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2888062c10 0x7f28880a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:34.522 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.489+0000 7f2886d9d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f288813cb40 0x7f2888130230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50554/0 (socket says 172.21.15.22:50554) 2022-04-28T14:41:34.522 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.489+0000 7f2886d9d700 1 -- 172.21.15.22:0/2842654689 learned_addr learned my addr 172.21.15.22:0/2842654689 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:34.522 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.489+0000 7f288659c700 1 -- 172.21.15.22:0/2842654689 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2888131240 msgr2=0x7f28880a0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:34.522 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.489+0000 7f288659c700 1 --2- 172.21.15.22:0/2842654689 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2888131240 0x7f28880a0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:34.522 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.489+0000 7f288659c700 1 -- 172.21.15.22:0/2842654689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f288813cb40 msgr2=0x7f2888130230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:34.522 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.489+0000 7f288659c700 1 --2- 172.21.15.22:0/2842654689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f288813cb40 0x7f2888130230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:34.522 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.489+0000 7f288659c700 1 -- 172.21.15.22:0/2842654689 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288000bc30 con 0x7f2888062c10 2022-04-28T14:41:34.522 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.489+0000 7f2886d9d700 1 --2- 172.21.15.22:0/2842654689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f288813cb40 0x7f2888130230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:34.522 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.489+0000 7f288659c700 1 --2- 172.21.15.22:0/2842654689 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2888062c10 0x7f28880a18b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f287c000c00 tx=0x7f287c007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:34.523 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.489+0000 7f28767fc700 1 -- 172.21.15.22:0/2842654689 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c0070d0 con 0x7f2888062c10 2022-04-28T14:41:34.523 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.489+0000 7f28767fc700 1 -- 172.21.15.22:0/2842654689 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c007250 con 0x7f2888062c10 2022-04-28T14:41:34.523 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.489+0000 7f288cab5700 1 -- 172.21.15.22:0/2842654689 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28780092a0 con 0x7f2888062c10 2022-04-28T14:41:34.523 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.489+0000 7f28767fc700 1 -- 172.21.15.22:0/2842654689 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c007610 con 0x7f2888062c10 2022-04-28T14:41:34.523 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.489+0000 7f288cab5700 1 -- 172.21.15.22:0/2842654689 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f288813b790 con 0x7f2888062c10 2022-04-28T14:41:34.523 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.490+0000 7f28767fc700 1 -- 172.21.15.22:0/2842654689 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f287c010070 con 0x7f2888062c10 2022-04-28T14:41:34.523 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.490+0000 7f288cab5700 1 -- 172.21.15.22:0/2842654689 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f288813b980 con 0x7f2888062c10 2022-04-28T14:41:34.523 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.491+0000 7f28767fc700 1 -- 172.21.15.22:0/2842654689 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f287c054930 con 0x7f2888062c10 2022-04-28T14:41:34.523 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.494+0000 7f28767fc700 1 -- 172.21.15.22:0/2842654689 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f288813b980 con 0x7f2888062c10 2022-04-28T14:41:34.636 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.632+0000 7f288cab5700 1 -- 172.21.15.22:0/2842654689 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f288813b980 con 0x7f2888062c10 2022-04-28T14:41:34.637 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.632+0000 7f28767fc700 1 -- 172.21.15.22:0/2842654689 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f288813b980 con 0x7f2888062c10 2022-04-28T14:41:34.637 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2022-04-28T14:41:34.639 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.633+0000 7f288cab5700 1 -- 172.21.15.22:0/2842654689 >> v1:172.21.15.22:6808/92758 conn(0x7f2864041ad0 legacy=0x7f2864043f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:34.639 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.633+0000 7f288cab5700 1 -- 172.21.15.22:0/2842654689 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2888062c10 msgr2=0x7f28880a18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:34.639 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.633+0000 7f288cab5700 1 --2- 172.21.15.22:0/2842654689 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2888062c10 0x7f28880a18b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f287c000c00 tx=0x7f287c007b90).stop 2022-04-28T14:41:34.639 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.633+0000 7f288cab5700 1 -- 172.21.15.22:0/2842654689 shutdown_connections 2022-04-28T14:41:34.639 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.633+0000 7f288cab5700 1 --2- 172.21.15.22:0/2842654689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f288813cb40 0x7f2888130230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:34.639 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.634+0000 7f288cab5700 1 --2- 172.21.15.22:0/2842654689 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2888062c10 0x7f28880a18b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:34.640 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.634+0000 7f288cab5700 1 --2- 172.21.15.22:0/2842654689 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2888131240 0x7f28880a0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:34.640 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.634+0000 7f288cab5700 1 -- 172.21.15.22:0/2842654689 >> 172.21.15.22:0/2842654689 conn(0x7f2888061f30 msgr2=0x7f2888131660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:34.640 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.634+0000 7f288cab5700 1 -- 172.21.15.22:0/2842654689 shutdown_connections 2022-04-28T14:41:34.640 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.634+0000 7f288cab5700 1 -- 172.21.15.22:0/2842654689 wait complete. 2022-04-28T14:41:34.649 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-04-28T14:41:34.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.765+0000 7f08e407f700 1 Processor -- start 2022-04-28T14:41:34.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.765+0000 7f08e407f700 1 -- start start 2022-04-28T14:41:34.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.765+0000 7f08e407f700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f08dc0a3320 0x7f08dc0691d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:34.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.765+0000 7f08e407f700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f08dc13b980 0x7f08dc067cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:34.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.765+0000 7f08e407f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08dc0a3700 con 0x7f08dc13bdc0 2022-04-28T14:41:34.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.765+0000 7f08e407f700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc0a2c40 con 0x7f08dc0a3320 2022-04-28T14:41:34.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.765+0000 7f08e407f700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc0a29d0 con 0x7f08dc13b980 2022-04-28T14:41:34.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.766+0000 7f08e161a700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f08dc13b980 0x7f08dc067cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:34.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.766+0000 7f08e1e1b700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f08dc0a3320 0x7f08dc0691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:34.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.766+0000 7f08e161a700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f08dc13b980 0x7f08dc067cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:47910/0 (socket says 172.21.15.22:47910) 2022-04-28T14:41:34.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.766+0000 7f08e261c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f08dc13bdc0 0x7f08dc138430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39958/0 (socket says 172.21.15.22:39958) 2022-04-28T14:41:34.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.766+0000 7f08e161a700 1 -- 172.21.15.22:0/4059057880 learned_addr learned my addr 172.21.15.22:0/4059057880 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:34.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.766+0000 7f08e161a700 1 -- 172.21.15.22:0/4059057880 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f08dc0a3320 msgr2=0x7f08dc0691d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:34.773 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.766+0000 7f08e161a700 1 --2- 172.21.15.22:0/4059057880 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f08dc0a3320 0x7f08dc0691d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:34.774 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.766+0000 7f08e161a700 1 -- 172.21.15.22:0/4059057880 >> v1:172.21.15.22:6789/0 conn(0x7f08dc13bdc0 legacy=0x7f08dc138430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:34.774 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.766+0000 7f08e0e19700 1 -- 172.21.15.22:0/4059057880 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2581512694 0 0) 0x7f08dc0a3700 con 0x7f08dc13bdc0 2022-04-28T14:41:34.774 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.766+0000 7f08e161a700 1 -- 172.21.15.22:0/4059057880 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08dc13c240 con 0x7f08dc13b980 2022-04-28T14:41:34.774 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.766+0000 7f08e1e1b700 1 --2- 172.21.15.22:0/4059057880 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f08dc0a3320 0x7f08dc0691d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:34.774 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.766+0000 7f08e161a700 1 --2- 172.21.15.22:0/4059057880 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f08dc13b980 0x7f08dc067cf0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f08cc009840 tx=0x7f08cc009060).ready entity=mon.2 client_cookie=2795886bf6095f1f server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:34.774 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.766+0000 7f08e0e19700 1 -- 172.21.15.22:0/4059057880 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc005880 con 0x7f08dc13b980 2022-04-28T14:41:34.774 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.766+0000 7f08e0e19700 1 -- 172.21.15.22:0/4059057880 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08cc0059e0 con 0x7f08dc13b980 2022-04-28T14:41:34.775 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.766+0000 7f08e0e19700 1 -- 172.21.15.22:0/4059057880 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc005d60 con 0x7f08dc13b980 2022-04-28T14:41:34.775 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.767+0000 7f08e407f700 1 -- 172.21.15.22:0/4059057880 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f08dc13b980 msgr2=0x7f08dc067cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:34.775 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.767+0000 7f08e407f700 1 --2- 172.21.15.22:0/4059057880 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f08dc13b980 0x7f08dc067cf0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f08cc009840 tx=0x7f08cc009060).stop 2022-04-28T14:41:34.775 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.767+0000 7f08e407f700 1 -- 172.21.15.22:0/4059057880 shutdown_connections 2022-04-28T14:41:34.775 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.767+0000 7f08e407f700 1 --2- 172.21.15.22:0/4059057880 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f08dc0a3320 0x7f08dc0691d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:34.775 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.767+0000 7f08e407f700 1 --2- 172.21.15.22:0/4059057880 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f08dc13b980 0x7f08dc067cf0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:34.775 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.767+0000 7f08e407f700 1 -- 172.21.15.22:0/4059057880 >> 172.21.15.22:0/4059057880 conn(0x7f08dc0ae9c0 msgr2=0x7f08dc0aeda0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:34.775 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.767+0000 7f08e407f700 1 -- 172.21.15.22:0/4059057880 shutdown_connections 2022-04-28T14:41:34.775 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.767+0000 7f08e407f700 1 -- 172.21.15.22:0/4059057880 wait complete. 2022-04-28T14:41:34.776 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.768+0000 7f08e407f700 1 Processor -- start 2022-04-28T14:41:34.776 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.768+0000 7f08e407f700 1 -- start start 2022-04-28T14:41:34.779 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.768+0000 7f08e407f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08dc0a3320 0x7f08dc096d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:34.779 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.768+0000 7f08e407f700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f08dc13b980 0x7f08dc14bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:34.779 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.768+0000 7f08e407f700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f08dc13bdc0 0x7f08dc148020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:34.779 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.768+0000 7f08e407f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc0961a0 con 0x7f08dc0a3320 2022-04-28T14:41:34.779 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.768+0000 7f08e407f700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc0aaeb0 con 0x7f08dc13bdc0 2022-04-28T14:41:34.779 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.768+0000 7f08e407f700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc096380 con 0x7f08dc13b980 2022-04-28T14:41:34.779 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.768+0000 7f08e1e1b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08dc0a3320 0x7f08dc096d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:34.780 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.768+0000 7f08e261c700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f08dc13bdc0 0x7f08dc148020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:34.780 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.768+0000 7f08e1e1b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08dc0a3320 0x7f08dc096d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50564/0 (socket says 172.21.15.22:50564) 2022-04-28T14:41:34.780 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.768+0000 7f08e1e1b700 1 -- 172.21.15.22:0/292065011 learned_addr learned my addr 172.21.15.22:0/292065011 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:34.780 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.768+0000 7f08e161a700 1 --2- 172.21.15.22:0/292065011 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f08dc13b980 0x7f08dc14bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:34.780 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.769+0000 7f08e261c700 1 -- 172.21.15.22:0/292065011 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f08dc13b980 msgr2=0x7f08dc14bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:34.780 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.769+0000 7f08e261c700 1 --2- 172.21.15.22:0/292065011 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f08dc13b980 0x7f08dc14bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:34.780 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.769+0000 7f08e261c700 1 -- 172.21.15.22:0/292065011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08dc0a3320 msgr2=0x7f08dc096d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:34.780 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.769+0000 7f08e261c700 1 --2- 172.21.15.22:0/292065011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08dc0a3320 0x7f08dc096d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:34.781 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.769+0000 7f08e261c700 1 -- 172.21.15.22:0/292065011 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d80092a0 con 0x7f08dc13bdc0 2022-04-28T14:41:34.781 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.769+0000 7f08e1e1b700 1 --2- 172.21.15.22:0/292065011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08dc0a3320 0x7f08dc096d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:34.781 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.769+0000 7f08e261c700 1 --2- 172.21.15.22:0/292065011 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f08dc13bdc0 0x7f08dc148020 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f08d400c810 tx=0x7f08d4007f90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:34.781 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.769+0000 7f08c9ffb700 1 -- 172.21.15.22:0/292065011 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d4005c70 con 0x7f08dc13bdc0 2022-04-28T14:41:34.781 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.769+0000 7f08c9ffb700 1 -- 172.21.15.22:0/292065011 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d4005dd0 con 0x7f08dc13bdc0 2022-04-28T14:41:34.781 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.769+0000 7f08c9ffb700 1 -- 172.21.15.22:0/292065011 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d4007300 con 0x7f08dc13bdc0 2022-04-28T14:41:34.781 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.769+0000 7f08e407f700 1 -- 172.21.15.22:0/292065011 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08cc009300 con 0x7f08dc13bdc0 2022-04-28T14:41:34.782 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.769+0000 7f08e407f700 1 -- 172.21.15.22:0/292065011 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08dc0aa880 con 0x7f08dc13bdc0 2022-04-28T14:41:34.782 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.770+0000 7f08c9ffb700 1 -- 172.21.15.22:0/292065011 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f08d4010070 con 0x7f08dc13bdc0 2022-04-28T14:41:34.782 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.770+0000 7f08e407f700 1 -- 172.21.15.22:0/292065011 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08dc046da0 con 0x7f08dc13bdc0 2022-04-28T14:41:34.782 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.770+0000 7f08c9ffb700 1 -- 172.21.15.22:0/292065011 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f08d4054b80 con 0x7f08dc13bdc0 2022-04-28T14:41:34.783 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.774+0000 7f08c9ffb700 1 -- 172.21.15.22:0/292065011 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f08d40351c0 con 0x7f08dc13bdc0 2022-04-28T14:41:34.918 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.913+0000 7f08e407f700 1 -- 172.21.15.22:0/292065011 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f08dc0adaf0 con 0x7f08dc13bdc0 2022-04-28T14:41:34.918 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.913+0000 7f08c9ffb700 1 -- 172.21.15.22:0/292065011 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v21) v1 ==== 110+0+10 (secure 0 0 0) 0x7f08d40389b0 con 0x7f08dc13bdc0 2022-04-28T14:41:34.918 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2022-04-28T14:41:34.920 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.915+0000 7f08e407f700 1 -- 172.21.15.22:0/292065011 >> v1:172.21.15.22:6808/92758 conn(0x7f08bc041b30 legacy=0x7f08bc043ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:34.920 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.915+0000 7f08e407f700 1 -- 172.21.15.22:0/292065011 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f08dc13bdc0 msgr2=0x7f08dc148020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:34.920 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.915+0000 7f08e407f700 1 --2- 172.21.15.22:0/292065011 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f08dc13bdc0 0x7f08dc148020 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f08d400c810 tx=0x7f08d4007f90).stop 2022-04-28T14:41:34.920 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.915+0000 7f08e407f700 1 -- 172.21.15.22:0/292065011 shutdown_connections 2022-04-28T14:41:34.920 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.915+0000 7f08e407f700 1 --2- 172.21.15.22:0/292065011 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f08dc13bdc0 0x7f08dc148020 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:34.920 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.915+0000 7f08e407f700 1 --2- 172.21.15.22:0/292065011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08dc0a3320 0x7f08dc096d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:34.921 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.915+0000 7f08e407f700 1 --2- 172.21.15.22:0/292065011 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f08dc13b980 0x7f08dc14bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:34.921 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.915+0000 7f08e407f700 1 -- 172.21.15.22:0/292065011 >> 172.21.15.22:0/292065011 conn(0x7f08dc0ae9c0 msgr2=0x7f08dc138b20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:34.921 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.915+0000 7f08e407f700 1 -- 172.21.15.22:0/292065011 shutdown_connections 2022-04-28T14:41:34.921 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:34.915+0000 7f08e407f700 1 -- 172.21.15.22:0/292065011 wait complete. 2022-04-28T14:41:34.931 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-04-28T14:41:35.049 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.044+0000 7f0b84969700 1 Processor -- start 2022-04-28T14:41:35.050 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.044+0000 7f0b84969700 1 -- start start 2022-04-28T14:41:35.053 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.045+0000 7f0b84969700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0b80063100 0x7f0b8009a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:35.053 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.045+0000 7f0b84969700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0b80097c60 0x7f0b80098b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:35.053 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.045+0000 7f0b84969700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0b80133b60 0x7f0b80133fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:35.053 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.045+0000 7f0b84969700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b80099e00 con 0x7f0b80133b60 2022-04-28T14:41:35.053 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.045+0000 7f0b84969700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b800634e0 con 0x7f0b80097c60 2022-04-28T14:41:35.053 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.045+0000 7f0b84969700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b800980f0 con 0x7f0b80063100 2022-04-28T14:41:35.053 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.045+0000 7f0b7dd9b700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0b80097c60 0x7f0b80098b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:35.053 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.045+0000 7f0b7ed9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0b80133b60 0x7f0b80133fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:35.054 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.045+0000 7f0b7e59c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0b80063100 0x7f0b8009a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:35.054 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.045+0000 7f0b7dd9b700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0b80097c60 0x7f0b80098b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48142/0 (socket says 172.21.15.22:48142) 2022-04-28T14:41:35.054 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.045+0000 7f0b7ed9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0b80133b60 0x7f0b80133fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50576/0 (socket says 172.21.15.22:50576) 2022-04-28T14:41:35.054 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.045+0000 7f0b7dd9b700 1 -- 172.21.15.22:0/1980031089 learned_addr learned my addr 172.21.15.22:0/1980031089 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:35.054 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.046+0000 7f0b7dd9b700 1 -- 172.21.15.22:0/1980031089 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0b80063100 msgr2=0x7f0b8009a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:35.054 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.046+0000 7f0b7dd9b700 1 --2- 172.21.15.22:0/1980031089 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0b80063100 0x7f0b8009a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.054 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.046+0000 7f0b7dd9b700 1 -- 172.21.15.22:0/1980031089 >> v2:172.21.15.22:3300/0 conn(0x7f0b80133b60 msgr2=0x7f0b80133fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:35.054 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.046+0000 7f0b7dd9b700 1 --2- 172.21.15.22:0/1980031089 >> v2:172.21.15.22:3300/0 conn(0x7f0b80133b60 0x7f0b80133fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.054 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.046+0000 7f0b7dd9b700 1 -- 172.21.15.22:0/1980031089 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b800983b0 con 0x7f0b80097c60 2022-04-28T14:41:35.055 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.046+0000 7f0b7ed9d700 1 --2- 172.21.15.22:0/1980031089 >> v2:172.21.15.22:3300/0 conn(0x7f0b80133b60 0x7f0b80133fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:35.055 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.046+0000 7f0b7dd9b700 1 --2- 172.21.15.22:0/1980031089 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0b80097c60 0x7f0b80098b30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f0b74006fd0 tx=0x7f0b740090f0).ready entity=mon.1 client_cookie=c172fa9dc181332 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:35.055 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.046+0000 7f0b7d59a700 1 -- 172.21.15.22:0/1980031089 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7400f510 con 0x7f0b80097c60 2022-04-28T14:41:35.055 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.046+0000 7f0b7d59a700 1 -- 172.21.15.22:0/1980031089 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7400f670 con 0x7f0b80097c60 2022-04-28T14:41:35.055 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.046+0000 7f0b7d59a700 1 -- 172.21.15.22:0/1980031089 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7400f9f0 con 0x7f0b80097c60 2022-04-28T14:41:35.055 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.047+0000 7f0b84969700 1 -- 172.21.15.22:0/1980031089 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0b80097c60 msgr2=0x7f0b80098b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:35.055 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.047+0000 7f0b84969700 1 --2- 172.21.15.22:0/1980031089 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0b80097c60 0x7f0b80098b30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f0b74006fd0 tx=0x7f0b740090f0).stop 2022-04-28T14:41:35.055 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.047+0000 7f0b84969700 1 -- 172.21.15.22:0/1980031089 shutdown_connections 2022-04-28T14:41:35.055 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.047+0000 7f0b84969700 1 --2- 172.21.15.22:0/1980031089 >> v2:172.21.15.22:3300/0 conn(0x7f0b80133b60 0x7f0b80133fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.055 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.047+0000 7f0b84969700 1 --2- 172.21.15.22:0/1980031089 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0b80063100 0x7f0b8009a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.056 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.047+0000 7f0b84969700 1 --2- 172.21.15.22:0/1980031089 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0b80097c60 0x7f0b80098b30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.056 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.047+0000 7f0b84969700 1 -- 172.21.15.22:0/1980031089 >> 172.21.15.22:0/1980031089 conn(0x7f0b800aaf80 msgr2=0x7f0b800ab390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:35.056 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.047+0000 7f0b84969700 1 -- 172.21.15.22:0/1980031089 shutdown_connections 2022-04-28T14:41:35.056 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.047+0000 7f0b84969700 1 -- 172.21.15.22:0/1980031089 wait complete. 2022-04-28T14:41:35.056 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.048+0000 7f0b84969700 1 Processor -- start 2022-04-28T14:41:35.056 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.048+0000 7f0b84969700 1 -- start start 2022-04-28T14:41:35.058 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.049+0000 7f0b84969700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0b80063100 0x7f0b80143820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:35.058 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.049+0000 7f0b84969700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b80133b60 0x7f0b80092690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:35.058 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.049+0000 7f0b84969700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0b80091700 0x7f0b80136b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:35.058 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.049+0000 7f0b84969700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b80143d10 con 0x7f0b80133b60 2022-04-28T14:41:35.059 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.049+0000 7f0b84969700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b800910b0 con 0x7f0b80091700 2022-04-28T14:41:35.059 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.049+0000 7f0b84969700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b80091270 con 0x7f0b80063100 2022-04-28T14:41:35.059 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.049+0000 7f0b7ed9d700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0b80091700 0x7f0b80136b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:35.059 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.049+0000 7f0b7dd9b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b80133b60 0x7f0b80092690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:35.059 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.049+0000 7f0b7e59c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0b80063100 0x7f0b80143820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:35.059 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.049+0000 7f0b7ed9d700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0b80091700 0x7f0b80136b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48150/0 (socket says 172.21.15.22:48150) 2022-04-28T14:41:35.059 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.049+0000 7f0b7ed9d700 1 -- 172.21.15.22:0/1488660462 learned_addr learned my addr 172.21.15.22:0/1488660462 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:35.059 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.049+0000 7f0b7e59c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0b80063100 0x7f0b80143820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:47930/0 (socket says 172.21.15.22:47930) 2022-04-28T14:41:35.059 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.049+0000 7f0b7dd9b700 1 -- 172.21.15.22:0/1488660462 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0b80063100 msgr2=0x7f0b80143820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:35.060 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.049+0000 7f0b7dd9b700 1 --2- 172.21.15.22:0/1488660462 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0b80063100 0x7f0b80143820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.060 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.049+0000 7f0b7dd9b700 1 -- 172.21.15.22:0/1488660462 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0b80091700 msgr2=0x7f0b80136b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:35.060 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.049+0000 7f0b7dd9b700 1 --2- 172.21.15.22:0/1488660462 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0b80091700 0x7f0b80136b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.060 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.049+0000 7f0b7dd9b700 1 -- 172.21.15.22:0/1488660462 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7800bc30 con 0x7f0b80133b60 2022-04-28T14:41:35.060 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.049+0000 7f0b7ed9d700 1 --2- 172.21.15.22:0/1488660462 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0b80091700 0x7f0b80136b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:35.060 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.049+0000 7f0b7dd9b700 1 --2- 172.21.15.22:0/1488660462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b80133b60 0x7f0b80092690 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f0b74014000 tx=0x7f0b74017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:35.060 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.050+0000 7f0b6e7fc700 1 -- 172.21.15.22:0/1488660462 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7400fe80 con 0x7f0b80133b60 2022-04-28T14:41:35.060 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.050+0000 7f0b6e7fc700 1 -- 172.21.15.22:0/1488660462 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7400f7e0 con 0x7f0b80133b60 2022-04-28T14:41:35.060 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.050+0000 7f0b84969700 1 -- 172.21.15.22:0/1488660462 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b74009370 con 0x7f0b80133b60 2022-04-28T14:41:35.060 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.050+0000 7f0b6e7fc700 1 -- 172.21.15.22:0/1488660462 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7401c650 con 0x7f0b80133b60 2022-04-28T14:41:35.061 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.050+0000 7f0b84969700 1 -- 172.21.15.22:0/1488660462 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b80144250 con 0x7f0b80133b60 2022-04-28T14:41:35.061 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.050+0000 7f0b6e7fc700 1 -- 172.21.15.22:0/1488660462 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f0b7402c070 con 0x7f0b80133b60 2022-04-28T14:41:35.061 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.051+0000 7f0b84969700 1 -- 172.21.15.22:0/1488660462 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b800913b0 con 0x7f0b80133b60 2022-04-28T14:41:35.061 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.051+0000 7f0b6e7fc700 1 -- 172.21.15.22:0/1488660462 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f0b74056bb0 con 0x7f0b80133b60 2022-04-28T14:41:35.061 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.054+0000 7f0b6e7fc700 1 -- 172.21.15.22:0/1488660462 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f0b74025970 con 0x7f0b80133b60 2022-04-28T14:41:35.223 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.218+0000 7f0b84969700 1 -- 172.21.15.22:0/1488660462 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b80144250 con 0x7f0b80133b60 2022-04-28T14:41:35.262 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.218+0000 7f0b6e7fc700 1 -- 172.21.15.22:0/1488660462 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+3551 (secure 0 0 0) 0x7f0b80144250 con 0x7f0b80133b60 2022-04-28T14:41:35.263 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:41:35.263 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.22:6818/2291514211","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6818","nonce":2291514211}]},"join_fscid":-1,"export_targets":[],"features":4611087854035861503,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4576,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.22:6817/3098679086","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6817","nonce":3098679086}]},"join_fscid":-1,"export_targets":[],"features":4611087854035861503,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-04-28T14:39:13.928436+0000","modified":"2022-04-28T14:40:01.257396+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4184},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4184":{"gid":4184,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6819/356491488","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6819","nonce":356491488}]},"join_fscid":-1,"export_targets":[],"features":4611087854035861503,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-04-28T14:41:35.264 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.220+0000 7f0b84969700 1 -- 172.21.15.22:0/1488660462 >> v1:172.21.15.22:6808/92758 conn(0x7f0b5c041b30 legacy=0x7f0b5c043ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:35.264 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.220+0000 7f0b84969700 1 -- 172.21.15.22:0/1488660462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b80133b60 msgr2=0x7f0b80092690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:35.265 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.220+0000 7f0b84969700 1 --2- 172.21.15.22:0/1488660462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b80133b60 0x7f0b80092690 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f0b74014000 tx=0x7f0b74017000).stop 2022-04-28T14:41:35.265 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.220+0000 7f0b84969700 1 -- 172.21.15.22:0/1488660462 shutdown_connections 2022-04-28T14:41:35.265 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.220+0000 7f0b84969700 1 --2- 172.21.15.22:0/1488660462 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f0b80091700 0x7f0b80136b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.265 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.220+0000 7f0b84969700 1 --2- 172.21.15.22:0/1488660462 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f0b80063100 0x7f0b80143820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.265 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.220+0000 7f0b84969700 1 --2- 172.21.15.22:0/1488660462 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0b80133b60 0x7f0b80092690 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.265 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.220+0000 7f0b84969700 1 -- 172.21.15.22:0/1488660462 >> 172.21.15.22:0/1488660462 conn(0x7f0b800aaf80 msgr2=0x7f0b80063c40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:35.265 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.220+0000 7f0b84969700 1 -- 172.21.15.22:0/1488660462 shutdown_connections 2022-04-28T14:41:35.265 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.220+0000 7f0b84969700 1 -- 172.21.15.22:0/1488660462 wait complete. 2022-04-28T14:41:35.265 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 14 2022-04-28T14:41:35.568 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-04-28T14:39:13.928436+0000', 'modified': '2022-04-28T14:40:01.257396+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4184}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_4184': {'gid': 4184, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.22:6819/356491488', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.22:6819', 'nonce': 356491488}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4611087854035861503, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-04-28T14:41:35.568 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-04-28T14:41:35.569 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2022-04-28T14:41:35.692 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.687+0000 7f1f6d924700 1 Processor -- start 2022-04-28T14:41:35.692 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.688+0000 7f1f6d924700 1 -- start start 2022-04-28T14:41:35.697 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.688+0000 7f1f6d924700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1f68068d00 0x7f1f68066c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:35.698 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.688+0000 7f1f6d924700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1f68062640 0x7f1f68062af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:35.698 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.688+0000 7f1f6d924700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f68067330 con 0x7f1f68068130 2022-04-28T14:41:35.698 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.688+0000 7f1f6d924700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f680aa710 con 0x7f1f68068d00 2022-04-28T14:41:35.698 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.688+0000 7f1f6d924700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f680a5bc0 con 0x7f1f68062640 2022-04-28T14:41:35.698 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.688+0000 7f1f667fc700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1f68068d00 0x7f1f68066c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:35.698 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.688+0000 7f1f677fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1f68062640 0x7f1f68062af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:35.698 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.688+0000 7f1f667fc700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1f68068d00 0x7f1f68066c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48154/0 (socket says 172.21.15.22:48154) 2022-04-28T14:41:35.698 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.688+0000 7f1f667fc700 1 -- 172.21.15.22:0/1870229477 learned_addr learned my addr 172.21.15.22:0/1870229477 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:35.698 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.688+0000 7f1f66ffd700 1 --1- 172.21.15.22:0/1870229477 >> v1:172.21.15.22:6789/0 conn(0x7f1f68068130 0x7f1f68061f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:39982/0 (socket says 172.21.15.22:39982) 2022-04-28T14:41:35.699 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.689+0000 7f1f677fe700 1 -- 172.21.15.22:0/1870229477 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1f68068d00 msgr2=0x7f1f68066c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:35.699 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.689+0000 7f1f677fe700 1 --2- 172.21.15.22:0/1870229477 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1f68068d00 0x7f1f68066c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.699 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.689+0000 7f1f677fe700 1 -- 172.21.15.22:0/1870229477 >> v1:172.21.15.22:6789/0 conn(0x7f1f68068130 legacy=0x7f1f68061f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:35.699 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.689+0000 7f1f65ffb700 1 -- 172.21.15.22:0/1870229477 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478711853 0 0) 0x7f1f68067330 con 0x7f1f68068130 2022-04-28T14:41:35.699 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.689+0000 7f1f677fe700 1 -- 172.21.15.22:0/1870229477 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f680aa290 con 0x7f1f68062640 2022-04-28T14:41:35.699 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.689+0000 7f1f667fc700 1 --2- 172.21.15.22:0/1870229477 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1f68068d00 0x7f1f68066c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:35.699 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.689+0000 7f1f677fe700 1 --2- 172.21.15.22:0/1870229477 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1f68062640 0x7f1f68062af0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f1f60009e90 tx=0x7f1f60009780).ready entity=mon.2 client_cookie=3455027020d2bd5a server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:35.699 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.689+0000 7f1f65ffb700 1 -- 172.21.15.22:0/1870229477 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6000e070 con 0x7f1f68062640 2022-04-28T14:41:35.699 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.689+0000 7f1f65ffb700 1 -- 172.21.15.22:0/1870229477 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6000bb60 con 0x7f1f68062640 2022-04-28T14:41:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.689+0000 7f1f65ffb700 1 -- 172.21.15.22:0/1870229477 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f60012410 con 0x7f1f68062640 2022-04-28T14:41:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.689+0000 7f1f6d924700 1 -- 172.21.15.22:0/1870229477 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1f68062640 msgr2=0x7f1f68062af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.689+0000 7f1f6d924700 1 --2- 172.21.15.22:0/1870229477 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1f68062640 0x7f1f68062af0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f1f60009e90 tx=0x7f1f60009780).stop 2022-04-28T14:41:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.689+0000 7f1f6d924700 1 -- 172.21.15.22:0/1870229477 shutdown_connections 2022-04-28T14:41:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.689+0000 7f1f6d924700 1 --2- 172.21.15.22:0/1870229477 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1f68062640 0x7f1f68062af0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.689+0000 7f1f6d924700 1 --2- 172.21.15.22:0/1870229477 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1f68068d00 0x7f1f68066c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.689+0000 7f1f6d924700 1 -- 172.21.15.22:0/1870229477 >> 172.21.15.22:0/1870229477 conn(0x7f1f680ae9d0 msgr2=0x7f1f680aede0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.690+0000 7f1f6d924700 1 -- 172.21.15.22:0/1870229477 shutdown_connections 2022-04-28T14:41:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.690+0000 7f1f6d924700 1 -- 172.21.15.22:0/1870229477 wait complete. 2022-04-28T14:41:35.700 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.691+0000 7f1f6d924700 1 Processor -- start 2022-04-28T14:41:35.701 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.691+0000 7f1f6d924700 1 -- start start 2022-04-28T14:41:35.701 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.691+0000 7f1f6d924700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f68062640 0x7f1f6809c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:35.701 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.691+0000 7f1f6d924700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1f68068130 0x7f1f6809a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:35.701 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.691+0000 7f1f6d924700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1f68068d00 0x7f1f68147680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:35.701 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.691+0000 7f1f6d924700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6809baa0 con 0x7f1f68062640 2022-04-28T14:41:35.701 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.691+0000 7f1f6d924700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f68147b70 con 0x7f1f68068d00 2022-04-28T14:41:35.701 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.691+0000 7f1f6d924700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f68147e00 con 0x7f1f68068130 2022-04-28T14:41:35.701 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.691+0000 7f1f66ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f68062640 0x7f1f6809c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:35.701 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.691+0000 7f1f677fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1f68068d00 0x7f1f68147680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:35.701 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.691+0000 7f1f677fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1f68068d00 0x7f1f68147680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48162/0 (socket says 172.21.15.22:48162) 2022-04-28T14:41:35.701 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.691+0000 7f1f66ffd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f68062640 0x7f1f6809c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50590/0 (socket says 172.21.15.22:50590) 2022-04-28T14:41:35.702 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.691+0000 7f1f677fe700 1 -- 172.21.15.22:0/1603709834 learned_addr learned my addr 172.21.15.22:0/1603709834 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:35.702 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.691+0000 7f1f667fc700 1 --2- 172.21.15.22:0/1603709834 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1f68068130 0x7f1f6809a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:35.702 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.692+0000 7f1f66ffd700 1 -- 172.21.15.22:0/1603709834 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1f68068130 msgr2=0x7f1f6809a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:35.702 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.692+0000 7f1f66ffd700 1 --2- 172.21.15.22:0/1603709834 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1f68068130 0x7f1f6809a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.702 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.692+0000 7f1f66ffd700 1 -- 172.21.15.22:0/1603709834 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1f68068d00 msgr2=0x7f1f68147680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:35.702 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.692+0000 7f1f66ffd700 1 --2- 172.21.15.22:0/1603709834 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1f68068d00 0x7f1f68147680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.702 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.692+0000 7f1f66ffd700 1 -- 172.21.15.22:0/1603709834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f58009370 con 0x7f1f68062640 2022-04-28T14:41:35.702 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.692+0000 7f1f677fe700 1 --2- 172.21.15.22:0/1603709834 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1f68068d00 0x7f1f68147680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:35.702 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.692+0000 7f1f667fc700 1 --2- 172.21.15.22:0/1603709834 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1f68068130 0x7f1f6809a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:35.703 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.692+0000 7f1f66ffd700 1 --2- 172.21.15.22:0/1603709834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1f68062640 0x7f1f6809c2c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f1f5c000c00 tx=0x7f1f5c007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:35.703 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.692+0000 7f1f4effd700 1 -- 172.21.15.22:0/1603709834 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c0070d0 con 0x7f1f68062640 2022-04-28T14:41:35.703 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.692+0000 7f1f4effd700 1 -- 172.21.15.22:0/1603709834 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5c007230 con 0x7f1f68062640 2022-04-28T14:41:35.703 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.692+0000 7f1f6d924700 1 -- 172.21.15.22:0/1603709834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f60009a20 con 0x7f1f68062640 2022-04-28T14:41:35.703 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.692+0000 7f1f4effd700 1 -- 172.21.15.22:0/1603709834 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c0056e0 con 0x7f1f68062640 2022-04-28T14:41:35.703 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.692+0000 7f1f6d924700 1 -- 172.21.15.22:0/1603709834 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f6809ac80 con 0x7f1f68062640 2022-04-28T14:41:35.703 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.693+0000 7f1f4effd700 1 -- 172.21.15.22:0/1603709834 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f1f5c010070 con 0x7f1f68062640 2022-04-28T14:41:35.703 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.693+0000 7f1f4effd700 1 -- 172.21.15.22:0/1603709834 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f1f5c054900 con 0x7f1f68062640 2022-04-28T14:41:35.710 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.696+0000 7f1f7f272b80 1 Processor -- start 2022-04-28T14:41:35.710 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.696+0000 7f1f7f272b80 1 -- start start 2022-04-28T14:41:35.710 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.696+0000 7f1f7f272b80 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55cb32ec48f0 0x55cb32ec1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:35.710 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.696+0000 7f1f7f272b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cb32ec2560 0x55cb32ec1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:35.710 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.696+0000 7f1f7f272b80 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55cb32ec1c00 0x55cb32ee4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:35.710 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.696+0000 7f1f7f272b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb32e04000 con 0x55cb32ec2560 2022-04-28T14:41:35.710 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.696+0000 7f1f7f272b80 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb32e18b40 con 0x55cb32ec48f0 2022-04-28T14:41:35.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.696+0000 7f1f7f272b80 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x55cb32de08c0 con 0x55cb32ec1c00 2022-04-28T14:41:35.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.696+0000 7f1f66ffd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55cb32ec48f0 0x55cb32ec1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:35.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.696+0000 7f1f677fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55cb32ec1c00 0x55cb32ee4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:35.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.696+0000 7f1f66ffd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55cb32ec48f0 0x55cb32ec1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48166/0 (socket says 172.21.15.22:48166) 2022-04-28T14:41:35.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.696+0000 7f1f66ffd700 1 -- 172.21.15.22:0/3843114834 learned_addr learned my addr 172.21.15.22:0/3843114834 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:35.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.696+0000 7f1f667fc700 1 --2- 172.21.15.22:0/3843114834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cb32ec2560 0x55cb32ec1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:35.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.697+0000 7f1f66ffd700 1 -- 172.21.15.22:0/3843114834 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55cb32ec1c00 msgr2=0x55cb32ee4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:35.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.697+0000 7f1f66ffd700 1 --2- 172.21.15.22:0/3843114834 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55cb32ec1c00 0x55cb32ee4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.697+0000 7f1f66ffd700 1 -- 172.21.15.22:0/3843114834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cb32ec2560 msgr2=0x55cb32ec1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:35.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.697+0000 7f1f66ffd700 1 --2- 172.21.15.22:0/3843114834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cb32ec2560 0x55cb32ec1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.697+0000 7f1f66ffd700 1 -- 172.21.15.22:0/3843114834 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb32c41c10 con 0x55cb32ec48f0 2022-04-28T14:41:35.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.697+0000 7f1f677fe700 1 --2- 172.21.15.22:0/3843114834 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55cb32ec1c00 0x55cb32ee4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:35.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.697+0000 7f1f667fc700 1 --2- 172.21.15.22:0/3843114834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cb32ec2560 0x55cb32ec1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:35.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.697+0000 7f1f66ffd700 1 --2- 172.21.15.22:0/3843114834 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55cb32ec48f0 0x55cb32ec1220 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f1f5c007e30 tx=0x7f1f5c015000).ready entity=mon.1 client_cookie=5674c6f0bf9033f2 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:35.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.697+0000 7f1f43fff700 1 -- 172.21.15.22:0/3843114834 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c038910 con 0x55cb32ec48f0 2022-04-28T14:41:35.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.697+0000 7f1f43fff700 1 -- 172.21.15.22:0/3843114834 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5c038730 con 0x55cb32ec48f0 2022-04-28T14:41:35.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.697+0000 7f1f43fff700 1 -- 172.21.15.22:0/3843114834 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c037170 con 0x55cb32ec48f0 2022-04-28T14:41:35.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.698+0000 7f1f7f272b80 1 -- 172.21.15.22:0/3843114834 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55cb32ec48f0 msgr2=0x55cb32ec1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:35.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.698+0000 7f1f7f272b80 1 --2- 172.21.15.22:0/3843114834 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55cb32ec48f0 0x55cb32ec1220 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f1f5c007e30 tx=0x7f1f5c015000).stop 2022-04-28T14:41:35.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.698+0000 7f1f7f272b80 1 -- 172.21.15.22:0/3843114834 shutdown_connections 2022-04-28T14:41:35.713 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.698+0000 7f1f7f272b80 1 --2- 172.21.15.22:0/3843114834 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55cb32ec1c00 0x55cb32ee4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.713 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.698+0000 7f1f7f272b80 1 --2- 172.21.15.22:0/3843114834 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55cb32ec48f0 0x55cb32ec1220 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.713 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.698+0000 7f1f7f272b80 1 --2- 172.21.15.22:0/3843114834 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cb32ec2560 0x55cb32ec1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.713 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.698+0000 7f1f7f272b80 1 -- 172.21.15.22:0/3843114834 >> 172.21.15.22:0/3843114834 conn(0x55cb32d31470 msgr2=0x55cb32ec56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:35.713 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.698+0000 7f1f7f272b80 1 -- 172.21.15.22:0/3843114834 shutdown_connections 2022-04-28T14:41:35.713 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.698+0000 7f1f7f272b80 1 -- 172.21.15.22:0/3843114834 wait complete. 2022-04-28T14:41:35.713 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.698+0000 7f1f7f272b80 1 -- start start 2022-04-28T14:41:35.713 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.698+0000 7f1f7f272b80 1 Processor -- start 2022-04-28T14:41:35.713 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.699+0000 7f1f7f272b80 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55cb32ec1c00 0x55cb32ee98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:35.713 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.699+0000 7f1f7f272b80 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cb32ec2560 0x55cb32ee8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:35.714 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.699+0000 7f1f7f272b80 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55cb32ec48f0 0x55cb32eea9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:35.714 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.699+0000 7f1f7f272b80 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb32de5110 con 0x55cb32ec2560 2022-04-28T14:41:35.714 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.699+0000 7f1f7f272b80 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb32ee57c0 con 0x55cb32ec48f0 2022-04-28T14:41:35.714 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.699+0000 7f1f7f272b80 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x55cb32ee9410 con 0x55cb32ec1c00 2022-04-28T14:41:35.714 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.699+0000 7f1f7f272b80 10 client.0 ll_register_callbacks cb 0x55cb32dba390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-04-28T14:41:35.714 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.699+0000 7f1f667fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cb32ec2560 0x55cb32ee8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:35.714 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.699+0000 7f1f66ffd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55cb32ec1c00 0x55cb32ee98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:35.714 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.699+0000 7f1f667fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cb32ec2560 0x55cb32ee8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50606/0 (socket says 172.21.15.22:50606) 2022-04-28T14:41:35.714 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.699+0000 7f1f667fc700 1 -- 172.21.15.22:0/4092608646 learned_addr learned my addr 172.21.15.22:0/4092608646 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:35.715 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.699+0000 7f1f677fe700 1 --2- 172.21.15.22:0/4092608646 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55cb32ec48f0 0x55cb32eea9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:35.715 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.699+0000 7f1f66ffd700 1 -- 172.21.15.22:0/4092608646 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55cb32ec48f0 msgr2=0x55cb32eea9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:35.715 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.699+0000 7f1f66ffd700 1 --2- 172.21.15.22:0/4092608646 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55cb32ec48f0 0x55cb32eea9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.715 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.699+0000 7f1f66ffd700 1 -- 172.21.15.22:0/4092608646 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cb32ec2560 msgr2=0x55cb32ee8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:35.715 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.700+0000 7f1f66ffd700 1 --2- 172.21.15.22:0/4092608646 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cb32ec2560 0x55cb32ee8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.715 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.700+0000 7f1f66ffd700 1 -- 172.21.15.22:0/4092608646 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f680aa290 con 0x55cb32ec1c00 2022-04-28T14:41:35.715 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.700+0000 7f1f667fc700 1 --2- 172.21.15.22:0/4092608646 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cb32ec2560 0x55cb32ee8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:35.715 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.700+0000 7f1f66ffd700 1 --2- 172.21.15.22:0/4092608646 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55cb32ec1c00 0x55cb32ee98a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1f5c038d00 tx=0x7f1f5c027000).ready entity=mon.2 client_cookie=cd468895ee4ba069 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:35.715 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.700+0000 7f1f417fa700 10 client.0 ms_handle_connect on v2:172.21.15.22:3302/0 2022-04-28T14:41:35.715 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.700+0000 7f1f417fa700 1 -- 172.21.15.22:0/4092608646 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c030070 con 0x55cb32ec1c00 2022-04-28T14:41:35.716 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.700+0000 7f1f417fa700 1 -- 172.21.15.22:0/4092608646 <== mon.2 v2:172.21.15.22:3302/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f1f5c037d30 con 0x55cb32ec1c00 2022-04-28T14:41:35.716 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.700+0000 7f1f7f272b80 1 -- 172.21.15.22:0/4092608646 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cb32ec0640 con 0x55cb32ec1c00 2022-04-28T14:41:35.716 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.700+0000 7f1f417fa700 1 -- 172.21.15.22:0/4092608646 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f5c038100 con 0x55cb32ec1c00 2022-04-28T14:41:35.716 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.700+0000 7f1f7f272b80 10 client.14267 fetch_fsmap learned FSMap version 14 2022-04-28T14:41:35.716 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.700+0000 7f1f7f272b80 1 -- 172.21.15.22:0/4092608646 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,fsmap=14,monmap=3+}) v3 -- 0x7f1f58013420 con 0x55cb32ec1c00 2022-04-28T14:41:35.716 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.700+0000 7f1f417fa700 1 -- 172.21.15.22:0/4092608646 <== mon.2 v2:172.21.15.22:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cb32ec0640 con 0x55cb32ec1c00 2022-04-28T14:41:35.716 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.700+0000 7f1f417fa700 1 -- 172.21.15.22:0/4092608646 <== mon.2 v2:172.21.15.22:3302/0 5 ==== fsmap(e 14) v1 ==== 2454+0+0 (secure 0 0 0) 0x7f1f5c005840 con 0x55cb32ec1c00 2022-04-28T14:41:35.716 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.700+0000 7f1f7f272b80 10 client.14267 fetch_fsmap finished waiting for FSMap version 14 2022-04-28T14:41:35.716 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.700+0000 7f1f7f272b80 10 client.14267 resolve_mds: resolved name 'c' to daemon mds.c 2022-04-28T14:41:35.717 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.700+0000 7f1f7f272b80 20 client.14267 populate_metadata read hostname 'smithi022' 2022-04-28T14:41:35.717 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.700+0000 7f1f7f272b80 4 client.14267 mds_command: new command op to 4184 tid=0[{"prefix": "get_command_descriptions"}] 2022-04-28T14:41:35.717 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.700+0000 7f1f7f272b80 1 -- 172.21.15.22:0/4092608646 --> v1:172.21.15.22:6819/356491488 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cb32e900a0 con 0x55cb32f02150 2022-04-28T14:41:35.717 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.701+0000 7f1f417fa700 10 client.14267 ms_handle_connect on v1:172.21.15.22:6819/356491488 2022-04-28T14:41:35.717 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.701+0000 7f1f417fa700 1 -- 172.21.15.22:0/4092608646 <== mds.0 v1:172.21.15.22:6819/356491488 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3729 (unknown 0 0 338808096) 0x55cb32e900a0 con 0x55cb32f02150 2022-04-28T14:41:35.717 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.701+0000 7f1f417fa700 10 client.14267 handle_command_reply: tid=0 2022-04-28T14:41:35.717 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.701+0000 7f1f7f272b80 1 client.14267 shutdown 2022-04-28T14:41:35.717 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.701+0000 7f1f7f272b80 1 -- 172.21.15.22:0/4092608646 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55cb32ec1c00 msgr2=0x55cb32ee98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:35.717 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.701+0000 7f1f7f272b80 1 --2- 172.21.15.22:0/4092608646 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55cb32ec1c00 0x55cb32ee98a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1f5c038d00 tx=0x7f1f5c027000).stop 2022-04-28T14:41:35.717 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.701+0000 7f1f7f272b80 1 -- 172.21.15.22:0/4092608646 shutdown_connections 2022-04-28T14:41:35.717 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.701+0000 7f1f7f272b80 1 --2- 172.21.15.22:0/4092608646 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x55cb32ec48f0 0x55cb32eea9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.718 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.701+0000 7f1f417fa700 0 client.14267 ms_handle_reset on v1:172.21.15.22:6819/356491488 2022-04-28T14:41:35.718 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.701+0000 7f1f7f272b80 1 --2- 172.21.15.22:0/4092608646 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x55cb32ec1c00 0x55cb32ee98a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.718 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.701+0000 7f1f7f272b80 1 --2- 172.21.15.22:0/4092608646 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55cb32ec2560 0x55cb32ee8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.718 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.701+0000 7f1f7f272b80 1 -- 172.21.15.22:0/4092608646 >> 172.21.15.22:0/4092608646 conn(0x55cb32d31470 msgr2=0x55cb32eefda0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:35.718 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.701+0000 7f1f7f272b80 1 -- 172.21.15.22:0/4092608646 shutdown_connections 2022-04-28T14:41:35.718 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.701+0000 7f1f7f272b80 1 -- 172.21.15.22:0/4092608646 wait complete. 2022-04-28T14:41:35.718 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.701+0000 7f1f7f272b80 20 client.14267 trim_cache size 0 max 16384 2022-04-28T14:41:35.719 DEBUG:teuthology.orchestra.run:got remote process result: 22 2022-04-28T14:41:35.719 INFO:teuthology.orchestra.run.smithi022.stderr:no valid command found; 10 closest matches: 2022-04-28T14:41:35.719 INFO:teuthology.orchestra.run.smithi022.stderr:injectargs ... 2022-04-28T14:41:35.720 INFO:teuthology.orchestra.run.smithi022.stderr:config set 2022-04-28T14:41:35.720 INFO:teuthology.orchestra.run.smithi022.stderr:config unset 2022-04-28T14:41:35.720 INFO:teuthology.orchestra.run.smithi022.stderr:exit 2022-04-28T14:41:35.720 INFO:teuthology.orchestra.run.smithi022.stderr:respawn 2022-04-28T14:41:35.720 INFO:teuthology.orchestra.run.smithi022.stderr:session kill 2022-04-28T14:41:35.720 INFO:teuthology.orchestra.run.smithi022.stderr:cpu_profiler status|flush 2022-04-28T14:41:35.720 INFO:teuthology.orchestra.run.smithi022.stderr:session ls [...] 2022-04-28T14:41:35.720 INFO:teuthology.orchestra.run.smithi022.stderr:client ls [...] 2022-04-28T14:41:35.720 INFO:teuthology.orchestra.run.smithi022.stderr:session evict [...] 2022-04-28T14:41:35.720 INFO:teuthology.orchestra.run.smithi022.stderr:Error EINVAL: invalid command 2022-04-28T14:41:35.721 INFO:teuthology.run_tasks:Running task ceph.restart... 2022-04-28T14:41:35.732 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2022-04-28T14:41:35.733 INFO:teuthology.orchestra.run:waiting for 300 2022-04-28T14:41:35.760 INFO:tasks.ceph.osd.0:Stopped 2022-04-28T14:41:35.760 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 0 2022-04-28T14:41:35.929 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.922+0000 7fe0db079700 1 Processor -- start 2022-04-28T14:41:35.929 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.922+0000 7fe0db079700 1 -- start start 2022-04-28T14:41:35.929 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.922+0000 7fe0db079700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe0d4063e20 0x7fe0d4067a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:35.929 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.922+0000 7fe0db079700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe0d4139bc0 0x7fe0d4139fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:35.929 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.922+0000 7fe0db079700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe0d409b4d0 0x7fe0d409b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:35.929 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.922+0000 7fe0db079700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0d4064200 con 0x7fe0d4139bc0 2022-04-28T14:41:35.929 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.922+0000 7fe0db079700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d4068040 con 0x7fe0d4063e20 2022-04-28T14:41:35.930 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.922+0000 7fe0db079700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d4063960 con 0x7fe0d409b4d0 2022-04-28T14:41:35.930 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.922+0000 7fe0d3fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe0d4139bc0 0x7fe0d4139fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:35.930 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.923+0000 7fe0d8e15700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe0d4063e20 0x7fe0d4067a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:35.930 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.923+0000 7fe0d3fff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe0d4139bc0 0x7fe0d4139fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50630/0 (socket says 172.21.15.22:50630) 2022-04-28T14:41:35.930 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.923+0000 7fe0d9616700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe0d409b4d0 0x7fe0d409b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:35.930 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.923+0000 7fe0d3fff700 1 -- 172.21.15.22:0/1910717318 learned_addr learned my addr 172.21.15.22:0/1910717318 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:35.930 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.923+0000 7fe0d9616700 1 -- 172.21.15.22:0/1910717318 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe0d4063e20 msgr2=0x7fe0d4067a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:35.930 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.923+0000 7fe0d9616700 1 --2- 172.21.15.22:0/1910717318 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe0d4063e20 0x7fe0d4067a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.930 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.923+0000 7fe0d9616700 1 -- 172.21.15.22:0/1910717318 >> v2:172.21.15.22:3300/0 conn(0x7fe0d4139bc0 msgr2=0x7fe0d4139fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:35.930 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.923+0000 7fe0d9616700 1 --2- 172.21.15.22:0/1910717318 >> v2:172.21.15.22:3300/0 conn(0x7fe0d4139bc0 0x7fe0d4139fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.931 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.923+0000 7fe0d9616700 1 -- 172.21.15.22:0/1910717318 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d409daf0 con 0x7fe0d409b4d0 2022-04-28T14:41:35.931 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.923+0000 7fe0d3fff700 1 --2- 172.21.15.22:0/1910717318 >> v2:172.21.15.22:3300/0 conn(0x7fe0d4139bc0 0x7fe0d4139fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:35.931 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.923+0000 7fe0d9616700 1 --2- 172.21.15.22:0/1910717318 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe0d409b4d0 0x7fe0d409b960 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fe0cc009e60 tx=0x7fe0cc009780).ready entity=mon.2 client_cookie=715d7e2e9c9a0178 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:35.931 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.923+0000 7fe0d37fe700 1 -- 172.21.15.22:0/1910717318 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc00e070 con 0x7fe0d409b4d0 2022-04-28T14:41:35.931 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.923+0000 7fe0d37fe700 1 -- 172.21.15.22:0/1910717318 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0cc00bab0 con 0x7fe0d409b4d0 2022-04-28T14:41:35.931 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.923+0000 7fe0d37fe700 1 -- 172.21.15.22:0/1910717318 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc00be30 con 0x7fe0d409b4d0 2022-04-28T14:41:35.931 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.924+0000 7fe0db079700 1 -- 172.21.15.22:0/1910717318 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe0d409b4d0 msgr2=0x7fe0d409b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:35.931 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.924+0000 7fe0db079700 1 --2- 172.21.15.22:0/1910717318 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe0d409b4d0 0x7fe0d409b960 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fe0cc009e60 tx=0x7fe0cc009780).stop 2022-04-28T14:41:35.931 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.924+0000 7fe0db079700 1 -- 172.21.15.22:0/1910717318 shutdown_connections 2022-04-28T14:41:35.931 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.924+0000 7fe0db079700 1 --2- 172.21.15.22:0/1910717318 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe0d409b4d0 0x7fe0d409b960 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.932 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.924+0000 7fe0db079700 1 --2- 172.21.15.22:0/1910717318 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe0d4063e20 0x7fe0d4067a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.932 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.924+0000 7fe0db079700 1 --2- 172.21.15.22:0/1910717318 >> v2:172.21.15.22:3300/0 conn(0x7fe0d4139bc0 0x7fe0d4139fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.932 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.924+0000 7fe0db079700 1 -- 172.21.15.22:0/1910717318 >> 172.21.15.22:0/1910717318 conn(0x7fe0d40aaf80 msgr2=0x7fe0d40ab390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:35.932 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.924+0000 7fe0db079700 1 -- 172.21.15.22:0/1910717318 shutdown_connections 2022-04-28T14:41:35.932 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.924+0000 7fe0db079700 1 -- 172.21.15.22:0/1910717318 wait complete. 2022-04-28T14:41:35.935 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.925+0000 7fe0db079700 1 Processor -- start 2022-04-28T14:41:35.935 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.925+0000 7fe0db079700 1 -- start start 2022-04-28T14:41:35.935 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.925+0000 7fe0db079700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe0d4063e20 0x7fe0d4097260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:35.935 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.925+0000 7fe0db079700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe0d409b4d0 0x7fe0d4096090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:35.935 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.925+0000 7fe0db079700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0d4139bc0 0x7fe0d4149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:35.935 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.925+0000 7fe0db079700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d4096d20 con 0x7fe0d4139bc0 2022-04-28T14:41:35.935 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.925+0000 7fe0db079700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d4096a60 con 0x7fe0d409b4d0 2022-04-28T14:41:35.935 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.925+0000 7fe0db079700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d4097bc0 con 0x7fe0d4063e20 2022-04-28T14:41:35.936 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.926+0000 7fe0d8e15700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe0d4063e20 0x7fe0d4097260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:35.936 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.926+0000 7fe0d8e15700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe0d4063e20 0x7fe0d4097260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:47986/0 (socket says 172.21.15.22:47986) 2022-04-28T14:41:35.936 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.926+0000 7fe0d8e15700 1 -- 172.21.15.22:0/3058454366 learned_addr learned my addr 172.21.15.22:0/3058454366 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:35.936 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.926+0000 7fe0d9616700 1 --2- 172.21.15.22:0/3058454366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0d4139bc0 0x7fe0d4149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:35.936 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.926+0000 7fe0d3fff700 1 --2- 172.21.15.22:0/3058454366 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe0d409b4d0 0x7fe0d4096090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:35.936 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.926+0000 7fe0d8e15700 1 -- 172.21.15.22:0/3058454366 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe0d409b4d0 msgr2=0x7fe0d4096090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:35.936 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.926+0000 7fe0d8e15700 1 --2- 172.21.15.22:0/3058454366 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe0d409b4d0 0x7fe0d4096090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.936 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.926+0000 7fe0d8e15700 1 -- 172.21.15.22:0/3058454366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0d4139bc0 msgr2=0x7fe0d4149420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:35.936 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.926+0000 7fe0d8e15700 1 --2- 172.21.15.22:0/3058454366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0d4139bc0 0x7fe0d4149420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:35.936 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.926+0000 7fe0d8e15700 1 -- 172.21.15.22:0/3058454366 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c0009370 con 0x7fe0d4063e20 2022-04-28T14:41:35.937 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.926+0000 7fe0d9616700 1 --2- 172.21.15.22:0/3058454366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0d4139bc0 0x7fe0d4149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:35.937 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.926+0000 7fe0d8e15700 1 --2- 172.21.15.22:0/3058454366 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe0d4063e20 0x7fe0d4097260 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fe0c800e900 tx=0x7fe0c8009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:35.937 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.926+0000 7fe0d0ff9700 1 -- 172.21.15.22:0/3058454366 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8009390 con 0x7fe0d4063e20 2022-04-28T14:41:35.937 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.926+0000 7fe0d0ff9700 1 -- 172.21.15.22:0/3058454366 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c8012600 con 0x7fe0d4063e20 2022-04-28T14:41:35.937 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.926+0000 7fe0db079700 1 -- 172.21.15.22:0/3058454366 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0cc009a20 con 0x7fe0d4063e20 2022-04-28T14:41:35.937 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.926+0000 7fe0d0ff9700 1 -- 172.21.15.22:0/3058454366 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8012980 con 0x7fe0d4063e20 2022-04-28T14:41:35.937 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.926+0000 7fe0db079700 1 -- 172.21.15.22:0/3058454366 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d409f510 con 0x7fe0d4063e20 2022-04-28T14:41:35.937 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.927+0000 7fe0d0ff9700 1 -- 172.21.15.22:0/3058454366 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7fe0c8022070 con 0x7fe0d4063e20 2022-04-28T14:41:35.937 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.927+0000 7fe0db079700 1 -- 172.21.15.22:0/3058454366 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d4095ee0 con 0x7fe0d4063e20 2022-04-28T14:41:35.938 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.927+0000 7fe0d0ff9700 1 -- 172.21.15.22:0/3058454366 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3702+0+0 (secure 0 0 0) 0x7fe0c8055550 con 0x7fe0d4063e20 2022-04-28T14:41:35.938 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:35.931+0000 7fe0d0ff9700 1 -- 172.21.15.22:0/3058454366 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7fe0c8035b90 con 0x7fe0d4063e20 2022-04-28T14:41:36.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.083+0000 7fe0db079700 1 -- 172.21.15.22:0/3058454366 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "osd down", "ids": ["0"]} v 0) v1 -- 0x7fe0d40a91c0 con 0x7fe0d4063e20 2022-04-28T14:41:36.089 INFO:tasks.ceph.mon.a.smithi022.stderr:2022-04-28T14:41:36.084+0000 7f9bed53e700 -1 mon.a@0(leader).osd e22 definitely_dead 0 2022-04-28T14:41:36.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.084+0000 7fe0d0ff9700 1 -- 172.21.15.22:0/3058454366 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["0"]}]=0 osd.0 is already down. v22) v1 ==== 93+0+0 (secure 0 0 0) 0x7fe0c8039380 con 0x7fe0d4063e20 2022-04-28T14:41:36.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.086+0000 7fe0db079700 1 -- 172.21.15.22:0/3058454366 >> v1:172.21.15.22:6808/92758 conn(0x7fe0bc041b00 legacy=0x7fe0bc043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:36.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.086+0000 7fe0db079700 1 -- 172.21.15.22:0/3058454366 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe0d4063e20 msgr2=0x7fe0d4097260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:36.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.086+0000 7fe0db079700 1 --2- 172.21.15.22:0/3058454366 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe0d4063e20 0x7fe0d4097260 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fe0c800e900 tx=0x7fe0c8009060).stop 2022-04-28T14:41:36.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.086+0000 7fe0db079700 1 -- 172.21.15.22:0/3058454366 shutdown_connections 2022-04-28T14:41:36.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.086+0000 7fe0db079700 1 --2- 172.21.15.22:0/3058454366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0d4139bc0 0x7fe0d4149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:36.092 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.086+0000 7fe0db079700 1 --2- 172.21.15.22:0/3058454366 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe0d4063e20 0x7fe0d4097260 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:36.092 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.086+0000 7fe0db079700 1 --2- 172.21.15.22:0/3058454366 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe0d409b4d0 0x7fe0d4096090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:36.092 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.086+0000 7fe0db079700 1 -- 172.21.15.22:0/3058454366 >> 172.21.15.22:0/3058454366 conn(0x7fe0d40aaf80 msgr2=0x7fe0d4069640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:36.092 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.086+0000 7fe0db079700 1 -- 172.21.15.22:0/3058454366 shutdown_connections 2022-04-28T14:41:36.092 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.086+0000 7fe0db079700 1 -- 172.21.15.22:0/3058454366 wait complete. 2022-04-28T14:41:36.092 INFO:teuthology.orchestra.run.smithi022.stderr:osd.0 is already down. 2022-04-28T14:41:36.102 INFO:tasks.ceph.osd.0:Restarting daemon 2022-04-28T14:41:36.102 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2022-04-28T14:41:36.105 INFO:tasks.ceph.osd.0:Started 2022-04-28T14:41:36.105 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2022-04-28T14:41:36.105 INFO:teuthology.orchestra.run:waiting for 300 2022-04-28T14:41:36.132 INFO:tasks.ceph.osd.1:Stopped 2022-04-28T14:41:36.132 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 1 2022-04-28T14:41:36.291 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.286+0000 7f5b812d0700 1 Processor -- start 2022-04-28T14:41:36.291 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.286+0000 7f5b812d0700 1 -- start start 2022-04-28T14:41:36.294 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.287+0000 7f5b812d0700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5b7c067010 0x7f5b7c13b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:36.294 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.287+0000 7f5b812d0700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5b7c13be70 0x7f5b7c142b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:36.294 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.287+0000 7f5b812d0700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b7c0a5cd0 con 0x7f5b7c0a5450 2022-04-28T14:41:36.295 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.287+0000 7f5b812d0700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b7c0673f0 con 0x7f5b7c13be70 2022-04-28T14:41:36.295 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.287+0000 7f5b812d0700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c0a5830 con 0x7f5b7c067010 2022-04-28T14:41:36.295 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.287+0000 7f5b7a7fc700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5b7c067010 0x7f5b7c13b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:36.295 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.287+0000 7f5b7b7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5b7c13be70 0x7f5b7c142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:36.295 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.287+0000 7f5b7affd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5b7c0a5450 0x7f5b7c135740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40062/0 (socket says 172.21.15.22:40062) 2022-04-28T14:41:36.295 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.287+0000 7f5b7affd700 1 -- 172.21.15.22:0/3284581013 learned_addr learned my addr 172.21.15.22:0/3284581013 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:41:36.295 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.288+0000 7f5b7b7fe700 1 -- 172.21.15.22:0/3284581013 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5b7c067010 msgr2=0x7f5b7c13b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:36.295 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.288+0000 7f5b7b7fe700 1 --2- 172.21.15.22:0/3284581013 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5b7c067010 0x7f5b7c13b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:36.295 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.288+0000 7f5b7b7fe700 1 -- 172.21.15.22:0/3284581013 >> v1:172.21.15.22:6789/0 conn(0x7f5b7c0a5450 legacy=0x7f5b7c135740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:36.295 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.288+0000 7f5b7b7fe700 1 -- 172.21.15.22:0/3284581013 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7c13c350 con 0x7f5b7c13be70 2022-04-28T14:41:36.296 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.288+0000 7f5b79ffb700 1 -- 172.21.15.22:0/3284581013 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1317281680 0 0) 0x7f5b7c0a5cd0 con 0x7f5b7c0a5450 2022-04-28T14:41:36.296 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.288+0000 7f5b7a7fc700 1 --2- 172.21.15.22:0/3284581013 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5b7c067010 0x7f5b7c13b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:36.296 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.288+0000 7f5b7b7fe700 1 --2- 172.21.15.22:0/3284581013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b7c13be70 0x7f5b7c142b90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f5b74009e60 tx=0x7f5b74009780).ready entity=mon.0 client_cookie=60680e979d8d696d server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:36.296 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.288+0000 7f5b79ffb700 1 -- 172.21.15.22:0/3284581013 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7400e070 con 0x7f5b7c13be70 2022-04-28T14:41:36.296 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.288+0000 7f5b79ffb700 1 -- 172.21.15.22:0/3284581013 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7400bb60 con 0x7f5b7c13be70 2022-04-28T14:41:36.296 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.288+0000 7f5b79ffb700 1 -- 172.21.15.22:0/3284581013 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b74012410 con 0x7f5b7c13be70 2022-04-28T14:41:36.296 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.288+0000 7f5b812d0700 1 -- 172.21.15.22:0/3284581013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b7c13be70 msgr2=0x7f5b7c142b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:36.296 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.288+0000 7f5b812d0700 1 --2- 172.21.15.22:0/3284581013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b7c13be70 0x7f5b7c142b90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f5b74009e60 tx=0x7f5b74009780).stop 2022-04-28T14:41:36.296 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.288+0000 7f5b812d0700 1 -- 172.21.15.22:0/3284581013 shutdown_connections 2022-04-28T14:41:36.296 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.288+0000 7f5b812d0700 1 --2- 172.21.15.22:0/3284581013 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b7c13be70 0x7f5b7c142b90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:36.297 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.288+0000 7f5b812d0700 1 --2- 172.21.15.22:0/3284581013 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5b7c067010 0x7f5b7c13b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:36.297 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.288+0000 7f5b812d0700 1 -- 172.21.15.22:0/3284581013 >> 172.21.15.22:0/3284581013 conn(0x7f5b7c069860 msgr2=0x7f5b7c069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:36.297 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.288+0000 7f5b812d0700 1 -- 172.21.15.22:0/3284581013 shutdown_connections 2022-04-28T14:41:36.297 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.288+0000 7f5b812d0700 1 -- 172.21.15.22:0/3284581013 wait complete. 2022-04-28T14:41:36.297 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.290+0000 7f5b812d0700 1 Processor -- start 2022-04-28T14:41:36.297 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.290+0000 7f5b812d0700 1 -- start start 2022-04-28T14:41:36.299 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.290+0000 7f5b812d0700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5b7c067010 0x7f5b7c116d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:36.300 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.290+0000 7f5b812d0700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5b7c0a5450 0x7f5b7c115a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:36.300 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.290+0000 7f5b812d0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b7c13be70 0x7f5b7c1339c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:36.300 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.290+0000 7f5b812d0700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c1175f0 con 0x7f5b7c13be70 2022-04-28T14:41:36.300 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.290+0000 7f5b812d0700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c0a7820 con 0x7f5b7c0a5450 2022-04-28T14:41:36.300 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.290+0000 7f5b812d0700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c0a7ac0 con 0x7f5b7c067010 2022-04-28T14:41:36.300 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.290+0000 7f5b7affd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5b7c067010 0x7f5b7c116d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:36.300 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.290+0000 7f5b7a7fc700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5b7c0a5450 0x7f5b7c115a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:36.300 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.290+0000 7f5b7affd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5b7c067010 0x7f5b7c116d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48026/0 (socket says 172.21.15.22:48026) 2022-04-28T14:41:36.300 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.290+0000 7f5b7affd700 1 -- 172.21.15.22:0/2822472913 learned_addr learned my addr 172.21.15.22:0/2822472913 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:36.301 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.290+0000 7f5b7b7fe700 1 --2- 172.21.15.22:0/2822472913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b7c13be70 0x7f5b7c1339c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:36.301 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.291+0000 7f5b7a7fc700 1 -- 172.21.15.22:0/2822472913 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5b7c067010 msgr2=0x7f5b7c116d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:36.301 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.291+0000 7f5b7a7fc700 1 --2- 172.21.15.22:0/2822472913 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5b7c067010 0x7f5b7c116d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:36.301 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.291+0000 7f5b7a7fc700 1 -- 172.21.15.22:0/2822472913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b7c13be70 msgr2=0x7f5b7c1339c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:36.301 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.291+0000 7f5b7a7fc700 1 --2- 172.21.15.22:0/2822472913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b7c13be70 0x7f5b7c1339c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:36.301 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.291+0000 7f5b7a7fc700 1 -- 172.21.15.22:0/2822472913 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6c0092a0 con 0x7f5b7c0a5450 2022-04-28T14:41:36.301 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.291+0000 7f5b7b7fe700 1 --2- 172.21.15.22:0/2822472913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b7c13be70 0x7f5b7c1339c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:36.301 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.291+0000 7f5b7affd700 1 --2- 172.21.15.22:0/2822472913 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5b7c067010 0x7f5b7c116d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:36.301 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.291+0000 7f5b7a7fc700 1 --2- 172.21.15.22:0/2822472913 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5b7c0a5450 0x7f5b7c115a40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f5b6c00e880 tx=0x7f5b6c009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:36.302 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.291+0000 7f5b62ffd700 1 -- 172.21.15.22:0/2822472913 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c012600 con 0x7f5b7c0a5450 2022-04-28T14:41:36.302 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.291+0000 7f5b62ffd700 1 -- 172.21.15.22:0/2822472913 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c012760 con 0x7f5b7c0a5450 2022-04-28T14:41:36.302 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.291+0000 7f5b812d0700 1 -- 172.21.15.22:0/2822472913 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b74009a20 con 0x7f5b7c0a5450 2022-04-28T14:41:36.302 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.291+0000 7f5b62ffd700 1 -- 172.21.15.22:0/2822472913 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c012ae0 con 0x7f5b7c0a5450 2022-04-28T14:41:36.302 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.291+0000 7f5b812d0700 1 -- 172.21.15.22:0/2822472913 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b7c0a7400 con 0x7f5b7c0a5450 2022-04-28T14:41:36.302 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.292+0000 7f5b812d0700 1 -- 172.21.15.22:0/2822472913 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b7c09f510 con 0x7f5b7c0a5450 2022-04-28T14:41:36.302 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.292+0000 7f5b62ffd700 1 -- 172.21.15.22:0/2822472913 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f5b6c022070 con 0x7f5b7c0a5450 2022-04-28T14:41:36.302 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.292+0000 7f5b62ffd700 1 -- 172.21.15.22:0/2822472913 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f5b6c0556e0 con 0x7f5b7c0a5450 2022-04-28T14:41:36.303 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.296+0000 7f5b62ffd700 1 -- 172.21.15.22:0/2822472913 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f5b6c035d20 con 0x7f5b7c0a5450 2022-04-28T14:41:36.454 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.447+0000 7f5b812d0700 1 -- 172.21.15.22:0/2822472913 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd down", "ids": ["1"]} v 0) v1 -- 0x7f5b7c046540 con 0x7f5b7c0a5450 2022-04-28T14:41:36.454 INFO:tasks.ceph.mon.a.smithi022.stderr:2022-04-28T14:41:36.448+0000 7f9bed53e700 -1 mon.a@0(leader).osd e22 definitely_dead 0 2022-04-28T14:41:36.694 INFO:tasks.ceph.osd.0.smithi022.stderr:2022-04-28T14:41:36.690+0000 7ff496223200 -1 Falling back to public interface 2022-04-28T14:41:36.868 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.864+0000 7f5b62ffd700 1 -- 172.21.15.22:0/2822472913 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["1"]}]=0 marked down osd.1. v23) v1 ==== 89+0+0 (secure 0 0 0) 0x7f5b6c016070 con 0x7f5b7c0a5450 2022-04-28T14:41:36.871 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.866+0000 7f5b812d0700 1 -- 172.21.15.22:0/2822472913 >> v1:172.21.15.22:6808/92758 conn(0x7f5b5c041b30 legacy=0x7f5b5c043ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:36.871 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.866+0000 7f5b812d0700 1 -- 172.21.15.22:0/2822472913 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5b7c0a5450 msgr2=0x7f5b7c115a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:36.871 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.866+0000 7f5b812d0700 1 --2- 172.21.15.22:0/2822472913 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5b7c0a5450 0x7f5b7c115a40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f5b6c00e880 tx=0x7f5b6c009060).stop 2022-04-28T14:41:36.876 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.870+0000 7f5b812d0700 1 -- 172.21.15.22:0/2822472913 shutdown_connections 2022-04-28T14:41:36.876 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.870+0000 7f5b812d0700 1 --2- 172.21.15.22:0/2822472913 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5b7c13be70 0x7f5b7c1339c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:36.876 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.870+0000 7f5b812d0700 1 --2- 172.21.15.22:0/2822472913 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5b7c067010 0x7f5b7c116d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:36.877 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.870+0000 7f5b812d0700 1 --2- 172.21.15.22:0/2822472913 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f5b7c0a5450 0x7f5b7c115a40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:36.877 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.870+0000 7f5b812d0700 1 -- 172.21.15.22:0/2822472913 >> 172.21.15.22:0/2822472913 conn(0x7f5b7c069860 msgr2=0x7f5b7c0abf00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:36.877 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.872+0000 7f5b812d0700 1 -- 172.21.15.22:0/2822472913 shutdown_connections 2022-04-28T14:41:36.877 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:36.872+0000 7f5b812d0700 1 -- 172.21.15.22:0/2822472913 wait complete. 2022-04-28T14:41:36.881 INFO:teuthology.orchestra.run.smithi022.stderr:marked down osd.1. 2022-04-28T14:41:36.893 INFO:tasks.ceph.osd.1:Restarting daemon 2022-04-28T14:41:36.893 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2022-04-28T14:41:36.896 INFO:tasks.ceph.osd.1:Started 2022-04-28T14:41:36.896 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2022-04-28T14:41:36.896 INFO:teuthology.orchestra.run:waiting for 300 2022-04-28T14:41:36.934 INFO:tasks.ceph.osd.2:Stopped 2022-04-28T14:41:36.934 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 2 2022-04-28T14:41:37.099 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.089+0000 7f61d6f97700 1 Processor -- start 2022-04-28T14:41:37.099 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.089+0000 7f61d6f97700 1 -- start start 2022-04-28T14:41:37.099 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.089+0000 7f61d6f97700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f61d013b850 0x7f61d0138920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:37.100 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.089+0000 7f61d6f97700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f61d00681c0 0x7f61d0138e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:37.100 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.089+0000 7f61d6f97700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d00a7930 con 0x7f61d0064530 2022-04-28T14:41:37.100 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.089+0000 7f61d6f97700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d0064910 con 0x7f61d00681c0 2022-04-28T14:41:37.100 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.090+0000 7f61d6f97700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61d0138410 con 0x7f61d013b850 2022-04-28T14:41:37.100 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.090+0000 7f61cffff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f61d013b850 0x7f61d0138920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:37.100 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.090+0000 7f61d5534700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f61d00681c0 0x7f61d0138e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:37.100 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.090+0000 7f61d4d33700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f61d0064530 0x7f61d013bf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40118/0 (socket says 172.21.15.22:40118) 2022-04-28T14:41:37.100 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.090+0000 7f61d4d33700 1 -- 172.21.15.22:0/3407739783 learned_addr learned my addr 172.21.15.22:0/3407739783 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:41:37.101 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.090+0000 7f61d5534700 1 -- 172.21.15.22:0/3407739783 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f61d013b850 msgr2=0x7f61d0138920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:37.101 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.090+0000 7f61d5534700 1 --2- 172.21.15.22:0/3407739783 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f61d013b850 0x7f61d0138920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:37.101 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.090+0000 7f61d5534700 1 -- 172.21.15.22:0/3407739783 >> v1:172.21.15.22:6789/0 conn(0x7f61d0064530 legacy=0x7f61d013bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:37.101 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.090+0000 7f61cf7fe700 1 -- 172.21.15.22:0/3407739783 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638679545 0 0) 0x7f61d00a7930 con 0x7f61d0064530 2022-04-28T14:41:37.101 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.090+0000 7f61d5534700 1 -- 172.21.15.22:0/3407739783 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d0138670 con 0x7f61d00681c0 2022-04-28T14:41:37.101 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.090+0000 7f61cffff700 1 --2- 172.21.15.22:0/3407739783 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f61d013b850 0x7f61d0138920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:37.101 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.090+0000 7f61d5534700 1 --2- 172.21.15.22:0/3407739783 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f61d00681c0 0x7f61d0138e10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f61c8009e90 tx=0x7f61c8009780).ready entity=mon.1 client_cookie=d810dfa41754ff86 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:37.101 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.090+0000 7f61cf7fe700 1 -- 172.21.15.22:0/3407739783 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c800e070 con 0x7f61d00681c0 2022-04-28T14:41:37.101 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.090+0000 7f61cf7fe700 1 -- 172.21.15.22:0/3407739783 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c800bb60 con 0x7f61d00681c0 2022-04-28T14:41:37.102 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.090+0000 7f61cf7fe700 1 -- 172.21.15.22:0/3407739783 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c8012410 con 0x7f61d00681c0 2022-04-28T14:41:37.102 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.091+0000 7f61d6f97700 1 -- 172.21.15.22:0/3407739783 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f61d00681c0 msgr2=0x7f61d0138e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:37.102 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.091+0000 7f61d6f97700 1 --2- 172.21.15.22:0/3407739783 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f61d00681c0 0x7f61d0138e10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f61c8009e90 tx=0x7f61c8009780).stop 2022-04-28T14:41:37.102 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.091+0000 7f61d6f97700 1 -- 172.21.15.22:0/3407739783 shutdown_connections 2022-04-28T14:41:37.102 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.091+0000 7f61d6f97700 1 --2- 172.21.15.22:0/3407739783 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f61d00681c0 0x7f61d0138e10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:37.102 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.091+0000 7f61d6f97700 1 --2- 172.21.15.22:0/3407739783 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f61d013b850 0x7f61d0138920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:37.102 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.091+0000 7f61d6f97700 1 -- 172.21.15.22:0/3407739783 >> 172.21.15.22:0/3407739783 conn(0x7f61d0067070 msgr2=0x7f61d0063c60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:37.102 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.091+0000 7f61d6f97700 1 -- 172.21.15.22:0/3407739783 shutdown_connections 2022-04-28T14:41:37.102 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.091+0000 7f61d6f97700 1 -- 172.21.15.22:0/3407739783 wait complete. 2022-04-28T14:41:37.102 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.092+0000 7f61d6f97700 1 Processor -- start 2022-04-28T14:41:37.103 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.092+0000 7f61d6f97700 1 -- start start 2022-04-28T14:41:37.103 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.092+0000 7f61d6f97700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f61d0064530 0x7f61d0137870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:37.103 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.092+0000 7f61d6f97700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f61d00681c0 0x7f61d00a2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:37.103 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.092+0000 7f61d6f97700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d013b850 0x7f61d00a0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:37.103 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.092+0000 7f61d6f97700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d00a1bb0 con 0x7f61d013b850 2022-04-28T14:41:37.103 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.092+0000 7f61d6f97700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d00a18f0 con 0x7f61d0064530 2022-04-28T14:41:37.103 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.092+0000 7f61d6f97700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61d009f3e0 con 0x7f61d00681c0 2022-04-28T14:41:37.103 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.093+0000 7f61cffff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f61d00681c0 0x7f61d00a2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:37.103 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.093+0000 7f61d5534700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d013b850 0x7f61d00a0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:37.104 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.093+0000 7f61cffff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f61d00681c0 0x7f61d00a2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48080/0 (socket says 172.21.15.22:48080) 2022-04-28T14:41:37.104 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.093+0000 7f61d5534700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d013b850 0x7f61d00a0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50732/0 (socket says 172.21.15.22:50732) 2022-04-28T14:41:37.104 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.093+0000 7f61cffff700 1 -- 172.21.15.22:0/2746812760 learned_addr learned my addr 172.21.15.22:0/2746812760 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:37.104 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.093+0000 7f61d4d33700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f61d0064530 0x7f61d0137870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:37.104 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.093+0000 7f61d5534700 1 -- 172.21.15.22:0/2746812760 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f61d00681c0 msgr2=0x7f61d00a2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:37.104 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.093+0000 7f61d5534700 1 --2- 172.21.15.22:0/2746812760 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f61d00681c0 0x7f61d00a2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:37.104 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.093+0000 7f61d5534700 1 -- 172.21.15.22:0/2746812760 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f61d0064530 msgr2=0x7f61d0137870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:37.104 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.093+0000 7f61d5534700 1 --2- 172.21.15.22:0/2746812760 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f61d0064530 0x7f61d0137870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:37.104 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.093+0000 7f61d5534700 1 -- 172.21.15.22:0/2746812760 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61bc0092a0 con 0x7f61d013b850 2022-04-28T14:41:37.104 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.093+0000 7f61d5534700 1 --2- 172.21.15.22:0/2746812760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d013b850 0x7f61d00a0f20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f61c8014000 tx=0x7f61d00a2680).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:37.105 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.093+0000 7f61ccff9700 1 -- 172.21.15.22:0/2746812760 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c801d630 con 0x7f61d013b850 2022-04-28T14:41:37.105 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.093+0000 7f61ccff9700 1 -- 172.21.15.22:0/2746812760 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c801d790 con 0x7f61d013b850 2022-04-28T14:41:37.105 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.093+0000 7f61d6f97700 1 -- 172.21.15.22:0/2746812760 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c8009a20 con 0x7f61d013b850 2022-04-28T14:41:37.105 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.093+0000 7f61ccff9700 1 -- 172.21.15.22:0/2746812760 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c801db30 con 0x7f61d013b850 2022-04-28T14:41:37.105 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.093+0000 7f61d6f97700 1 -- 172.21.15.22:0/2746812760 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d00a0270 con 0x7f61d013b850 2022-04-28T14:41:37.105 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.094+0000 7f61ccff9700 1 -- 172.21.15.22:0/2746812760 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f61c8027460 con 0x7f61d013b850 2022-04-28T14:41:37.105 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.094+0000 7f61d6f97700 1 -- 172.21.15.22:0/2746812760 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d00a0400 con 0x7f61d013b850 2022-04-28T14:41:37.105 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.094+0000 7f61ccff9700 1 -- 172.21.15.22:0/2746812760 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f61c8057620 con 0x7f61d013b850 2022-04-28T14:41:37.106 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.098+0000 7f61ccff9700 1 -- 172.21.15.22:0/2746812760 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f61d00a0400 con 0x7f61d013b850 2022-04-28T14:41:37.253 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.248+0000 7f61d6f97700 1 -- 172.21.15.22:0/2746812760 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd down", "ids": ["2"]} v 0) v1 -- 0x7f61d00a0400 con 0x7f61d013b850 2022-04-28T14:41:37.253 INFO:tasks.ceph.mon.a.smithi022.stderr:2022-04-28T14:41:37.248+0000 7f9bed53e700 -1 mon.a@0(leader).osd e23 definitely_dead 0 2022-04-28T14:41:37.487 INFO:tasks.ceph.osd.1.smithi022.stderr:2022-04-28T14:41:37.483+0000 7f75c7c35200 -1 Falling back to public interface 2022-04-28T14:41:37.878 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.873+0000 7f61ccff9700 1 -- 172.21.15.22:0/2746812760 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["2"]}]=0 marked down osd.2. v24) v1 ==== 89+0+0 (secure 0 0 0) 0x7f61d00a0400 con 0x7f61d013b850 2022-04-28T14:41:37.881 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.876+0000 7f61d6f97700 1 -- 172.21.15.22:0/2746812760 >> v1:172.21.15.22:6808/92758 conn(0x7f61b8041b00 legacy=0x7f61b8043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:37.881 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.876+0000 7f61d6f97700 1 -- 172.21.15.22:0/2746812760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d013b850 msgr2=0x7f61d00a0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:37.881 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.876+0000 7f61d6f97700 1 --2- 172.21.15.22:0/2746812760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d013b850 0x7f61d00a0f20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f61c8014000 tx=0x7f61d00a2680).stop 2022-04-28T14:41:37.883 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.877+0000 7f61d6f97700 1 -- 172.21.15.22:0/2746812760 shutdown_connections 2022-04-28T14:41:37.883 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.877+0000 7f61d6f97700 1 --2- 172.21.15.22:0/2746812760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61d013b850 0x7f61d00a0f20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:37.883 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.877+0000 7f61d6f97700 1 --2- 172.21.15.22:0/2746812760 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f61d0064530 0x7f61d0137870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:37.883 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.877+0000 7f61d6f97700 1 --2- 172.21.15.22:0/2746812760 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f61d00681c0 0x7f61d00a2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:37.883 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.877+0000 7f61d6f97700 1 -- 172.21.15.22:0/2746812760 >> 172.21.15.22:0/2746812760 conn(0x7f61d0067070 msgr2=0x7f61d0138890 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:37.883 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.878+0000 7f61d6f97700 1 -- 172.21.15.22:0/2746812760 shutdown_connections 2022-04-28T14:41:37.883 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:37.878+0000 7f61d6f97700 1 -- 172.21.15.22:0/2746812760 wait complete. 2022-04-28T14:41:37.884 INFO:teuthology.orchestra.run.smithi022.stderr:marked down osd.2. 2022-04-28T14:41:37.900 INFO:tasks.ceph.osd.2:Restarting daemon 2022-04-28T14:41:37.900 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2022-04-28T14:41:37.902 INFO:tasks.ceph.osd.2:Started 2022-04-28T14:41:37.903 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2022-04-28T14:41:37.903 INFO:teuthology.orchestra.run:waiting for 300 2022-04-28T14:41:37.941 INFO:tasks.ceph.osd.3:Stopped 2022-04-28T14:41:37.942 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 3 2022-04-28T14:41:38.102 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.097+0000 7fbe58ef0700 1 Processor -- start 2022-04-28T14:41:38.102 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.097+0000 7fbe58ef0700 1 -- start start 2022-04-28T14:41:38.105 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.098+0000 7fbe58ef0700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fbe540a5450 0x7fbe54067010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:38.105 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.098+0000 7fbe58ef0700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbe54140b80 0x7fbe54142f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:38.105 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.098+0000 7fbe58ef0700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe540a5cd0 con 0x7fbe54135740 2022-04-28T14:41:38.105 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.098+0000 7fbe58ef0700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe540a5830 con 0x7fbe54140b80 2022-04-28T14:41:38.105 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.098+0000 7fbe58ef0700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5413c350 con 0x7fbe540a5450 2022-04-28T14:41:38.106 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.098+0000 7fbe52d9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbe54140b80 0x7fbe54142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:38.106 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.098+0000 7fbe5259c700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fbe540a5450 0x7fbe54067010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:38.106 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.098+0000 7fbe5259c700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fbe540a5450 0x7fbe54067010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48334/0 (socket says 172.21.15.22:48334) 2022-04-28T14:41:38.106 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.098+0000 7fbe5259c700 1 -- 172.21.15.22:0/1472489154 learned_addr learned my addr 172.21.15.22:0/1472489154 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:38.106 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.098+0000 7fbe52d9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbe54140b80 0x7fbe54142f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50770/0 (socket says 172.21.15.22:50770) 2022-04-28T14:41:38.106 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.098+0000 7fbe51d9b700 1 --1- 172.21.15.22:0/1472489154 >> v1:172.21.15.22:6789/0 conn(0x7fbe54135740 0x7fbe5413b980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40162/0 (socket says 172.21.15.22:40162) 2022-04-28T14:41:38.106 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.098+0000 7fbe5259c700 1 -- 172.21.15.22:0/1472489154 >> v2:172.21.15.22:3300/0 conn(0x7fbe54140b80 msgr2=0x7fbe54142f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:38.106 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.098+0000 7fbe5259c700 1 --2- 172.21.15.22:0/1472489154 >> v2:172.21.15.22:3300/0 conn(0x7fbe54140b80 0x7fbe54142f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:38.106 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.098+0000 7fbe5259c700 1 -- 172.21.15.22:0/1472489154 >> v1:172.21.15.22:6789/0 conn(0x7fbe54135740 legacy=0x7fbe5413b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:38.106 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.098+0000 7fbe5259c700 1 -- 172.21.15.22:0/1472489154 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5413c5f0 con 0x7fbe540a5450 2022-04-28T14:41:38.107 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.098+0000 7fbe52d9d700 1 --2- 172.21.15.22:0/1472489154 >> v2:172.21.15.22:3300/0 conn(0x7fbe54140b80 0x7fbe54142f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:38.107 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.098+0000 7fbe5259c700 1 --2- 172.21.15.22:0/1472489154 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fbe540a5450 0x7fbe54067010 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fbe48006fd0 tx=0x7fbe480090f0).ready entity=mon.1 client_cookie=1ef09d0e11ec3315 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:38.107 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.099+0000 7fbe5159a700 1 -- 172.21.15.22:0/1472489154 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4800b580 con 0x7fbe540a5450 2022-04-28T14:41:38.107 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.099+0000 7fbe5159a700 1 -- 172.21.15.22:0/1472489154 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4800b6e0 con 0x7fbe540a5450 2022-04-28T14:41:38.107 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.099+0000 7fbe5159a700 1 -- 172.21.15.22:0/1472489154 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4800ba60 con 0x7fbe540a5450 2022-04-28T14:41:38.107 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.099+0000 7fbe58ef0700 1 -- 172.21.15.22:0/1472489154 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fbe540a5450 msgr2=0x7fbe54067010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:38.107 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.099+0000 7fbe58ef0700 1 --2- 172.21.15.22:0/1472489154 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fbe540a5450 0x7fbe54067010 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fbe48006fd0 tx=0x7fbe480090f0).stop 2022-04-28T14:41:38.107 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.099+0000 7fbe58ef0700 1 -- 172.21.15.22:0/1472489154 shutdown_connections 2022-04-28T14:41:38.107 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.099+0000 7fbe58ef0700 1 --2- 172.21.15.22:0/1472489154 >> v2:172.21.15.22:3300/0 conn(0x7fbe54140b80 0x7fbe54142f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:38.108 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.099+0000 7fbe58ef0700 1 --2- 172.21.15.22:0/1472489154 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fbe540a5450 0x7fbe54067010 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:38.108 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.099+0000 7fbe58ef0700 1 -- 172.21.15.22:0/1472489154 >> 172.21.15.22:0/1472489154 conn(0x7fbe54069860 msgr2=0x7fbe54069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:38.108 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.099+0000 7fbe58ef0700 1 -- 172.21.15.22:0/1472489154 shutdown_connections 2022-04-28T14:41:38.108 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.099+0000 7fbe58ef0700 1 -- 172.21.15.22:0/1472489154 wait complete. 2022-04-28T14:41:38.108 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.100+0000 7fbe58ef0700 1 Processor -- start 2022-04-28T14:41:38.108 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.101+0000 7fbe58ef0700 1 -- start start 2022-04-28T14:41:38.110 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.101+0000 7fbe58ef0700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fbe540a5450 0x7fbe54138680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:38.111 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.101+0000 7fbe58ef0700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe54135740 0x7fbe5414bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:38.111 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.101+0000 7fbe58ef0700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fbe54140b80 0x7fbe54136cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:38.111 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.101+0000 7fbe58ef0700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5413ea80 con 0x7fbe54135740 2022-04-28T14:41:38.111 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.101+0000 7fbe58ef0700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe54137d30 con 0x7fbe54140b80 2022-04-28T14:41:38.111 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.101+0000 7fbe58ef0700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe541365e0 con 0x7fbe540a5450 2022-04-28T14:41:38.111 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.101+0000 7fbe5259c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fbe540a5450 0x7fbe54138680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:38.111 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.101+0000 7fbe5259c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fbe540a5450 0x7fbe54138680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48124/0 (socket says 172.21.15.22:48124) 2022-04-28T14:41:38.111 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.101+0000 7fbe52d9d700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fbe54140b80 0x7fbe54136cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:38.111 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.101+0000 7fbe5259c700 1 -- 172.21.15.22:0/2845852537 learned_addr learned my addr 172.21.15.22:0/2845852537 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:38.112 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.102+0000 7fbe51d9b700 1 --2- 172.21.15.22:0/2845852537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe54135740 0x7fbe5414bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:38.112 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.102+0000 7fbe5259c700 1 -- 172.21.15.22:0/2845852537 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fbe54140b80 msgr2=0x7fbe54136cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:38.112 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.102+0000 7fbe5259c700 1 --2- 172.21.15.22:0/2845852537 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fbe54140b80 0x7fbe54136cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:38.112 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.102+0000 7fbe5259c700 1 -- 172.21.15.22:0/2845852537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe54135740 msgr2=0x7fbe5414bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:38.112 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.102+0000 7fbe5259c700 1 --2- 172.21.15.22:0/2845852537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe54135740 0x7fbe5414bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:38.112 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.102+0000 7fbe5259c700 1 -- 172.21.15.22:0/2845852537 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4c009a20 con 0x7fbe540a5450 2022-04-28T14:41:38.112 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.102+0000 7fbe52d9d700 1 --2- 172.21.15.22:0/2845852537 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fbe54140b80 0x7fbe54136cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:38.112 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.102+0000 7fbe5259c700 1 --2- 172.21.15.22:0/2845852537 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fbe540a5450 0x7fbe54138680 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fbe48009fd0 tx=0x7fbe48017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:38.112 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.102+0000 7fbe427fc700 1 -- 172.21.15.22:0/2845852537 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe48000bc0 con 0x7fbe540a5450 2022-04-28T14:41:38.112 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.102+0000 7fbe427fc700 1 -- 172.21.15.22:0/2845852537 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4800b850 con 0x7fbe540a5450 2022-04-28T14:41:38.113 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.102+0000 7fbe58ef0700 1 -- 172.21.15.22:0/2845852537 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe48009370 con 0x7fbe540a5450 2022-04-28T14:41:38.113 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.102+0000 7fbe427fc700 1 -- 172.21.15.22:0/2845852537 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe48000d20 con 0x7fbe540a5450 2022-04-28T14:41:38.113 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.102+0000 7fbe58ef0700 1 -- 172.21.15.22:0/2845852537 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe540a9cd0 con 0x7fbe540a5450 2022-04-28T14:41:38.113 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.103+0000 7fbe427fc700 1 -- 172.21.15.22:0/2845852537 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7fbe4802c070 con 0x7fbe540a5450 2022-04-28T14:41:38.113 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.103+0000 7fbe58ef0700 1 -- 172.21.15.22:0/2845852537 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe5414bbf0 con 0x7fbe540a5450 2022-04-28T14:41:38.113 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.103+0000 7fbe427fc700 1 -- 172.21.15.22:0/2845852537 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 3702+0+0 (secure 0 0 0) 0x7fbe48057220 con 0x7fbe540a5450 2022-04-28T14:41:38.113 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.107+0000 7fbe427fc700 1 -- 172.21.15.22:0/2845852537 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7fbe4800b9c0 con 0x7fbe540a5450 2022-04-28T14:41:38.261 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.256+0000 7fbe58ef0700 1 -- 172.21.15.22:0/2845852537 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "osd down", "ids": ["3"]} v 0) v1 -- 0x7fbe5409f510 con 0x7fbe540a5450 2022-04-28T14:41:38.261 INFO:tasks.ceph.mon.a.smithi022.stderr:2022-04-28T14:41:38.257+0000 7f9bed53e700 -1 mon.a@0(leader).osd e24 definitely_dead 0 2022-04-28T14:41:38.500 INFO:tasks.ceph.osd.2.smithi022.stderr:2022-04-28T14:41:38.495+0000 7fb5d9fa4200 -1 Falling back to public interface 2022-04-28T14:41:38.883 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.878+0000 7fbe427fc700 1 -- 172.21.15.22:0/2845852537 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["3"]}]=0 marked down osd.3. v25) v1 ==== 89+0+0 (secure 0 0 0) 0x7fbe48020020 con 0x7fbe540a5450 2022-04-28T14:41:38.885 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.880+0000 7fbe58ef0700 1 -- 172.21.15.22:0/2845852537 >> v1:172.21.15.22:6808/92758 conn(0x7fbe30041b00 legacy=0x7fbe30043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:38.886 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.880+0000 7fbe58ef0700 1 -- 172.21.15.22:0/2845852537 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fbe540a5450 msgr2=0x7fbe54138680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:38.886 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.880+0000 7fbe58ef0700 1 --2- 172.21.15.22:0/2845852537 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fbe540a5450 0x7fbe54138680 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fbe48009fd0 tx=0x7fbe48017000).stop 2022-04-28T14:41:38.886 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.880+0000 7fbe58ef0700 1 -- 172.21.15.22:0/2845852537 shutdown_connections 2022-04-28T14:41:38.886 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.880+0000 7fbe58ef0700 1 --2- 172.21.15.22:0/2845852537 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fbe54140b80 0x7fbe54136cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:38.886 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.880+0000 7fbe58ef0700 1 --2- 172.21.15.22:0/2845852537 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fbe540a5450 0x7fbe54138680 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:38.886 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.880+0000 7fbe58ef0700 1 --2- 172.21.15.22:0/2845852537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe54135740 0x7fbe5414bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:38.886 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.880+0000 7fbe58ef0700 1 -- 172.21.15.22:0/2845852537 >> 172.21.15.22:0/2845852537 conn(0x7fbe54069860 msgr2=0x7fbe54066b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:38.886 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.881+0000 7fbe58ef0700 1 -- 172.21.15.22:0/2845852537 shutdown_connections 2022-04-28T14:41:38.887 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:38.881+0000 7fbe58ef0700 1 -- 172.21.15.22:0/2845852537 wait complete. 2022-04-28T14:41:38.887 INFO:teuthology.orchestra.run.smithi022.stderr:marked down osd.3. 2022-04-28T14:41:38.900 INFO:tasks.ceph.osd.3:Restarting daemon 2022-04-28T14:41:38.900 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2022-04-28T14:41:38.902 INFO:tasks.ceph.osd.3:Started 2022-04-28T14:41:38.902 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2022-04-28T14:41:38.902 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-28T14:41:39.028 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.023+0000 7f9df7dd1700 1 Processor -- start 2022-04-28T14:41:39.028 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.023+0000 7f9df7dd1700 1 -- start start 2022-04-28T14:41:39.033 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.024+0000 7f9df7dd1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9df00a5450 0x7f9df0067010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:39.033 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.024+0000 7f9df7dd1700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9df0135740 0x7f9df013b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:39.033 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.024+0000 7f9df7dd1700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9df00a5cd0 con 0x7f9df013be70 2022-04-28T14:41:39.033 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.024+0000 7f9df7dd1700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df00a5830 con 0x7f9df00a5450 2022-04-28T14:41:39.033 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.024+0000 7f9df7dd1700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9df013c350 con 0x7f9df0135740 2022-04-28T14:41:39.034 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.024+0000 7f9df5b6d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9df00a5450 0x7f9df0067010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:39.034 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.024+0000 7f9df636e700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9df013be70 0x7f9df01381e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40204/0 (socket says 172.21.15.22:40204) 2022-04-28T14:41:39.034 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.024+0000 7f9df636e700 1 -- 172.21.15.22:0/3429923958 learned_addr learned my addr 172.21.15.22:0/3429923958 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:41:39.034 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.024+0000 7f9df536c700 1 --2- 172.21.15.22:0/3429923958 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9df0135740 0x7f9df013b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:39.034 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.024+0000 7f9df5b6d700 1 -- 172.21.15.22:0/3429923958 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9df0135740 msgr2=0x7f9df013b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:39.034 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.024+0000 7f9df5b6d700 1 --2- 172.21.15.22:0/3429923958 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9df0135740 0x7f9df013b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:39.034 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.024+0000 7f9df5b6d700 1 -- 172.21.15.22:0/3429923958 >> v1:172.21.15.22:6789/0 conn(0x7f9df013be70 legacy=0x7f9df01381e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:39.034 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.024+0000 7f9df4b6b700 1 -- 172.21.15.22:0/3429923958 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2301648532 0 0) 0x7f9df00a5cd0 con 0x7f9df013be70 2022-04-28T14:41:39.034 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.024+0000 7f9df5b6d700 1 -- 172.21.15.22:0/3429923958 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df013c5f0 con 0x7f9df00a5450 2022-04-28T14:41:39.035 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.024+0000 7f9df5b6d700 1 --2- 172.21.15.22:0/3429923958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df00a5450 0x7f9df0067010 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f9de8009e60 tx=0x7f9de8009780).ready entity=mon.0 client_cookie=3f7c4ecb7641adbe server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:39.035 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.024+0000 7f9df4b6b700 1 -- 172.21.15.22:0/3429923958 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de800e070 con 0x7f9df00a5450 2022-04-28T14:41:39.035 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.025+0000 7f9df4b6b700 1 -- 172.21.15.22:0/3429923958 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de800bb60 con 0x7f9df00a5450 2022-04-28T14:41:39.035 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.025+0000 7f9df4b6b700 1 -- 172.21.15.22:0/3429923958 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de8012410 con 0x7f9df00a5450 2022-04-28T14:41:39.035 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.025+0000 7f9df7dd1700 1 -- 172.21.15.22:0/3429923958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df00a5450 msgr2=0x7f9df0067010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:39.035 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.025+0000 7f9df7dd1700 1 --2- 172.21.15.22:0/3429923958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df00a5450 0x7f9df0067010 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f9de8009e60 tx=0x7f9de8009780).stop 2022-04-28T14:41:39.035 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.025+0000 7f9df7dd1700 1 -- 172.21.15.22:0/3429923958 shutdown_connections 2022-04-28T14:41:39.035 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.025+0000 7f9df7dd1700 1 --2- 172.21.15.22:0/3429923958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df00a5450 0x7f9df0067010 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:39.035 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.025+0000 7f9df7dd1700 1 --2- 172.21.15.22:0/3429923958 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9df0135740 0x7f9df013b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:39.036 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.025+0000 7f9df7dd1700 1 -- 172.21.15.22:0/3429923958 >> 172.21.15.22:0/3429923958 conn(0x7f9df0069860 msgr2=0x7f9df0069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:39.036 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.025+0000 7f9df7dd1700 1 -- 172.21.15.22:0/3429923958 shutdown_connections 2022-04-28T14:41:39.036 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.025+0000 7f9df7dd1700 1 -- 172.21.15.22:0/3429923958 wait complete. 2022-04-28T14:41:39.036 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.026+0000 7f9df7dd1700 1 Processor -- start 2022-04-28T14:41:39.036 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.026+0000 7f9df7dd1700 1 -- start start 2022-04-28T14:41:39.036 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.027+0000 7f9df7dd1700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9df00a5450 0x7f9df01173a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:39.036 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.027+0000 7f9df7dd1700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9df0135740 0x7f9df0148540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:39.036 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.027+0000 7f9df7dd1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df013be70 0x7f9df0115320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:39.036 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.027+0000 7f9df7dd1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df0148f10 con 0x7f9df013be70 2022-04-28T14:41:39.037 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.027+0000 7f9df7dd1700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df0116ac0 con 0x7f9df00a5450 2022-04-28T14:41:39.037 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.027+0000 7f9df7dd1700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9df0116cc0 con 0x7f9df0135740 2022-04-28T14:41:39.037 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.027+0000 7f9df536c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9df0135740 0x7f9df0148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:39.037 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.027+0000 7f9df636e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df013be70 0x7f9df0115320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:39.037 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.027+0000 7f9df5b6d700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9df00a5450 0x7f9df01173a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:39.037 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.027+0000 7f9df536c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9df0135740 0x7f9df0148540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48164/0 (socket says 172.21.15.22:48164) 2022-04-28T14:41:39.037 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.027+0000 7f9df536c700 1 -- 172.21.15.22:0/787336933 learned_addr learned my addr 172.21.15.22:0/787336933 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:39.037 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.027+0000 7f9df5b6d700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9df00a5450 0x7f9df01173a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48378/0 (socket says 172.21.15.22:48378) 2022-04-28T14:41:39.037 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.027+0000 7f9df536c700 1 -- 172.21.15.22:0/787336933 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9df00a5450 msgr2=0x7f9df01173a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:39.037 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.027+0000 7f9df536c700 1 --2- 172.21.15.22:0/787336933 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9df00a5450 0x7f9df01173a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.027+0000 7f9df536c700 1 -- 172.21.15.22:0/787336933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df013be70 msgr2=0x7f9df0115320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.027+0000 7f9df536c700 1 --2- 172.21.15.22:0/787336933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df013be70 0x7f9df0115320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.027+0000 7f9df536c700 1 -- 172.21.15.22:0/787336933 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de8009a20 con 0x7f9df0135740 2022-04-28T14:41:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.027+0000 7f9df536c700 1 --2- 172.21.15.22:0/787336933 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9df0135740 0x7f9df0148540 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f9de000e980 tx=0x7f9de0009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.027+0000 7f9dddffb700 1 -- 172.21.15.22:0/787336933 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de0012600 con 0x7f9df0135740 2022-04-28T14:41:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.027+0000 7f9dddffb700 1 -- 172.21.15.22:0/787336933 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de0012760 con 0x7f9df0135740 2022-04-28T14:41:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.027+0000 7f9df7dd1700 1 -- 172.21.15.22:0/787336933 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df0114ed0 con 0x7f9df0135740 2022-04-28T14:41:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.027+0000 7f9dddffb700 1 -- 172.21.15.22:0/787336933 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de0012ae0 con 0x7f9df0135740 2022-04-28T14:41:39.038 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.028+0000 7f9df7dd1700 1 -- 172.21.15.22:0/787336933 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df0147f60 con 0x7f9df0135740 2022-04-28T14:41:39.039 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.028+0000 7f9dddffb700 1 -- 172.21.15.22:0/787336933 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f9de0022070 con 0x7f9df0135740 2022-04-28T14:41:39.039 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.028+0000 7f9df7dd1700 1 -- 172.21.15.22:0/787336933 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df009f510 con 0x7f9df0135740 2022-04-28T14:41:39.039 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.029+0000 7f9dddffb700 1 -- 172.21.15.22:0/787336933 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f9de0055780 con 0x7f9df0135740 2022-04-28T14:41:39.039 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.032+0000 7f9dddffb700 1 -- 172.21.15.22:0/787336933 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f9de0036360 con 0x7f9df0135740 2022-04-28T14:41:39.180 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.176+0000 7f9df7dd1700 1 -- 172.21.15.22:0/787336933 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9df0065a60 con 0x7f9df0135740 2022-04-28T14:41:39.181 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.177+0000 7f9dddffb700 1 -- 172.21.15.22:0/787336933 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+11278 (secure 0 0 0) 0x7f9de0016070 con 0x7f9df0135740 2022-04-28T14:41:39.181 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:41:39.182 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":25,"fsid":"3047163a-0285-4058-8e05-ce74c6fbb9c5","created":"2022-04-28T14:38:54.232890+0000","modified":"2022-04-28T14:41:38.872482+0000","last_up_change":"2022-04-28T14:41:38.872482+0000","last_in_change":"2022-04-28T14:39:00.269721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-04-28T14:39:03.639717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-04-28T14:39:12.000229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-04-28T14:39:12.915097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"device_health_metrics","create_time":"2022-04-28T14:41:25.197740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"782ee638-1ada-48d9-9454-f9e0ca8a3135","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":14,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6800","nonce":87556}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":87556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":87556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":87556}]},"public_addr":"172.21.15.22:6800/87556","cluster_addr":"172.21.15.22:6801/87556","heartbeat_back_addr":"172.21.15.22:6803/87556","heartbeat_front_addr":"172.21.15.22:6802/87556","state":["exists"]},{"osd":1,"uuid":"61ca6f96-fb4f-4c0f-b68b-edf1e7011f1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":87557}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":87557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":87557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":87557}]},"public_addr":"172.21.15.22:6804/87557","cluster_addr":"172.21.15.22:6805/87557","heartbeat_back_addr":"172.21.15.22:6807/87557","heartbeat_front_addr":"172.21.15.22:6806/87557","state":["exists"]},{"osd":2,"uuid":"4b3043b9-50df-4b7f-a55a-ac8e6148c449","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":87558}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":87558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":87558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":87558}]},"public_addr":"172.21.15.22:6813/87558","cluster_addr":"172.21.15.22:6814/87558","heartbeat_back_addr":"172.21.15.22:6816/87558","heartbeat_front_addr":"172.21.15.22:6815/87558","state":["exists"]},{"osd":3,"uuid":"7807bcd1-53f8-44b5-9992-57c328e5b299","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":87561}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":87561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":87561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":87561}]},"public_addr":"172.21.15.22:6809/87561","cluster_addr":"172.21.15.22:6810/87561","heartbeat_back_addr":"172.21.15.22:6812/87561","heartbeat_front_addr":"172.21.15.22:6811/87561","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"2022-04-28T14:41:38.872482+0000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:6808/86956":"2022-04-29T14:41:24.302858+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-04-28T14:41:39.183 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.178+0000 7f9df7dd1700 1 -- 172.21.15.22:0/787336933 >> v1:172.21.15.22:6808/92758 conn(0x7f9dd0041b00 legacy=0x7f9dd0043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:39.183 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.178+0000 7f9df7dd1700 1 -- 172.21.15.22:0/787336933 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9df0135740 msgr2=0x7f9df0148540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:39.183 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.178+0000 7f9df7dd1700 1 --2- 172.21.15.22:0/787336933 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9df0135740 0x7f9df0148540 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f9de000e980 tx=0x7f9de0009060).stop 2022-04-28T14:41:39.184 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.178+0000 7f9df7dd1700 1 -- 172.21.15.22:0/787336933 shutdown_connections 2022-04-28T14:41:39.184 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.178+0000 7f9df7dd1700 1 --2- 172.21.15.22:0/787336933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9df013be70 0x7f9df0115320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:39.184 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.178+0000 7f9df7dd1700 1 --2- 172.21.15.22:0/787336933 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f9df00a5450 0x7f9df01173a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:39.184 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.178+0000 7f9df7dd1700 1 --2- 172.21.15.22:0/787336933 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9df0135740 0x7f9df0148540 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:39.184 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.178+0000 7f9df7dd1700 1 -- 172.21.15.22:0/787336933 >> 172.21.15.22:0/787336933 conn(0x7f9df0069860 msgr2=0x7f9df0069c40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:39.184 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.178+0000 7f9df7dd1700 1 -- 172.21.15.22:0/787336933 shutdown_connections 2022-04-28T14:41:39.184 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:39.178+0000 7f9df7dd1700 1 -- 172.21.15.22:0/787336933 wait complete. 2022-04-28T14:41:39.473 INFO:tasks.ceph.osd.0.smithi022.stderr:2022-04-28T14:41:39.468+0000 7ff496223200 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: store not yet converted to per-pg omap 2022-04-28T14:41:39.475 INFO:tasks.ceph.osd.0.smithi022.stderr:2022-04-28T14:41:39.470+0000 7ff496223200 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:0d82a743:::600.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:39.476 INFO:tasks.ceph.osd.0.smithi022.stderr:2022-04-28T14:41:39.470+0000 7ff496223200 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:0d89b25e:::603.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:39.476 INFO:tasks.ceph.osd.0.smithi022.stderr:2022-04-28T14:41:39.470+0000 7ff496223200 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:0f65c9b8:::60a.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:39.476 INFO:tasks.ceph.osd.0.smithi022.stderr:2022-04-28T14:41:39.470+0000 7ff496223200 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:2e2b5214:::610.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:39.476 INFO:tasks.ceph.osd.0.smithi022.stderr:2022-04-28T14:41:39.470+0000 7ff496223200 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:2f55791f:::606.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:39.476 INFO:tasks.ceph.osd.0.smithi022.stderr:2022-04-28T14:41:39.470+0000 7ff496223200 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:3ed09add:::607.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:39.476 INFO:tasks.ceph.osd.0.smithi022.stderr:2022-04-28T14:41:39.470+0000 7ff496223200 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:54ba6923:::mds1_openfiles.0:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:39.476 INFO:tasks.ceph.osd.0.smithi022.stderr:2022-04-28T14:41:39.470+0000 7ff496223200 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:654134d2:::mds0_openfiles.0:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:39.476 INFO:tasks.ceph.osd.0.smithi022.stderr:2022-04-28T14:41:39.470+0000 7ff496223200 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:92e99a1d:::612.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:39.476 INFO:tasks.ceph.osd.0.smithi022.stderr:2022-04-28T14:41:39.470+0000 7ff496223200 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:b871830b:::605.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:39.477 INFO:tasks.ceph.osd.0.smithi022.stderr:2022-04-28T14:41:39.470+0000 7ff496223200 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:ca4dd7f5:::611.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:39.477 INFO:tasks.ceph.osd.0.smithi022.stderr:2022-04-28T14:41:39.470+0000 7ff496223200 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:e0b41d06:::609.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:39.477 INFO:tasks.ceph.osd.0.smithi022.stderr:2022-04-28T14:41:39.470+0000 7ff496223200 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #2:ff5b34d6:::1.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:39.503 INFO:tasks.ceph.osd.3.smithi022.stderr:2022-04-28T14:41:39.498+0000 7f5e535a5200 -1 Falling back to public interface 2022-04-28T14:41:40.229 INFO:tasks.ceph.osd.0.smithi022.stderr:2022-04-28T14:41:40.224+0000 7ff496223200 -1 osd.0 21 log_to_monitors {default=true} 2022-04-28T14:41:40.261 INFO:tasks.ceph.osd.1.smithi022.stderr:2022-04-28T14:41:40.257+0000 7f75c7c35200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: store not yet converted to per-pg omap 2022-04-28T14:41:40.264 INFO:tasks.ceph.osd.1.smithi022.stderr:2022-04-28T14:41:40.259+0000 7f75c7c35200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:09401a81:::601.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:40.264 INFO:tasks.ceph.osd.1.smithi022.stderr:2022-04-28T14:41:40.259+0000 7f75c7c35200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:0bd6d154:::602.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:40.265 INFO:tasks.ceph.osd.1.smithi022.stderr:2022-04-28T14:41:40.259+0000 7f75c7c35200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:0d82a743:::600.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:40.265 INFO:tasks.ceph.osd.1.smithi022.stderr:2022-04-28T14:41:40.259+0000 7f75c7c35200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:0d89b25e:::603.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:40.265 INFO:tasks.ceph.osd.1.smithi022.stderr:2022-04-28T14:41:40.259+0000 7f75c7c35200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:0f65c9b8:::60a.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:40.265 INFO:tasks.ceph.osd.1.smithi022.stderr:2022-04-28T14:41:40.259+0000 7f75c7c35200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:1470b2f8:::613.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:40.265 INFO:tasks.ceph.osd.1.smithi022.stderr:2022-04-28T14:41:40.259+0000 7f75c7c35200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:3ed09add:::607.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:40.265 INFO:tasks.ceph.osd.1.smithi022.stderr:2022-04-28T14:41:40.259+0000 7f75c7c35200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:54ba6923:::mds1_openfiles.0:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:40.265 INFO:tasks.ceph.osd.1.smithi022.stderr:2022-04-28T14:41:40.259+0000 7f75c7c35200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:6f2c300e:::60f.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:40.265 INFO:tasks.ceph.osd.1.smithi022.stderr:2022-04-28T14:41:40.259+0000 7f75c7c35200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:92e99a1d:::612.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:40.265 INFO:tasks.ceph.osd.1.smithi022.stderr:2022-04-28T14:41:40.259+0000 7f75c7c35200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:a93a17c2:::604.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:40.266 INFO:tasks.ceph.osd.1.smithi022.stderr:2022-04-28T14:41:40.259+0000 7f75c7c35200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:b871830b:::605.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:40.266 INFO:tasks.ceph.osd.1.smithi022.stderr:2022-04-28T14:41:40.259+0000 7f75c7c35200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:cd5a64a3:::100.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:40.266 INFO:tasks.ceph.osd.1.smithi022.stderr:2022-04-28T14:41:40.259+0000 7f75c7c35200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:e455cf45:::60b.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:40.266 INFO:tasks.ceph.osd.1.smithi022.stderr:2022-04-28T14:41:40.259+0000 7f75c7c35200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:e8b9846e:::60d.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:40.266 INFO:tasks.ceph.osd.1.smithi022.stderr:2022-04-28T14:41:40.259+0000 7f75c7c35200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #2:ff5b34d6:::1.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:40.266 INFO:tasks.ceph.osd.1.smithi022.stderr:2022-04-28T14:41:40.259+0000 7f75c7c35200 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #4:2241aba4:::INTEL_SSDPED1D480GA_PHMB747402EC480DGN:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:40.922 INFO:tasks.ceph.osd.0.smithi022.stderr:2022-04-28T14:41:40.917+0000 7ff489356700 -1 osd.0 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-04-28T14:41:40.991 INFO:tasks.ceph.osd.1.smithi022.stderr:2022-04-28T14:41:40.987+0000 7f75c7c35200 -1 osd.1 22 log_to_monitors {default=true} 2022-04-28T14:41:41.267 INFO:tasks.ceph.osd.2.smithi022.stderr:2022-04-28T14:41:41.262+0000 7fb5d9fa4200 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: store not yet converted to per-pg omap 2022-04-28T14:41:41.269 INFO:tasks.ceph.osd.2.smithi022.stderr:2022-04-28T14:41:41.264+0000 7fb5d9fa4200 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:09401a81:::601.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:41.269 INFO:tasks.ceph.osd.2.smithi022.stderr:2022-04-28T14:41:41.264+0000 7fb5d9fa4200 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:0bd6d154:::602.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:41.269 INFO:tasks.ceph.osd.2.smithi022.stderr:2022-04-28T14:41:41.264+0000 7fb5d9fa4200 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:48cd7578:::60e.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:41.269 INFO:tasks.ceph.osd.2.smithi022.stderr:2022-04-28T14:41:41.264+0000 7fb5d9fa4200 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:717a0223:::608.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:41.269 INFO:tasks.ceph.osd.2.smithi022.stderr:2022-04-28T14:41:41.264+0000 7fb5d9fa4200 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:c112adae:::101.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:41.269 INFO:tasks.ceph.osd.2.smithi022.stderr:2022-04-28T14:41:41.264+0000 7fb5d9fa4200 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:c27f454c:::mds1_sessionmap:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:41.269 INFO:tasks.ceph.osd.2.smithi022.stderr:2022-04-28T14:41:41.264+0000 7fb5d9fa4200 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:cd5a64a3:::100.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:41.270 INFO:tasks.ceph.osd.2.smithi022.stderr:2022-04-28T14:41:41.264+0000 7fb5d9fa4200 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:d0630e4c:::mds0_sessionmap:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:41.270 INFO:tasks.ceph.osd.2.smithi022.stderr:2022-04-28T14:41:41.264+0000 7fb5d9fa4200 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:d70a01c6:::60c.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:41.270 INFO:tasks.ceph.osd.2.smithi022.stderr:2022-04-28T14:41:41.264+0000 7fb5d9fa4200 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #2:e8b9846e:::60d.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:41.926 INFO:tasks.ceph.osd.1.smithi022.stderr:2022-04-28T14:41:41.921+0000 7f75bad68700 -1 osd.1 27 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-04-28T14:41:41.983 INFO:tasks.ceph.osd.2.smithi022.stderr:2022-04-28T14:41:41.978+0000 7fb5d9fa4200 -1 osd.2 23 log_to_monitors {default=true} 2022-04-28T14:41:42.195 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-28T14:41:42.242 INFO:tasks.ceph.osd.3.smithi022.stderr:2022-04-28T14:41:42.237+0000 7f5e535a5200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: store not yet converted to per-pg omap 2022-04-28T14:41:42.244 INFO:tasks.ceph.osd.3.smithi022.stderr:2022-04-28T14:41:42.239+0000 7f5e535a5200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:1470b2f8:::613.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:42.245 INFO:tasks.ceph.osd.3.smithi022.stderr:2022-04-28T14:41:42.239+0000 7f5e535a5200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:2e2b5214:::610.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:42.245 INFO:tasks.ceph.osd.3.smithi022.stderr:2022-04-28T14:41:42.239+0000 7f5e535a5200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:2f55791f:::606.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:42.245 INFO:tasks.ceph.osd.3.smithi022.stderr:2022-04-28T14:41:42.239+0000 7f5e535a5200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:48cd7578:::60e.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:42.245 INFO:tasks.ceph.osd.3.smithi022.stderr:2022-04-28T14:41:42.239+0000 7f5e535a5200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:654134d2:::mds0_openfiles.0:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:42.245 INFO:tasks.ceph.osd.3.smithi022.stderr:2022-04-28T14:41:42.239+0000 7f5e535a5200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:6f2c300e:::60f.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:42.245 INFO:tasks.ceph.osd.3.smithi022.stderr:2022-04-28T14:41:42.239+0000 7f5e535a5200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:717a0223:::608.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:42.245 INFO:tasks.ceph.osd.3.smithi022.stderr:2022-04-28T14:41:42.239+0000 7f5e535a5200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:a93a17c2:::604.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:42.245 INFO:tasks.ceph.osd.3.smithi022.stderr:2022-04-28T14:41:42.239+0000 7f5e535a5200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:c112adae:::101.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:42.245 INFO:tasks.ceph.osd.3.smithi022.stderr:2022-04-28T14:41:42.239+0000 7f5e535a5200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:c27f454c:::mds1_sessionmap:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:42.246 INFO:tasks.ceph.osd.3.smithi022.stderr:2022-04-28T14:41:42.239+0000 7f5e535a5200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:ca4dd7f5:::611.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:42.246 INFO:tasks.ceph.osd.3.smithi022.stderr:2022-04-28T14:41:42.239+0000 7f5e535a5200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:d0630e4c:::mds0_sessionmap:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:42.246 INFO:tasks.ceph.osd.3.smithi022.stderr:2022-04-28T14:41:42.239+0000 7f5e535a5200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:d70a01c6:::60c.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:42.246 INFO:tasks.ceph.osd.3.smithi022.stderr:2022-04-28T14:41:42.239+0000 7f5e535a5200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:e0b41d06:::609.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:42.246 INFO:tasks.ceph.osd.3.smithi022.stderr:2022-04-28T14:41:42.239+0000 7f5e535a5200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #2:e455cf45:::60b.00000000:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:42.246 INFO:tasks.ceph.osd.3.smithi022.stderr:2022-04-28T14:41:42.239+0000 7f5e535a5200 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #4:2241aba4:::INTEL_SSDPED1D480GA_PHMB747402EC480DGN:head# has omap that is not per-pool or pgmeta 2022-04-28T14:41:42.323 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.318+0000 7f3a543da700 1 Processor -- start 2022-04-28T14:41:42.323 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.318+0000 7f3a543da700 1 -- start start 2022-04-28T14:41:42.325 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.319+0000 7f3a543da700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3a4c068130 0x7f3a4c066c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:42.326 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.319+0000 7f3a543da700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3a4c068d00 0x7f3a4c061f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:42.326 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.319+0000 7f3a543da700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a4c067330 con 0x7f3a4c062420 2022-04-28T14:41:42.326 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.319+0000 7f3a543da700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a4c0aa710 con 0x7f3a4c068130 2022-04-28T14:41:42.326 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.319+0000 7f3a543da700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c0a5bc0 con 0x7f3a4c068d00 2022-04-28T14:41:42.326 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.319+0000 7f3a52176700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3a4c068130 0x7f3a4c066c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:42.326 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.319+0000 7f3a51975700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3a4c068d00 0x7f3a4c061f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:42.326 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.319+0000 7f3a52176700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3a4c068130 0x7f3a4c066c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50846/0 (socket says 172.21.15.22:50846) 2022-04-28T14:41:42.326 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.319+0000 7f3a51975700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3a4c068d00 0x7f3a4c061f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48200/0 (socket says 172.21.15.22:48200) 2022-04-28T14:41:42.327 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.319+0000 7f3a52977700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f3a4c062420 0x7f3a4c0628d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40246/0 (socket says 172.21.15.22:40246) 2022-04-28T14:41:42.327 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.319+0000 7f3a52176700 1 -- 172.21.15.22:0/2192056440 learned_addr learned my addr 172.21.15.22:0/2192056440 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:42.327 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.319+0000 7f3a51975700 1 -- 172.21.15.22:0/2192056440 >> v2:172.21.15.22:3300/0 conn(0x7f3a4c068130 msgr2=0x7f3a4c066c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:42.327 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.319+0000 7f3a51975700 1 --2- 172.21.15.22:0/2192056440 >> v2:172.21.15.22:3300/0 conn(0x7f3a4c068130 0x7f3a4c066c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:42.327 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.319+0000 7f3a51975700 1 -- 172.21.15.22:0/2192056440 >> v1:172.21.15.22:6789/0 conn(0x7f3a4c062420 legacy=0x7f3a4c0628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:42.327 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.319+0000 7f3a51975700 1 -- 172.21.15.22:0/2192056440 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4c0aa290 con 0x7f3a4c068d00 2022-04-28T14:41:42.327 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.319+0000 7f3a52176700 1 --2- 172.21.15.22:0/2192056440 >> v2:172.21.15.22:3300/0 conn(0x7f3a4c068130 0x7f3a4c066c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:42.327 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.319+0000 7f3a51975700 1 --2- 172.21.15.22:0/2192056440 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3a4c068d00 0x7f3a4c061f30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f3a3c009760 tx=0x7f3a3c009060).ready entity=mon.2 client_cookie=1735269ae81ed343 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:42.327 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.319+0000 7f3a51174700 1 -- 172.21.15.22:0/2192056440 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c00f510 con 0x7f3a4c068d00 2022-04-28T14:41:42.327 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.319+0000 7f3a51174700 1 -- 172.21.15.22:0/2192056440 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3c00f670 con 0x7f3a4c068d00 2022-04-28T14:41:42.328 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.319+0000 7f3a51174700 1 -- 172.21.15.22:0/2192056440 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c00f9f0 con 0x7f3a4c068d00 2022-04-28T14:41:42.328 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.320+0000 7f3a543da700 1 -- 172.21.15.22:0/2192056440 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3a4c068d00 msgr2=0x7f3a4c061f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:42.328 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.320+0000 7f3a543da700 1 --2- 172.21.15.22:0/2192056440 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3a4c068d00 0x7f3a4c061f30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f3a3c009760 tx=0x7f3a3c009060).stop 2022-04-28T14:41:42.328 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.320+0000 7f3a543da700 1 -- 172.21.15.22:0/2192056440 shutdown_connections 2022-04-28T14:41:42.328 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.320+0000 7f3a543da700 1 --2- 172.21.15.22:0/2192056440 >> v2:172.21.15.22:3300/0 conn(0x7f3a4c068130 0x7f3a4c066c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:42.328 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.320+0000 7f3a543da700 1 --2- 172.21.15.22:0/2192056440 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3a4c068d00 0x7f3a4c061f30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:42.328 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.320+0000 7f3a543da700 1 -- 172.21.15.22:0/2192056440 >> 172.21.15.22:0/2192056440 conn(0x7f3a4c0ae9d0 msgr2=0x7f3a4c0aede0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:42.328 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.320+0000 7f3a543da700 1 -- 172.21.15.22:0/2192056440 shutdown_connections 2022-04-28T14:41:42.328 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.320+0000 7f3a543da700 1 -- 172.21.15.22:0/2192056440 wait complete. 2022-04-28T14:41:42.328 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.321+0000 7f3a543da700 1 Processor -- start 2022-04-28T14:41:42.329 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.321+0000 7f3a543da700 1 -- start start 2022-04-28T14:41:42.331 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.322+0000 7f3a543da700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a4c062420 0x7f3a4c09a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:42.331 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.322+0000 7f3a543da700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3a4c068130 0x7f3a4c147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:42.332 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.322+0000 7f3a543da700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3a4c068d00 0x7f3a4c09b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:42.332 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.322+0000 7f3a543da700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c098580 con 0x7f3a4c062420 2022-04-28T14:41:42.332 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.322+0000 7f3a543da700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c1483d0 con 0x7f3a4c068130 2022-04-28T14:41:42.332 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.322+0000 7f3a543da700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c148690 con 0x7f3a4c068d00 2022-04-28T14:41:42.332 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.322+0000 7f3a52977700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3a4c068d00 0x7f3a4c09b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:42.332 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.322+0000 7f3a52977700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3a4c068d00 0x7f3a4c09b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48208/0 (socket says 172.21.15.22:48208) 2022-04-28T14:41:42.332 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.322+0000 7f3a52977700 1 -- 172.21.15.22:0/605198880 learned_addr learned my addr 172.21.15.22:0/605198880 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:42.332 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.322+0000 7f3a52176700 1 --2- 172.21.15.22:0/605198880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a4c062420 0x7f3a4c09a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:42.332 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.322+0000 7f3a51975700 1 --2- 172.21.15.22:0/605198880 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3a4c068130 0x7f3a4c147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:42.332 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.322+0000 7f3a52977700 1 -- 172.21.15.22:0/605198880 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3a4c068130 msgr2=0x7f3a4c147bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:42.333 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.322+0000 7f3a52977700 1 --2- 172.21.15.22:0/605198880 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3a4c068130 0x7f3a4c147bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:42.333 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.322+0000 7f3a52977700 1 -- 172.21.15.22:0/605198880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a4c062420 msgr2=0x7f3a4c09a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:42.333 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.322+0000 7f3a52977700 1 --2- 172.21.15.22:0/605198880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a4c062420 0x7f3a4c09a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:42.333 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.322+0000 7f3a52977700 1 -- 172.21.15.22:0/605198880 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a48009370 con 0x7f3a4c068d00 2022-04-28T14:41:42.333 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.322+0000 7f3a52977700 1 --2- 172.21.15.22:0/605198880 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3a4c068d00 0x7f3a4c09b2d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f3a4400c790 tx=0x7f3a440015e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:42.333 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.322+0000 7f3a3a7fc700 1 -- 172.21.15.22:0/605198880 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44005c70 con 0x7f3a4c068d00 2022-04-28T14:41:42.333 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.322+0000 7f3a3a7fc700 1 -- 172.21.15.22:0/605198880 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a44005dd0 con 0x7f3a4c068d00 2022-04-28T14:41:42.333 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.322+0000 7f3a543da700 1 -- 172.21.15.22:0/605198880 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a3c0092a0 con 0x7f3a4c068d00 2022-04-28T14:41:42.333 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.322+0000 7f3a3a7fc700 1 -- 172.21.15.22:0/605198880 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a44007320 con 0x7f3a4c068d00 2022-04-28T14:41:42.333 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.322+0000 7f3a543da700 1 -- 172.21.15.22:0/605198880 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a4c1480c0 con 0x7f3a4c068d00 2022-04-28T14:41:42.334 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.323+0000 7f3a3a7fc700 1 -- 172.21.15.22:0/605198880 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f3a44010030 con 0x7f3a4c068d00 2022-04-28T14:41:42.334 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.324+0000 7f3a543da700 1 -- 172.21.15.22:0/605198880 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a4c065a50 con 0x7f3a4c068d00 2022-04-28T14:41:42.334 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.324+0000 7f3a3a7fc700 1 -- 172.21.15.22:0/605198880 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 3702+0+0 (secure 0 0 0) 0x7f3a440551b0 con 0x7f3a4c068d00 2022-04-28T14:41:42.334 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.327+0000 7f3a3a7fc700 1 -- 172.21.15.22:0/605198880 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f3a440359c0 con 0x7f3a4c068d00 2022-04-28T14:41:42.471 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.466+0000 7f3a543da700 1 -- 172.21.15.22:0/605198880 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a4c046540 con 0x7f3a4c068d00 2022-04-28T14:41:42.472 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.467+0000 7f3a3a7fc700 1 -- 172.21.15.22:0/605198880 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+11285 (secure 0 0 0) 0x7f3a44038fe0 con 0x7f3a4c068d00 2022-04-28T14:41:42.472 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:41:42.472 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":27,"fsid":"3047163a-0285-4058-8e05-ce74c6fbb9c5","created":"2022-04-28T14:38:54.232890+0000","modified":"2022-04-28T14:41:41.882161+0000","last_up_change":"2022-04-28T14:41:41.882161+0000","last_in_change":"2022-04-28T14:39:00.269721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-04-28T14:39:03.639717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-04-28T14:39:12.000229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-04-28T14:39:12.915097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"device_health_metrics","create_time":"2022-04-28T14:41:25.197740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"782ee638-1ada-48d9-9454-f9e0ca8a3135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":21,"up_from":27,"up_thru":14,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6800","nonce":94303}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":94303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":94303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":94303}]},"public_addr":"172.21.15.22:6800/94303","cluster_addr":"172.21.15.22:6801/94303","heartbeat_back_addr":"172.21.15.22:6803/94303","heartbeat_front_addr":"172.21.15.22:6802/94303","state":["exists","up"]},{"osd":1,"uuid":"61ca6f96-fb4f-4c0f-b68b-edf1e7011f1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":22,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":87557}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":87557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":87557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":87557}]},"public_addr":"172.21.15.22:6804/87557","cluster_addr":"172.21.15.22:6805/87557","heartbeat_back_addr":"172.21.15.22:6807/87557","heartbeat_front_addr":"172.21.15.22:6806/87557","state":["exists"]},{"osd":2,"uuid":"4b3043b9-50df-4b7f-a55a-ac8e6148c449","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":87558}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":87558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":87558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":87558}]},"public_addr":"172.21.15.22:6813/87558","cluster_addr":"172.21.15.22:6814/87558","heartbeat_back_addr":"172.21.15.22:6816/87558","heartbeat_front_addr":"172.21.15.22:6815/87558","state":["exists"]},{"osd":3,"uuid":"7807bcd1-53f8-44b5-9992-57c328e5b299","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":87561}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":87561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":87561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":87561}]},"public_addr":"172.21.15.22:6809/87561","cluster_addr":"172.21.15.22:6810/87561","heartbeat_back_addr":"172.21.15.22:6812/87561","heartbeat_front_addr":"172.21.15.22:6811/87561","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"2022-04-28T14:41:38.872482+0000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:6808/86956":"2022-04-29T14:41:24.302858+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-04-28T14:41:42.473 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.468+0000 7f3a543da700 1 -- 172.21.15.22:0/605198880 >> v1:172.21.15.22:6808/92758 conn(0x7f3a2c041b30 legacy=0x7f3a2c043ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:42.474 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.468+0000 7f3a543da700 1 -- 172.21.15.22:0/605198880 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3a4c068d00 msgr2=0x7f3a4c09b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:42.474 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.468+0000 7f3a543da700 1 --2- 172.21.15.22:0/605198880 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3a4c068d00 0x7f3a4c09b2d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f3a4400c790 tx=0x7f3a440015e0).stop 2022-04-28T14:41:42.474 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.469+0000 7f3a543da700 1 -- 172.21.15.22:0/605198880 shutdown_connections 2022-04-28T14:41:42.474 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.469+0000 7f3a543da700 1 --2- 172.21.15.22:0/605198880 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f3a4c068d00 0x7f3a4c09b2d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:42.474 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.469+0000 7f3a543da700 1 --2- 172.21.15.22:0/605198880 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a4c062420 0x7f3a4c09a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:42.474 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.469+0000 7f3a543da700 1 --2- 172.21.15.22:0/605198880 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f3a4c068130 0x7f3a4c147bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:42.474 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.469+0000 7f3a543da700 1 -- 172.21.15.22:0/605198880 >> 172.21.15.22:0/605198880 conn(0x7f3a4c0ae9d0 msgr2=0x7f3a4c0a35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:42.475 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.469+0000 7f3a543da700 1 -- 172.21.15.22:0/605198880 shutdown_connections 2022-04-28T14:41:42.475 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:42.469+0000 7f3a543da700 1 -- 172.21.15.22:0/605198880 wait complete. 2022-04-28T14:41:42.917 INFO:tasks.ceph.osd.2.smithi022.stderr:2022-04-28T14:41:42.913+0000 7fb5cd0d7700 -1 osd.2 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-04-28T14:41:43.138 INFO:tasks.ceph.osd.3.smithi022.stderr:2022-04-28T14:41:42.977+0000 7f5e535a5200 -1 osd.3 24 log_to_monitors {default=true} 2022-04-28T14:41:43.933 INFO:tasks.ceph.osd.3.smithi022.stderr:2022-04-28T14:41:43.928+0000 7f5e466d8700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-04-28T14:41:45.485 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-28T14:41:45.617 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.612+0000 7fdeb74bc700 1 Processor -- start 2022-04-28T14:41:45.617 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.612+0000 7fdeb74bc700 1 -- start start 2022-04-28T14:41:45.620 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.613+0000 7fdeb74bc700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fdeb0063e20 0x7fdeb009cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:45.620 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.613+0000 7fdeb74bc700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fdeb0099600 0x7fdeb009b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:45.620 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.613+0000 7fdeb74bc700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb00639d0 con 0x7fdeb0098180 2022-04-28T14:41:45.620 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.613+0000 7fdeb74bc700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb0099d00 con 0x7fdeb0063e20 2022-04-28T14:41:45.620 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.613+0000 7fdeb74bc700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb0064200 con 0x7fdeb0099600 2022-04-28T14:41:45.621 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.613+0000 7fdeb4a57700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fdeb0099600 0x7fdeb009b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:45.621 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.613+0000 7fdeb5258700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fdeb0063e20 0x7fdeb009cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:45.621 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.613+0000 7fdeb5a59700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fdeb0098180 0x7fdeb013b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40340/0 (socket says 172.21.15.22:40340) 2022-04-28T14:41:45.621 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.613+0000 7fdeb5a59700 1 -- 172.21.15.22:0/2582844162 learned_addr learned my addr 172.21.15.22:0/2582844162 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:41:45.621 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.613+0000 7fdeb4a57700 1 --2- 172.21.15.22:0/2582844162 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fdeb0099600 0x7fdeb009b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48292/0 (socket says 172.21.15.22:48292) 2022-04-28T14:41:45.621 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.613+0000 7fdea3fff700 1 -- 172.21.15.22:0/2582844162 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2502638038 0 0) 0x7fdeb00639d0 con 0x7fdeb0098180 2022-04-28T14:41:45.621 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.613+0000 7fdeb4a57700 1 -- 172.21.15.22:0/2582844162 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fdeb0063e20 msgr2=0x7fdeb009cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:45.621 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.613+0000 7fdeb4a57700 1 --2- 172.21.15.22:0/2582844162 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fdeb0063e20 0x7fdeb009cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:45.622 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.613+0000 7fdeb4a57700 1 -- 172.21.15.22:0/2582844162 >> v1:172.21.15.22:6789/0 conn(0x7fdeb0098180 legacy=0x7fdeb013b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:45.622 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.613+0000 7fdeb4a57700 1 -- 172.21.15.22:0/2582844162 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb009b9c0 con 0x7fdeb0099600 2022-04-28T14:41:45.622 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.613+0000 7fdeb5258700 1 --2- 172.21.15.22:0/2582844162 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fdeb0063e20 0x7fdeb009cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:45.622 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.613+0000 7fdeb4a57700 1 --2- 172.21.15.22:0/2582844162 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fdeb0099600 0x7fdeb009b4d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fdea4009790 tx=0x7fdea4009060).ready entity=mon.2 client_cookie=723e4a3de600ed5a server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:45.622 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.614+0000 7fdea3fff700 1 -- 172.21.15.22:0/2582844162 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea400b590 con 0x7fdeb0099600 2022-04-28T14:41:45.622 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.614+0000 7fdea3fff700 1 -- 172.21.15.22:0/2582844162 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea400b6f0 con 0x7fdeb0099600 2022-04-28T14:41:45.622 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.614+0000 7fdea3fff700 1 -- 172.21.15.22:0/2582844162 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea400ba70 con 0x7fdeb0099600 2022-04-28T14:41:45.622 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.614+0000 7fdeb74bc700 1 -- 172.21.15.22:0/2582844162 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fdeb0099600 msgr2=0x7fdeb009b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:45.622 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.614+0000 7fdeb74bc700 1 --2- 172.21.15.22:0/2582844162 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fdeb0099600 0x7fdeb009b4d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fdea4009790 tx=0x7fdea4009060).stop 2022-04-28T14:41:45.623 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.614+0000 7fdeb74bc700 1 -- 172.21.15.22:0/2582844162 shutdown_connections 2022-04-28T14:41:45.623 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.614+0000 7fdeb74bc700 1 --2- 172.21.15.22:0/2582844162 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fdeb0063e20 0x7fdeb009cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:45.623 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.614+0000 7fdeb74bc700 1 --2- 172.21.15.22:0/2582844162 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fdeb0099600 0x7fdeb009b4d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:45.623 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.614+0000 7fdeb74bc700 1 -- 172.21.15.22:0/2582844162 >> 172.21.15.22:0/2582844162 conn(0x7fdeb00aaf80 msgr2=0x7fdeb00ab390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:45.623 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.614+0000 7fdeb74bc700 1 -- 172.21.15.22:0/2582844162 shutdown_connections 2022-04-28T14:41:45.623 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.614+0000 7fdeb74bc700 1 -- 172.21.15.22:0/2582844162 wait complete. 2022-04-28T14:41:45.623 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.615+0000 7fdeb74bc700 1 Processor -- start 2022-04-28T14:41:45.623 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.615+0000 7fdeb74bc700 1 -- start start 2022-04-28T14:41:45.625 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.616+0000 7fdeb74bc700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fdeb0063e20 0x7fdeb0069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:45.625 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.616+0000 7fdeb74bc700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fdeb0098180 0x7fdeb0148090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:45.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.616+0000 7fdeb74bc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdeb0099600 0x7fdeb0138c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:45.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.616+0000 7fdeb74bc700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb00a0e40 con 0x7fdeb0099600 2022-04-28T14:41:45.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.616+0000 7fdeb74bc700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb0148a60 con 0x7fdeb0098180 2022-04-28T14:41:45.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.616+0000 7fdeb74bc700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb00a8830 con 0x7fdeb0063e20 2022-04-28T14:41:45.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.616+0000 7fdeb5258700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fdeb0063e20 0x7fdeb0069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:45.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.616+0000 7fdeb5a59700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdeb0099600 0x7fdeb0138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:45.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.616+0000 7fdeb4a57700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fdeb0098180 0x7fdeb0148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:45.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.616+0000 7fdeb5a59700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdeb0099600 0x7fdeb0138c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50950/0 (socket says 172.21.15.22:50950) 2022-04-28T14:41:45.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.616+0000 7fdeb5258700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fdeb0063e20 0x7fdeb0069fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48300/0 (socket says 172.21.15.22:48300) 2022-04-28T14:41:45.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.616+0000 7fdeb5a59700 1 -- 172.21.15.22:0/1413658066 learned_addr learned my addr 172.21.15.22:0/1413658066 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:45.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.616+0000 7fdeb5258700 1 -- 172.21.15.22:0/1413658066 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fdeb0098180 msgr2=0x7fdeb0148090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:45.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.616+0000 7fdeb5258700 1 --2- 172.21.15.22:0/1413658066 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fdeb0098180 0x7fdeb0148090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:45.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.616+0000 7fdeb5258700 1 -- 172.21.15.22:0/1413658066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdeb0099600 msgr2=0x7fdeb0138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:45.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.616+0000 7fdeb5258700 1 --2- 172.21.15.22:0/1413658066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdeb0099600 0x7fdeb0138c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:45.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.616+0000 7fdeb5258700 1 -- 172.21.15.22:0/1413658066 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac0092a0 con 0x7fdeb0063e20 2022-04-28T14:41:45.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.616+0000 7fdeb4a57700 1 --2- 172.21.15.22:0/1413658066 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fdeb0098180 0x7fdeb0148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:45.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.616+0000 7fdeb5258700 1 --2- 172.21.15.22:0/1413658066 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fdeb0063e20 0x7fdeb0069fc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fdeac00e980 tx=0x7fdeac009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:45.628 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.617+0000 7fdea17fa700 1 -- 172.21.15.22:0/1413658066 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeac012600 con 0x7fdeb0063e20 2022-04-28T14:41:45.628 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.617+0000 7fdea17fa700 1 -- 172.21.15.22:0/1413658066 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeac012760 con 0x7fdeb0063e20 2022-04-28T14:41:45.628 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.617+0000 7fdeb74bc700 1 -- 172.21.15.22:0/1413658066 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea40092a0 con 0x7fdeb0063e20 2022-04-28T14:41:45.628 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.617+0000 7fdea17fa700 1 -- 172.21.15.22:0/1413658066 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeac012ae0 con 0x7fdeb0063e20 2022-04-28T14:41:45.628 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.617+0000 7fdeb74bc700 1 -- 172.21.15.22:0/1413658066 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb0148580 con 0x7fdeb0063e20 2022-04-28T14:41:45.628 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.618+0000 7fdea17fa700 1 -- 172.21.15.22:0/1413658066 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7fdeac022070 con 0x7fdeb0063e20 2022-04-28T14:41:45.628 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.618+0000 7fdeb74bc700 1 -- 172.21.15.22:0/1413658066 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb01487d0 con 0x7fdeb0063e20 2022-04-28T14:41:45.628 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.618+0000 7fdea17fa700 1 -- 172.21.15.22:0/1413658066 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3702+0+0 (secure 0 0 0) 0x7fdeac055730 con 0x7fdeb0063e20 2022-04-28T14:41:45.629 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.621+0000 7fdea17fa700 1 -- 172.21.15.22:0/1413658066 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7fdeac035d70 con 0x7fdeb0063e20 2022-04-28T14:41:45.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.764+0000 7fdeb74bc700 1 -- 172.21.15.22:0/1413658066 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdeb0147d60 con 0x7fdeb0063e20 2022-04-28T14:41:45.770 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.765+0000 7fdea17fa700 1 -- 172.21.15.22:0/1413658066 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+11306 (secure 0 0 0) 0x7fdeac016070 con 0x7fdeb0063e20 2022-04-28T14:41:45.770 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:41:45.770 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":30,"fsid":"3047163a-0285-4058-8e05-ce74c6fbb9c5","created":"2022-04-28T14:38:54.232890+0000","modified":"2022-04-28T14:41:44.899394+0000","last_up_change":"2022-04-28T14:41:44.899394+0000","last_in_change":"2022-04-28T14:39:00.269721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-04-28T14:39:03.639717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-04-28T14:39:12.000229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-04-28T14:39:12.915097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"device_health_metrics","create_time":"2022-04-28T14:41:25.197740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"782ee638-1ada-48d9-9454-f9e0ca8a3135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":21,"up_from":27,"up_thru":29,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6800","nonce":94303}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":94303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":94303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":94303}]},"public_addr":"172.21.15.22:6800/94303","cluster_addr":"172.21.15.22:6801/94303","heartbeat_back_addr":"172.21.15.22:6803/94303","heartbeat_front_addr":"172.21.15.22:6802/94303","state":["exists","up"]},{"osd":1,"uuid":"61ca6f96-fb4f-4c0f-b68b-edf1e7011f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":29,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":94391}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":94391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":94391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":94391}]},"public_addr":"172.21.15.22:6804/94391","cluster_addr":"172.21.15.22:6805/94391","heartbeat_back_addr":"172.21.15.22:6807/94391","heartbeat_front_addr":"172.21.15.22:6806/94391","state":["exists","up"]},{"osd":2,"uuid":"4b3043b9-50df-4b7f-a55a-ac8e6148c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":29,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":94493}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":94493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":94493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":94493}]},"public_addr":"172.21.15.22:6809/94493","cluster_addr":"172.21.15.22:6810/94493","heartbeat_back_addr":"172.21.15.22:6812/94493","heartbeat_front_addr":"172.21.15.22:6811/94493","state":["exists","up"]},{"osd":3,"uuid":"7807bcd1-53f8-44b5-9992-57c328e5b299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":24,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":94624}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":94624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":94624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":94624}]},"public_addr":"172.21.15.22:6813/94624","cluster_addr":"172.21.15.22:6814/94624","heartbeat_back_addr":"172.21.15.22:6816/94624","heartbeat_front_addr":"172.21.15.22:6815/94624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"2022-04-28T14:41:38.872482+0000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:6808/86956":"2022-04-29T14:41:24.302858+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-04-28T14:41:45.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.766+0000 7fdeb74bc700 1 -- 172.21.15.22:0/1413658066 >> v1:172.21.15.22:6808/92758 conn(0x7fde90041b00 legacy=0x7fde90043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:45.771 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.766+0000 7fdeb74bc700 1 -- 172.21.15.22:0/1413658066 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fdeb0063e20 msgr2=0x7fdeb0069fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:45.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.766+0000 7fdeb74bc700 1 --2- 172.21.15.22:0/1413658066 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fdeb0063e20 0x7fdeb0069fc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fdeac00e980 tx=0x7fdeac009060).stop 2022-04-28T14:41:45.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.767+0000 7fdeb74bc700 1 -- 172.21.15.22:0/1413658066 shutdown_connections 2022-04-28T14:41:45.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.767+0000 7fdeb74bc700 1 --2- 172.21.15.22:0/1413658066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdeb0099600 0x7fdeb0138c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:45.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.767+0000 7fdeb74bc700 1 --2- 172.21.15.22:0/1413658066 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fdeb0063e20 0x7fdeb0069fc0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:45.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.767+0000 7fdeb74bc700 1 --2- 172.21.15.22:0/1413658066 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fdeb0098180 0x7fdeb0148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:45.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.767+0000 7fdeb74bc700 1 -- 172.21.15.22:0/1413658066 >> 172.21.15.22:0/1413658066 conn(0x7fdeb00aaf80 msgr2=0x7fdeb0062680 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:45.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.767+0000 7fdeb74bc700 1 -- 172.21.15.22:0/1413658066 shutdown_connections 2022-04-28T14:41:45.772 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:45.767+0000 7fdeb74bc700 1 -- 172.21.15.22:0/1413658066 wait complete. 2022-04-28T14:41:45.783 INFO:tasks.ceph.ceph_manager.ceph:all up! 2022-04-28T14:41:45.783 INFO:teuthology.run_tasks:Running task ceph.stop... 2022-04-28T14:41:45.795 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2022-04-28T14:41:45.796 INFO:teuthology.orchestra.run:waiting for 300 2022-04-28T14:41:45.804 INFO:tasks.ceph.mds.a:Stopped 2022-04-28T14:41:45.804 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2022-04-28T14:41:45.804 INFO:teuthology.orchestra.run:waiting for 300 2022-04-28T14:41:45.853 INFO:tasks.ceph.mds.b:Stopped 2022-04-28T14:41:45.853 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2022-04-28T14:41:45.853 INFO:teuthology.orchestra.run:waiting for 300 2022-04-28T14:41:45.904 INFO:tasks.ceph.mds.c:Stopped 2022-04-28T14:41:47.899 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog finished 2022-04-28T14:41:47.899 INFO:teuthology.run_tasks:Running task ceph.restart... 2022-04-28T14:41:47.911 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2022-04-28T14:41:47.911 INFO:tasks.ceph.mds.a:Restarting daemon 2022-04-28T14:41:47.911 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-04-28T14:41:47.914 INFO:tasks.ceph.mds.a:Started 2022-04-28T14:41:47.914 ERROR:tasks.ceph.mds.b:tried to stop a non-running daemon 2022-04-28T14:41:47.914 INFO:tasks.ceph.mds.b:Restarting daemon 2022-04-28T14:41:47.914 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-04-28T14:41:47.917 INFO:tasks.ceph.mds.b:Started 2022-04-28T14:41:47.917 ERROR:tasks.ceph.mds.c:tried to stop a non-running daemon 2022-04-28T14:41:47.917 INFO:tasks.ceph.mds.c:Restarting daemon 2022-04-28T14:41:47.917 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-04-28T14:41:47.919 INFO:tasks.ceph.mds.c:Started 2022-04-28T14:41:47.919 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2022-04-28T14:41:47.919 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-28T14:41:48.008 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2022-04-28T14:41:48.011 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2022-04-28T14:41:48.013 INFO:tasks.ceph.mds.b.smithi022.stdout:starting mds.b at 2022-04-28T14:41:48.076 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.072+0000 7fef493e2700 1 Processor -- start 2022-04-28T14:41:48.077 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.072+0000 7fef493e2700 1 -- start start 2022-04-28T14:41:48.079 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.072+0000 7fef493e2700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fef44069200 0x7fef44138680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:48.079 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.072+0000 7fef493e2700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fef44138b70 0x7fef44139020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:48.080 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.072+0000 7fef493e2700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef440624d0 con 0x7fef440620f0 2022-04-28T14:41:48.080 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.072+0000 7fef493e2700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef44067ca0 con 0x7fef44138b70 2022-04-28T14:41:48.080 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.072+0000 7fef493e2700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef440679e0 con 0x7fef44069200 2022-04-28T14:41:48.080 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.073+0000 7fef437fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fef44138b70 0x7fef44139020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:48.080 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.073+0000 7fef42ffd700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fef440620f0 0x7fef440672d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40400/0 (socket says 172.21.15.22:40400) 2022-04-28T14:41:48.080 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.073+0000 7fef42ffd700 1 -- 172.21.15.22:0/1184801088 learned_addr learned my addr 172.21.15.22:0/1184801088 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:41:48.080 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.073+0000 7fef427fc700 1 --2- 172.21.15.22:0/1184801088 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fef44069200 0x7fef44138680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:48.080 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.073+0000 7fef41ffb700 1 -- 172.21.15.22:0/1184801088 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144898063 0 0) 0x7fef440624d0 con 0x7fef440620f0 2022-04-28T14:41:48.080 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.073+0000 7fef41ffb700 1 -- 172.21.15.22:0/1184801088 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef300033f0 con 0x7fef440620f0 2022-04-28T14:41:48.080 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.073+0000 7fef437fe700 1 -- 172.21.15.22:0/1184801088 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fef44069200 msgr2=0x7fef44138680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:48.081 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.073+0000 7fef437fe700 1 --2- 172.21.15.22:0/1184801088 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fef44069200 0x7fef44138680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:48.081 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.073+0000 7fef437fe700 1 -- 172.21.15.22:0/1184801088 >> v1:172.21.15.22:6789/0 conn(0x7fef440620f0 legacy=0x7fef440672d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:48.081 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.073+0000 7fef437fe700 1 -- 172.21.15.22:0/1184801088 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef44068a20 con 0x7fef44138b70 2022-04-28T14:41:48.081 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.073+0000 7fef427fc700 1 --2- 172.21.15.22:0/1184801088 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fef44069200 0x7fef44138680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:48.081 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.073+0000 7fef437fe700 1 --2- 172.21.15.22:0/1184801088 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fef44138b70 0x7fef44139020 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fef3c009e90 tx=0x7fef3c009780).ready entity=mon.1 client_cookie=8cbd773422c66cf0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:48.081 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.073+0000 7fef41ffb700 1 -- 172.21.15.22:0/1184801088 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c00e070 con 0x7fef44138b70 2022-04-28T14:41:48.081 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.073+0000 7fef41ffb700 1 -- 172.21.15.22:0/1184801088 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3c00bab0 con 0x7fef44138b70 2022-04-28T14:41:48.081 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.073+0000 7fef41ffb700 1 -- 172.21.15.22:0/1184801088 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c00be30 con 0x7fef44138b70 2022-04-28T14:41:48.081 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.074+0000 7fef493e2700 1 -- 172.21.15.22:0/1184801088 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fef44138b70 msgr2=0x7fef44139020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:48.082 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.074+0000 7fef493e2700 1 --2- 172.21.15.22:0/1184801088 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fef44138b70 0x7fef44139020 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fef3c009e90 tx=0x7fef3c009780).stop 2022-04-28T14:41:48.082 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.074+0000 7fef493e2700 1 -- 172.21.15.22:0/1184801088 shutdown_connections 2022-04-28T14:41:48.082 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.074+0000 7fef493e2700 1 --2- 172.21.15.22:0/1184801088 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fef44138b70 0x7fef44139020 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:48.082 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.074+0000 7fef493e2700 1 --2- 172.21.15.22:0/1184801088 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fef44069200 0x7fef44138680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:48.082 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.074+0000 7fef493e2700 1 -- 172.21.15.22:0/1184801088 >> 172.21.15.22:0/1184801088 conn(0x7fef440aa5c0 msgr2=0x7fef440aa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:48.082 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.074+0000 7fef493e2700 1 -- 172.21.15.22:0/1184801088 shutdown_connections 2022-04-28T14:41:48.082 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.074+0000 7fef493e2700 1 -- 172.21.15.22:0/1184801088 wait complete. 2022-04-28T14:41:48.085 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.075+0000 7fef493e2700 1 Processor -- start 2022-04-28T14:41:48.085 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.075+0000 7fef493e2700 1 -- start start 2022-04-28T14:41:48.085 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.076+0000 7fef493e2700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fef440620f0 0x7fef440a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:48.085 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.076+0000 7fef493e2700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fef44069200 0x7fef440a3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:48.085 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.076+0000 7fef493e2700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef44138b70 0x7fef4414ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:48.085 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.076+0000 7fef493e2700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef44091b30 con 0x7fef44138b70 2022-04-28T14:41:48.085 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.076+0000 7fef493e2700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef440a3920 con 0x7fef44069200 2022-04-28T14:41:48.085 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.076+0000 7fef493e2700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef4413c920 con 0x7fef440620f0 2022-04-28T14:41:48.085 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.076+0000 7fef42ffd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fef440620f0 0x7fef440a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:48.086 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.076+0000 7fef427fc700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fef44069200 0x7fef440a3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:48.086 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.076+0000 7fef427fc700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fef44069200 0x7fef440a3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48580/0 (socket says 172.21.15.22:48580) 2022-04-28T14:41:48.086 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.076+0000 7fef437fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef44138b70 0x7fef4414ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:48.086 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.076+0000 7fef42ffd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fef440620f0 0x7fef440a4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48362/0 (socket says 172.21.15.22:48362) 2022-04-28T14:41:48.086 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.076+0000 7fef427fc700 1 -- 172.21.15.22:0/2222254769 learned_addr learned my addr 172.21.15.22:0/2222254769 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:48.086 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.076+0000 7fef42ffd700 1 -- 172.21.15.22:0/2222254769 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fef44069200 msgr2=0x7fef440a3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:48.086 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.076+0000 7fef42ffd700 1 --2- 172.21.15.22:0/2222254769 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fef44069200 0x7fef440a3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:48.087 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.076+0000 7fef42ffd700 1 -- 172.21.15.22:0/2222254769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef44138b70 msgr2=0x7fef4414ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:48.087 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.076+0000 7fef42ffd700 1 --2- 172.21.15.22:0/2222254769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef44138b70 0x7fef4414ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:48.087 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.076+0000 7fef42ffd700 1 -- 172.21.15.22:0/2222254769 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef380092a0 con 0x7fef440620f0 2022-04-28T14:41:48.087 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.076+0000 7fef427fc700 1 --2- 172.21.15.22:0/2222254769 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fef44069200 0x7fef440a3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:48.087 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.076+0000 7fef42ffd700 1 --2- 172.21.15.22:0/2222254769 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fef440620f0 0x7fef440a4700 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fef34001ed0 tx=0x7fef34007bd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:48.087 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.077+0000 7fef2affd700 1 -- 172.21.15.22:0/2222254769 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef340070d0 con 0x7fef440620f0 2022-04-28T14:41:48.087 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.077+0000 7fef2affd700 1 -- 172.21.15.22:0/2222254769 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef34007230 con 0x7fef440620f0 2022-04-28T14:41:48.087 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.077+0000 7fef493e2700 1 -- 172.21.15.22:0/2222254769 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef3c009a20 con 0x7fef440620f0 2022-04-28T14:41:48.087 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.077+0000 7fef2affd700 1 -- 172.21.15.22:0/2222254769 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef340075f0 con 0x7fef440620f0 2022-04-28T14:41:48.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.077+0000 7fef493e2700 1 -- 172.21.15.22:0/2222254769 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef440a3600 con 0x7fef440620f0 2022-04-28T14:41:48.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.078+0000 7fef2affd700 1 -- 172.21.15.22:0/2222254769 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7fef34010070 con 0x7fef440620f0 2022-04-28T14:41:48.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.078+0000 7fef493e2700 1 -- 172.21.15.22:0/2222254769 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef44091980 con 0x7fef440620f0 2022-04-28T14:41:48.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.078+0000 7fef2affd700 1 -- 172.21.15.22:0/2222254769 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 3745+0+0 (secure 0 0 0) 0x7fef340549e0 con 0x7fef440620f0 2022-04-28T14:41:48.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.081+0000 7fef2affd700 1 -- 172.21.15.22:0/2222254769 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7fef34034ff0 con 0x7fef440620f0 2022-04-28T14:41:48.225 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.220+0000 7fef493e2700 1 -- 172.21.15.22:0/2222254769 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef440695e0 con 0x7fef440620f0 2022-04-28T14:41:48.226 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.221+0000 7fef2affd700 1 -- 172.21.15.22:0/2222254769 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+11370 (secure 0 0 0) 0x7fef34024c80 con 0x7fef440620f0 2022-04-28T14:41:48.226 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:41:48.226 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":34,"fsid":"3047163a-0285-4058-8e05-ce74c6fbb9c5","created":"2022-04-28T14:38:54.232890+0000","modified":"2022-04-28T14:41:48.026855+0000","last_up_change":"2022-04-28T14:41:44.899394+0000","last_in_change":"2022-04-28T14:39:00.269721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-04-28T14:39:03.639717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-04-28T14:39:12.000229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-04-28T14:39:12.915097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"device_health_metrics","create_time":"2022-04-28T14:41:25.197740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"782ee638-1ada-48d9-9454-f9e0ca8a3135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":21,"up_from":27,"up_thru":30,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6800","nonce":94303}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":94303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":94303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":94303}]},"public_addr":"172.21.15.22:6800/94303","cluster_addr":"172.21.15.22:6801/94303","heartbeat_back_addr":"172.21.15.22:6803/94303","heartbeat_front_addr":"172.21.15.22:6802/94303","state":["exists","up"]},{"osd":1,"uuid":"61ca6f96-fb4f-4c0f-b68b-edf1e7011f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":30,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":94391}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":94391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":94391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":94391}]},"public_addr":"172.21.15.22:6804/94391","cluster_addr":"172.21.15.22:6805/94391","heartbeat_back_addr":"172.21.15.22:6807/94391","heartbeat_front_addr":"172.21.15.22:6806/94391","state":["exists","up"]},{"osd":2,"uuid":"4b3043b9-50df-4b7f-a55a-ac8e6148c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":30,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":94493}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":94493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":94493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":94493}]},"public_addr":"172.21.15.22:6809/94493","cluster_addr":"172.21.15.22:6810/94493","heartbeat_back_addr":"172.21.15.22:6812/94493","heartbeat_front_addr":"172.21.15.22:6811/94493","state":["exists","up"]},{"osd":3,"uuid":"7807bcd1-53f8-44b5-9992-57c328e5b299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":30,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":94624}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":94624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":94624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":94624}]},"public_addr":"172.21.15.22:6813/94624","cluster_addr":"172.21.15.22:6814/94624","heartbeat_back_addr":"172.21.15.22:6816/94624","heartbeat_front_addr":"172.21.15.22:6815/94624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"2022-04-28T14:41:38.872482+0000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:6819/356491488":"2022-04-29T14:41:48.026821+0000","172.21.15.22:6808/86956":"2022-04-29T14:41:24.302858+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-04-28T14:41:48.228 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.223+0000 7fef493e2700 1 -- 172.21.15.22:0/2222254769 >> v1:172.21.15.22:6808/92758 conn(0x7fef24041b00 legacy=0x7fef24043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:48.228 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.223+0000 7fef493e2700 1 -- 172.21.15.22:0/2222254769 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fef440620f0 msgr2=0x7fef440a4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:48.228 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.223+0000 7fef493e2700 1 --2- 172.21.15.22:0/2222254769 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fef440620f0 0x7fef440a4700 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fef34001ed0 tx=0x7fef34007bd0).stop 2022-04-28T14:41:48.228 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.223+0000 7fef493e2700 1 -- 172.21.15.22:0/2222254769 shutdown_connections 2022-04-28T14:41:48.228 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.223+0000 7fef493e2700 1 --2- 172.21.15.22:0/2222254769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef44138b70 0x7fef4414ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:48.228 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.223+0000 7fef493e2700 1 --2- 172.21.15.22:0/2222254769 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fef440620f0 0x7fef440a4700 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:48.228 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.223+0000 7fef493e2700 1 --2- 172.21.15.22:0/2222254769 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fef44069200 0x7fef440a3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:48.229 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.223+0000 7fef493e2700 1 -- 172.21.15.22:0/2222254769 >> 172.21.15.22:0/2222254769 conn(0x7fef440aa5c0 msgr2=0x7fef44062840 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:48.229 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.223+0000 7fef493e2700 1 -- 172.21.15.22:0/2222254769 shutdown_connections 2022-04-28T14:41:48.229 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.223+0000 7fef493e2700 1 -- 172.21.15.22:0/2222254769 wait complete. 2022-04-28T14:41:48.239 INFO:tasks.ceph.ceph_manager.ceph:all up! 2022-04-28T14:41:48.239 INFO:teuthology.run_tasks:Running task exec... 2022-04-28T14:41:48.253 INFO:teuthology.task.exec:Executing custom commands... 2022-04-28T14:41:48.253 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi022.front.sepia.ceph.com 2022-04-28T14:41:48.253 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph versions' 2022-04-28T14:41:48.370 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.362+0000 7f2cb5b4e700 1 Processor -- start 2022-04-28T14:41:48.370 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.363+0000 7f2cb5b4e700 1 -- start start 2022-04-28T14:41:48.370 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.363+0000 7f2cb5b4e700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2cb00a0490 0x7f2cb01381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:48.371 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.363+0000 7f2cb5b4e700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2cb00a4110 0x7f2cb00a38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:48.371 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.363+0000 7f2cb5b4e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2cb00abe70 0x7f2cb013b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:48.371 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.363+0000 7f2cb5b4e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb01387e0 con 0x7f2cb00abe70 2022-04-28T14:41:48.371 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.363+0000 7f2cb5b4e700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb0138a80 con 0x7f2cb00a0490 2022-04-28T14:41:48.371 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.363+0000 7f2cb5b4e700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb00a2fd0 con 0x7f2cb00a4110 2022-04-28T14:41:48.371 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.363+0000 7f2caf7fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2cb00a0490 0x7f2cb01381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:48.371 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.363+0000 7f2caeffd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2cb00a4110 0x7f2cb00a38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:48.371 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.363+0000 7f2caffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2cb00abe70 0x7f2cb013b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:48.371 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.363+0000 7f2caf7fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2cb00a0490 0x7f2cb01381c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48586/0 (socket says 172.21.15.22:48586) 2022-04-28T14:41:48.372 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.363+0000 7f2caeffd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2cb00a4110 0x7f2cb00a38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48370/0 (socket says 172.21.15.22:48370) 2022-04-28T14:41:48.372 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.363+0000 7f2caffff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2cb00abe70 0x7f2cb013b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51022/0 (socket says 172.21.15.22:51022) 2022-04-28T14:41:48.372 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.363+0000 7f2caf7fe700 1 -- 172.21.15.22:0/852262460 learned_addr learned my addr 172.21.15.22:0/852262460 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:48.372 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.364+0000 7f2caf7fe700 1 -- 172.21.15.22:0/852262460 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2cb00a4110 msgr2=0x7f2cb00a38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:48.372 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.364+0000 7f2caf7fe700 1 --2- 172.21.15.22:0/852262460 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2cb00a4110 0x7f2cb00a38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:48.372 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.364+0000 7f2caf7fe700 1 -- 172.21.15.22:0/852262460 >> v2:172.21.15.22:3300/0 conn(0x7f2cb00abe70 msgr2=0x7f2cb013b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:48.372 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.364+0000 7f2caf7fe700 1 --2- 172.21.15.22:0/852262460 >> v2:172.21.15.22:3300/0 conn(0x7f2cb00abe70 0x7f2cb013b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:48.372 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.364+0000 7f2caf7fe700 1 -- 172.21.15.22:0/852262460 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb00ac320 con 0x7f2cb00a0490 2022-04-28T14:41:48.372 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.364+0000 7f2caffff700 1 --2- 172.21.15.22:0/852262460 >> v2:172.21.15.22:3300/0 conn(0x7f2cb00abe70 0x7f2cb013b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:48.372 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.364+0000 7f2caf7fe700 1 --2- 172.21.15.22:0/852262460 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2cb00a0490 0x7f2cb01381c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f2ca0006fd0 tx=0x7f2ca00090f0).ready entity=mon.1 client_cookie=a8de94d5b683009f server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:48.372 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.364+0000 7f2cae7fc700 1 -- 172.21.15.22:0/852262460 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca000f510 con 0x7f2cb00a0490 2022-04-28T14:41:48.373 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.364+0000 7f2cae7fc700 1 -- 172.21.15.22:0/852262460 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca000f670 con 0x7f2cb00a0490 2022-04-28T14:41:48.373 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.364+0000 7f2cae7fc700 1 -- 172.21.15.22:0/852262460 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca000f9f0 con 0x7f2cb00a0490 2022-04-28T14:41:48.373 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.364+0000 7f2cb5b4e700 1 -- 172.21.15.22:0/852262460 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2cb00a0490 msgr2=0x7f2cb01381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:48.373 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.364+0000 7f2cb5b4e700 1 --2- 172.21.15.22:0/852262460 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2cb00a0490 0x7f2cb01381c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f2ca0006fd0 tx=0x7f2ca00090f0).stop 2022-04-28T14:41:48.373 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.365+0000 7f2cb5b4e700 1 -- 172.21.15.22:0/852262460 shutdown_connections 2022-04-28T14:41:48.373 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.365+0000 7f2cb5b4e700 1 --2- 172.21.15.22:0/852262460 >> v2:172.21.15.22:3300/0 conn(0x7f2cb00abe70 0x7f2cb013b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:48.373 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.365+0000 7f2cb5b4e700 1 --2- 172.21.15.22:0/852262460 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2cb00a0490 0x7f2cb01381c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:48.373 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.365+0000 7f2cb5b4e700 1 --2- 172.21.15.22:0/852262460 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2cb00a4110 0x7f2cb00a38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:48.373 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.365+0000 7f2cb5b4e700 1 -- 172.21.15.22:0/852262460 >> 172.21.15.22:0/852262460 conn(0x7f2cb0062b50 msgr2=0x7f2cb0062f30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:48.373 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.365+0000 7f2cb5b4e700 1 -- 172.21.15.22:0/852262460 shutdown_connections 2022-04-28T14:41:48.374 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.365+0000 7f2cb5b4e700 1 -- 172.21.15.22:0/852262460 wait complete. 2022-04-28T14:41:48.374 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.366+0000 7f2cb5b4e700 1 Processor -- start 2022-04-28T14:41:48.374 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.366+0000 7f2cb5b4e700 1 -- start start 2022-04-28T14:41:48.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.366+0000 7f2cb5b4e700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2cb00a0490 0x7f2cb00a9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:48.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.366+0000 7f2cb5b4e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cb00a4110 0x7f2cb00aa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:48.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.366+0000 7f2cb5b4e700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2cb00abe70 0x7f2cb014ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:48.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.366+0000 7f2cb5b4e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb0116750 con 0x7f2cb00a4110 2022-04-28T14:41:48.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.366+0000 7f2cb5b4e700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb00ab1b0 con 0x7f2cb00a0490 2022-04-28T14:41:48.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.366+0000 7f2cb5b4e700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb014b780 con 0x7f2cb00abe70 2022-04-28T14:41:48.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.366+0000 7f2caf7fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2cb00a0490 0x7f2cb00a9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:48.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.366+0000 7f2caf7fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2cb00a0490 0x7f2cb00a9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48592/0 (socket says 172.21.15.22:48592) 2022-04-28T14:41:48.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.366+0000 7f2caf7fe700 1 -- 172.21.15.22:0/2789076396 learned_addr learned my addr 172.21.15.22:0/2789076396 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:48.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.367+0000 7f2caffff700 1 --2- 172.21.15.22:0/2789076396 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2cb00abe70 0x7f2cb014ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:48.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.367+0000 7f2caeffd700 1 --2- 172.21.15.22:0/2789076396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cb00a4110 0x7f2cb00aa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:48.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.367+0000 7f2caf7fe700 1 -- 172.21.15.22:0/2789076396 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2cb00abe70 msgr2=0x7f2cb014ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:48.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.367+0000 7f2caf7fe700 1 --2- 172.21.15.22:0/2789076396 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2cb00abe70 0x7f2cb014ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:48.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.367+0000 7f2caf7fe700 1 -- 172.21.15.22:0/2789076396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cb00a4110 msgr2=0x7f2cb00aa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:48.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.367+0000 7f2caf7fe700 1 --2- 172.21.15.22:0/2789076396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cb00a4110 0x7f2cb00aa5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:48.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.367+0000 7f2caf7fe700 1 -- 172.21.15.22:0/2789076396 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca8009a20 con 0x7f2cb00a0490 2022-04-28T14:41:48.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.367+0000 7f2caffff700 1 --2- 172.21.15.22:0/2789076396 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2cb00abe70 0x7f2cb014ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:48.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.367+0000 7f2caf7fe700 1 --2- 172.21.15.22:0/2789076396 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2cb00a0490 0x7f2cb00a9de0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f2ca0009df0 tx=0x7f2ca0017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:48.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.367+0000 7f2c977fe700 1 -- 172.21.15.22:0/2789076396 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca000fe80 con 0x7f2cb00a0490 2022-04-28T14:41:48.379 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.367+0000 7f2c977fe700 1 -- 172.21.15.22:0/2789076396 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca000f7e0 con 0x7f2cb00a0490 2022-04-28T14:41:48.379 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.367+0000 7f2c977fe700 1 -- 172.21.15.22:0/2789076396 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca001b640 con 0x7f2cb00a0490 2022-04-28T14:41:48.379 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.367+0000 7f2cb5b4e700 1 -- 172.21.15.22:0/2789076396 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca0009370 con 0x7f2cb00a0490 2022-04-28T14:41:48.379 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.367+0000 7f2cb5b4e700 1 -- 172.21.15.22:0/2789076396 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb00a85f0 con 0x7f2cb00a0490 2022-04-28T14:41:48.379 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.368+0000 7f2cb5b4e700 1 -- 172.21.15.22:0/2789076396 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb006c350 con 0x7f2cb00a0490 2022-04-28T14:41:48.379 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.368+0000 7f2c977fe700 1 -- 172.21.15.22:0/2789076396 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f2ca0023030 con 0x7f2cb00a0490 2022-04-28T14:41:48.379 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.368+0000 7f2c977fe700 1 -- 172.21.15.22:0/2789076396 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 3745+0+0 (secure 0 0 0) 0x7f2ca00560f0 con 0x7f2cb00a0490 2022-04-28T14:41:48.379 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.372+0000 7f2c977fe700 1 -- 172.21.15.22:0/2789076396 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f2ca003a300 con 0x7f2cb00a0490 2022-04-28T14:41:48.565 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.560+0000 7f2cb5b4e700 1 -- 172.21.15.22:0/2789076396 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2cb00a4630 con 0x7f2cb00a0490 2022-04-28T14:41:48.565 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.561+0000 7f2c977fe700 1 -- 172.21.15.22:0/2789076396 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+835 (secure 0 0 0) 0x7f2ca0021070 con 0x7f2cb00a0490 2022-04-28T14:41:48.566 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2022-04-28T14:41:48.566 INFO:teuthology.orchestra.run.smithi022.stdout: "mon": { 2022-04-28T14:41:48.566 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable)": 3 2022-04-28T14:41:48.566 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.566 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr": { 2022-04-28T14:41:48.566 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable)": 2 2022-04-28T14:41:48.566 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.566 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": { 2022-04-28T14:41:48.566 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable)": 4 2022-04-28T14:41:48.567 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.567 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": { 2022-04-28T14:41:48.567 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph version 14.2.22 (ca74598065096e6fcbd8433c8779a2be0c889351) nautilus (stable)": 3, 2022-04-28T14:41:48.567 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable)": 3 2022-04-28T14:41:48.567 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.567 INFO:teuthology.orchestra.run.smithi022.stdout: "overall": { 2022-04-28T14:41:48.567 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph version 14.2.22 (ca74598065096e6fcbd8433c8779a2be0c889351) nautilus (stable)": 3, 2022-04-28T14:41:48.567 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable)": 12 2022-04-28T14:41:48.567 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:41:48.567 INFO:teuthology.orchestra.run.smithi022.stdout:} 2022-04-28T14:41:48.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.562+0000 7f2cb5b4e700 1 -- 172.21.15.22:0/2789076396 >> v1:172.21.15.22:6808/92758 conn(0x7f2c90041b00 legacy=0x7f2c90043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:48.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.562+0000 7f2cb5b4e700 1 -- 172.21.15.22:0/2789076396 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2cb00a0490 msgr2=0x7f2cb00a9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:48.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.562+0000 7f2cb5b4e700 1 --2- 172.21.15.22:0/2789076396 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2cb00a0490 0x7f2cb00a9de0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f2ca0009df0 tx=0x7f2ca0017000).stop 2022-04-28T14:41:48.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.562+0000 7f2cb5b4e700 1 -- 172.21.15.22:0/2789076396 shutdown_connections 2022-04-28T14:41:48.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.562+0000 7f2cb5b4e700 1 --2- 172.21.15.22:0/2789076396 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2cb00abe70 0x7f2cb014ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:48.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.562+0000 7f2cb5b4e700 1 --2- 172.21.15.22:0/2789076396 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2cb00a0490 0x7f2cb00a9de0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:48.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.562+0000 7f2cb5b4e700 1 --2- 172.21.15.22:0/2789076396 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2cb00a4110 0x7f2cb00aa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:48.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.562+0000 7f2cb5b4e700 1 -- 172.21.15.22:0/2789076396 >> 172.21.15.22:0/2789076396 conn(0x7f2cb0062b50 msgr2=0x7f2cb0137a10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:48.569 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.562+0000 7f2cb5b4e700 1 -- 172.21.15.22:0/2789076396 shutdown_connections 2022-04-28T14:41:48.570 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.562+0000 7f2cb5b4e700 1 -- 172.21.15.22:0/2789076396 wait complete. 2022-04-28T14:41:48.578 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd dump -f json-pretty' 2022-04-28T14:41:48.694 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.689+0000 7fc6a3d41700 1 Processor -- start 2022-04-28T14:41:48.694 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.690+0000 7fc6a3d41700 1 -- start start 2022-04-28T14:41:48.697 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.690+0000 7fc6a3d41700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc69c05e510 0x7fc69c0679e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:48.697 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.690+0000 7fc6a3d41700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc69c13d060 0x7fc69c13f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:48.698 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.690+0000 7fc6a3d41700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc69c05e8f0 con 0x7fc69c067ed0 2022-04-28T14:41:48.698 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.690+0000 7fc6a3d41700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc69c067020 con 0x7fc69c13d060 2022-04-28T14:41:48.698 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.690+0000 7fc6a3d41700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c0a6140 con 0x7fc69c05e510 2022-04-28T14:41:48.698 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.690+0000 7fc6a1add700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc69c05e510 0x7fc69c0679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:48.698 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.690+0000 7fc6a22de700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc69c13d060 0x7fc69c13f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:48.698 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.690+0000 7fc6a1add700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc69c05e510 0x7fc69c0679e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48384/0 (socket says 172.21.15.22:48384) 2022-04-28T14:41:48.698 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.690+0000 7fc6a22de700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc69c13d060 0x7fc69c13f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51034/0 (socket says 172.21.15.22:51034) 2022-04-28T14:41:48.698 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.690+0000 7fc6a12dc700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc69c067ed0 0x7fc69c068e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40428/0 (socket says 172.21.15.22:40428) 2022-04-28T14:41:48.698 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.690+0000 7fc6a1add700 1 -- 172.21.15.22:0/3174926015 learned_addr learned my addr 172.21.15.22:0/3174926015 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:48.699 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.691+0000 7fc6a22de700 1 -- 172.21.15.22:0/3174926015 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc69c05e510 msgr2=0x7fc69c0679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:48.699 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.691+0000 7fc6a22de700 1 --2- 172.21.15.22:0/3174926015 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc69c05e510 0x7fc69c0679e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:48.699 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.691+0000 7fc6a22de700 1 -- 172.21.15.22:0/3174926015 >> v1:172.21.15.22:6789/0 conn(0x7fc69c067ed0 legacy=0x7fc69c068e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:48.699 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.691+0000 7fc6a22de700 1 -- 172.21.15.22:0/3174926015 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69c068730 con 0x7fc69c13d060 2022-04-28T14:41:48.699 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.691+0000 7fc6a0adb700 1 -- 172.21.15.22:0/3174926015 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198465466 0 0) 0x7fc69c05e8f0 con 0x7fc69c067ed0 2022-04-28T14:41:48.699 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.691+0000 7fc6a1add700 1 --2- 172.21.15.22:0/3174926015 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc69c05e510 0x7fc69c0679e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:48.699 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.691+0000 7fc6a22de700 1 --2- 172.21.15.22:0/3174926015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc69c13d060 0x7fc69c13f450 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fc69400d0d0 tx=0x7fc69400b990).ready entity=mon.0 client_cookie=f679a7f8002244a5 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:48.699 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.691+0000 7fc6a0adb700 1 -- 172.21.15.22:0/3174926015 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694010070 con 0x7fc69c13d060 2022-04-28T14:41:48.699 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.691+0000 7fc6a0adb700 1 -- 172.21.15.22:0/3174926015 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69400b2e0 con 0x7fc69c13d060 2022-04-28T14:41:48.699 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.691+0000 7fc6a0adb700 1 -- 172.21.15.22:0/3174926015 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69400dd40 con 0x7fc69c13d060 2022-04-28T14:41:48.700 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.692+0000 7fc6a3d41700 1 -- 172.21.15.22:0/3174926015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc69c13d060 msgr2=0x7fc69c13f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:48.700 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.692+0000 7fc6a3d41700 1 --2- 172.21.15.22:0/3174926015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc69c13d060 0x7fc69c13f450 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fc69400d0d0 tx=0x7fc69400b990).stop 2022-04-28T14:41:48.700 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.692+0000 7fc6a3d41700 1 -- 172.21.15.22:0/3174926015 shutdown_connections 2022-04-28T14:41:48.700 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.692+0000 7fc6a3d41700 1 --2- 172.21.15.22:0/3174926015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc69c13d060 0x7fc69c13f450 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:48.700 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.692+0000 7fc6a3d41700 1 --2- 172.21.15.22:0/3174926015 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc69c05e510 0x7fc69c0679e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:48.700 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.692+0000 7fc6a3d41700 1 -- 172.21.15.22:0/3174926015 >> 172.21.15.22:0/3174926015 conn(0x7fc69c0a7110 msgr2=0x7fc69c0a7520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:48.700 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.692+0000 7fc6a3d41700 1 -- 172.21.15.22:0/3174926015 shutdown_connections 2022-04-28T14:41:48.700 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.692+0000 7fc6a3d41700 1 -- 172.21.15.22:0/3174926015 wait complete. 2022-04-28T14:41:48.700 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.693+0000 7fc6a3d41700 1 Processor -- start 2022-04-28T14:41:48.700 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.693+0000 7fc6a3d41700 1 -- start start 2022-04-28T14:41:48.703 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.693+0000 7fc6a3d41700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc69c05e510 0x7fc69c147440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:48.703 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.693+0000 7fc6a3d41700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc69c067ed0 0x7fc69c0a4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:48.703 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.693+0000 7fc6a3d41700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc69c13d060 0x7fc69c0a2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:48.703 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.693+0000 7fc6a3d41700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c0a3950 con 0x7fc69c13d060 2022-04-28T14:41:48.703 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.693+0000 7fc6a3d41700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c146fa0 con 0x7fc69c05e510 2022-04-28T14:41:48.703 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.693+0000 7fc6a3d41700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc69c0a2060 con 0x7fc69c067ed0 2022-04-28T14:41:48.703 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.693+0000 7fc6a1add700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc69c05e510 0x7fc69c147440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:48.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.693+0000 7fc6a12dc700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc69c067ed0 0x7fc69c0a4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:48.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.693+0000 7fc6a1add700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc69c05e510 0x7fc69c147440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48604/0 (socket says 172.21.15.22:48604) 2022-04-28T14:41:48.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.693+0000 7fc6a22de700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc69c13d060 0x7fc69c0a2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:48.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.693+0000 7fc6a1add700 1 -- 172.21.15.22:0/2620425359 learned_addr learned my addr 172.21.15.22:0/2620425359 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:48.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.694+0000 7fc6a1add700 1 -- 172.21.15.22:0/2620425359 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc69c067ed0 msgr2=0x7fc69c0a4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:48.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.694+0000 7fc6a1add700 1 --2- 172.21.15.22:0/2620425359 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc69c067ed0 0x7fc69c0a4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:48.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.694+0000 7fc6a1add700 1 -- 172.21.15.22:0/2620425359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc69c13d060 msgr2=0x7fc69c0a2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:48.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.694+0000 7fc6a1add700 1 --2- 172.21.15.22:0/2620425359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc69c13d060 0x7fc69c0a2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:48.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.694+0000 7fc6a1add700 1 -- 172.21.15.22:0/2620425359 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc698009300 con 0x7fc69c05e510 2022-04-28T14:41:48.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.694+0000 7fc6a22de700 1 --2- 172.21.15.22:0/2620425359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc69c13d060 0x7fc69c0a2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:48.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.694+0000 7fc6a12dc700 1 --2- 172.21.15.22:0/2620425359 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc69c067ed0 0x7fc69c0a4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:48.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.694+0000 7fc6a1add700 1 --2- 172.21.15.22:0/2620425359 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc69c05e510 0x7fc69c147440 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fc69800ea50 tx=0x7fc698009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:48.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.694+0000 7fc68dffb700 1 -- 172.21.15.22:0/2620425359 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc698005880 con 0x7fc69c05e510 2022-04-28T14:41:48.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.694+0000 7fc68dffb700 1 -- 172.21.15.22:0/2620425359 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6980059e0 con 0x7fc69c05e510 2022-04-28T14:41:48.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.694+0000 7fc6a3d41700 1 -- 172.21.15.22:0/2620425359 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc69400bc30 con 0x7fc69c05e510 2022-04-28T14:41:48.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.694+0000 7fc68dffb700 1 -- 172.21.15.22:0/2620425359 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc698005d60 con 0x7fc69c05e510 2022-04-28T14:41:48.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.694+0000 7fc6a3d41700 1 -- 172.21.15.22:0/2620425359 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc69c147930 con 0x7fc69c05e510 2022-04-28T14:41:48.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.695+0000 7fc68dffb700 1 -- 172.21.15.22:0/2620425359 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7fc698006230 con 0x7fc69c05e510 2022-04-28T14:41:48.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.695+0000 7fc68dffb700 1 -- 172.21.15.22:0/2620425359 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 3745+0+0 (secure 0 0 0) 0x7fc698055630 con 0x7fc69c05e510 2022-04-28T14:41:48.706 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.695+0000 7fc6a3d41700 1 -- 172.21.15.22:0/2620425359 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc69c0690e0 con 0x7fc69c05e510 2022-04-28T14:41:48.706 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.699+0000 7fc68dffb700 1 -- 172.21.15.22:0/2620425359 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7fc698016020 con 0x7fc69c05e510 2022-04-28T14:41:48.843 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.839+0000 7fc6a3d41700 1 -- 172.21.15.22:0/2620425359 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc69c06c350 con 0x7fc69c05e510 2022-04-28T14:41:48.844 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.839+0000 7fc68dffb700 1 -- 172.21.15.22:0/2620425359 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v34) v1 ==== 81+0+20852 (secure 0 0 0) 0x7fc698035e10 con 0x7fc69c05e510 2022-04-28T14:41:48.844 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:41:48.844 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2022-04-28T14:41:48.845 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 34, 2022-04-28T14:41:48.845 INFO:teuthology.orchestra.run.smithi022.stdout: "fsid": "3047163a-0285-4058-8e05-ce74c6fbb9c5", 2022-04-28T14:41:48.845 INFO:teuthology.orchestra.run.smithi022.stdout: "created": "2022-04-28T14:38:54.232890+0000", 2022-04-28T14:41:48.845 INFO:teuthology.orchestra.run.smithi022.stdout: "modified": "2022-04-28T14:41:48.026855+0000", 2022-04-28T14:41:48.845 INFO:teuthology.orchestra.run.smithi022.stdout: "last_up_change": "2022-04-28T14:41:44.899394+0000", 2022-04-28T14:41:48.845 INFO:teuthology.orchestra.run.smithi022.stdout: "last_in_change": "2022-04-28T14:39:00.269721+0000", 2022-04-28T14:41:48.845 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2022-04-28T14:41:48.845 INFO:teuthology.orchestra.run.smithi022.stdout: "flags_num": 5799936, 2022-04-28T14:41:48.845 INFO:teuthology.orchestra.run.smithi022.stdout: "flags_set": [ 2022-04-28T14:41:48.845 INFO:teuthology.orchestra.run.smithi022.stdout: "pglog_hardlimit", 2022-04-28T14:41:48.845 INFO:teuthology.orchestra.run.smithi022.stdout: "purged_snapdirs", 2022-04-28T14:41:48.846 INFO:teuthology.orchestra.run.smithi022.stdout: "recovery_deletes", 2022-04-28T14:41:48.846 INFO:teuthology.orchestra.run.smithi022.stdout: "sortbitwise" 2022-04-28T14:41:48.846 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2022-04-28T14:41:48.846 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_version": 8, 2022-04-28T14:41:48.846 INFO:teuthology.orchestra.run.smithi022.stdout: "full_ratio": 0.94999998807907104, 2022-04-28T14:41:48.846 INFO:teuthology.orchestra.run.smithi022.stdout: "backfillfull_ratio": 0.89999997615814209, 2022-04-28T14:41:48.846 INFO:teuthology.orchestra.run.smithi022.stdout: "nearfull_ratio": 0.85000002384185791, 2022-04-28T14:41:48.846 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_snapshot": "", 2022-04-28T14:41:48.846 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_max": 4, 2022-04-28T14:41:48.846 INFO:teuthology.orchestra.run.smithi022.stdout: "max_osd": 4, 2022-04-28T14:41:48.847 INFO:teuthology.orchestra.run.smithi022.stdout: "require_min_compat_client": "nautilus", 2022-04-28T14:41:48.847 INFO:teuthology.orchestra.run.smithi022.stdout: "min_compat_client": "jewel", 2022-04-28T14:41:48.847 INFO:teuthology.orchestra.run.smithi022.stdout: "require_osd_release": "nautilus", 2022-04-28T14:41:48.847 INFO:teuthology.orchestra.run.smithi022.stdout: "pools": [ 2022-04-28T14:41:48.847 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:41:48.847 INFO:teuthology.orchestra.run.smithi022.stdout: "pool": 1, 2022-04-28T14:41:48.847 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_name": "rbd", 2022-04-28T14:41:48.847 INFO:teuthology.orchestra.run.smithi022.stdout: "create_time": "2022-04-28T14:39:03.639717+0000", 2022-04-28T14:41:48.847 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2022-04-28T14:41:48.848 INFO:teuthology.orchestra.run.smithi022.stdout: "flags_names": "hashpspool", 2022-04-28T14:41:48.848 INFO:teuthology.orchestra.run.smithi022.stdout: "type": 1, 2022-04-28T14:41:48.848 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 2, 2022-04-28T14:41:48.848 INFO:teuthology.orchestra.run.smithi022.stdout: "min_size": 1, 2022-04-28T14:41:48.848 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_rule": 0, 2022-04-28T14:41:48.848 INFO:teuthology.orchestra.run.smithi022.stdout: "peering_crush_bucket_count": 0, 2022-04-28T14:41:48.848 INFO:teuthology.orchestra.run.smithi022.stdout: "peering_crush_bucket_target": 0, 2022-04-28T14:41:48.848 INFO:teuthology.orchestra.run.smithi022.stdout: "peering_crush_bucket_barrier": 0, 2022-04-28T14:41:48.848 INFO:teuthology.orchestra.run.smithi022.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2022-04-28T14:41:48.848 INFO:teuthology.orchestra.run.smithi022.stdout: "object_hash": 2, 2022-04-28T14:41:48.848 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscale_mode": "off", 2022-04-28T14:41:48.849 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num": 8, 2022-04-28T14:41:48.849 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_placement_num": 8, 2022-04-28T14:41:48.849 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_placement_num_target": 8, 2022-04-28T14:41:48.849 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num_target": 8, 2022-04-28T14:41:48.849 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num_pending": 8, 2022-04-28T14:41:48.849 INFO:teuthology.orchestra.run.smithi022.stdout: "last_pg_merge_meta": { 2022-04-28T14:41:48.849 INFO:teuthology.orchestra.run.smithi022.stdout: "source_pgid": "0.0", 2022-04-28T14:41:48.849 INFO:teuthology.orchestra.run.smithi022.stdout: "ready_epoch": 0, 2022-04-28T14:41:48.849 INFO:teuthology.orchestra.run.smithi022.stdout: "last_epoch_started": 0, 2022-04-28T14:41:48.849 INFO:teuthology.orchestra.run.smithi022.stdout: "last_epoch_clean": 0, 2022-04-28T14:41:48.850 INFO:teuthology.orchestra.run.smithi022.stdout: "source_version": "0'0", 2022-04-28T14:41:48.850 INFO:teuthology.orchestra.run.smithi022.stdout: "target_version": "0'0" 2022-04-28T14:41:48.850 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.850 INFO:teuthology.orchestra.run.smithi022.stdout: "last_change": "12", 2022-04-28T14:41:48.850 INFO:teuthology.orchestra.run.smithi022.stdout: "last_force_op_resend": "0", 2022-04-28T14:41:48.850 INFO:teuthology.orchestra.run.smithi022.stdout: "last_force_op_resend_prenautilus": "0", 2022-04-28T14:41:48.850 INFO:teuthology.orchestra.run.smithi022.stdout: "last_force_op_resend_preluminous": "0", 2022-04-28T14:41:48.850 INFO:teuthology.orchestra.run.smithi022.stdout: "auid": 0, 2022-04-28T14:41:48.850 INFO:teuthology.orchestra.run.smithi022.stdout: "snap_mode": "selfmanaged", 2022-04-28T14:41:48.850 INFO:teuthology.orchestra.run.smithi022.stdout: "snap_seq": 0, 2022-04-28T14:41:48.850 INFO:teuthology.orchestra.run.smithi022.stdout: "snap_epoch": 0, 2022-04-28T14:41:48.851 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_snaps": [], 2022-04-28T14:41:48.851 INFO:teuthology.orchestra.run.smithi022.stdout: "removed_snaps": "[]", 2022-04-28T14:41:48.851 INFO:teuthology.orchestra.run.smithi022.stdout: "quota_max_bytes": 0, 2022-04-28T14:41:48.851 INFO:teuthology.orchestra.run.smithi022.stdout: "quota_max_objects": 0, 2022-04-28T14:41:48.851 INFO:teuthology.orchestra.run.smithi022.stdout: "tiers": [], 2022-04-28T14:41:48.851 INFO:teuthology.orchestra.run.smithi022.stdout: "tier_of": -1, 2022-04-28T14:41:48.851 INFO:teuthology.orchestra.run.smithi022.stdout: "read_tier": -1, 2022-04-28T14:41:48.851 INFO:teuthology.orchestra.run.smithi022.stdout: "write_tier": -1, 2022-04-28T14:41:48.851 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_mode": "none", 2022-04-28T14:41:48.852 INFO:teuthology.orchestra.run.smithi022.stdout: "target_max_bytes": 0, 2022-04-28T14:41:48.852 INFO:teuthology.orchestra.run.smithi022.stdout: "target_max_objects": 0, 2022-04-28T14:41:48.852 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-04-28T14:41:48.852 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-04-28T14:41:48.852 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_target_full_ratio_micro": 800000, 2022-04-28T14:41:48.852 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_min_flush_age": 0, 2022-04-28T14:41:48.852 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_min_evict_age": 0, 2022-04-28T14:41:48.852 INFO:teuthology.orchestra.run.smithi022.stdout: "erasure_code_profile": "", 2022-04-28T14:41:48.852 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_params": { 2022-04-28T14:41:48.852 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "none" 2022-04-28T14:41:48.853 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.853 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_period": 0, 2022-04-28T14:41:48.853 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_count": 0, 2022-04-28T14:41:48.853 INFO:teuthology.orchestra.run.smithi022.stdout: "use_gmt_hitset": true, 2022-04-28T14:41:48.853 INFO:teuthology.orchestra.run.smithi022.stdout: "min_read_recency_for_promote": 0, 2022-04-28T14:41:48.853 INFO:teuthology.orchestra.run.smithi022.stdout: "min_write_recency_for_promote": 0, 2022-04-28T14:41:48.853 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_grade_decay_rate": 0, 2022-04-28T14:41:48.853 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_search_last_n": 0, 2022-04-28T14:41:48.853 INFO:teuthology.orchestra.run.smithi022.stdout: "grade_table": [], 2022-04-28T14:41:48.853 INFO:teuthology.orchestra.run.smithi022.stdout: "stripe_width": 0, 2022-04-28T14:41:48.853 INFO:teuthology.orchestra.run.smithi022.stdout: "expected_num_objects": 0, 2022-04-28T14:41:48.854 INFO:teuthology.orchestra.run.smithi022.stdout: "fast_read": false, 2022-04-28T14:41:48.854 INFO:teuthology.orchestra.run.smithi022.stdout: "options": {}, 2022-04-28T14:41:48.854 INFO:teuthology.orchestra.run.smithi022.stdout: "application_metadata": { 2022-04-28T14:41:48.854 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd": {} 2022-04-28T14:41:48.854 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:41:48.854 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.854 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:41:48.854 INFO:teuthology.orchestra.run.smithi022.stdout: "pool": 2, 2022-04-28T14:41:48.854 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_name": "cephfs_metadata", 2022-04-28T14:41:48.854 INFO:teuthology.orchestra.run.smithi022.stdout: "create_time": "2022-04-28T14:39:12.000229+0000", 2022-04-28T14:41:48.855 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2022-04-28T14:41:48.855 INFO:teuthology.orchestra.run.smithi022.stdout: "flags_names": "hashpspool", 2022-04-28T14:41:48.855 INFO:teuthology.orchestra.run.smithi022.stdout: "type": 1, 2022-04-28T14:41:48.855 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 2, 2022-04-28T14:41:48.855 INFO:teuthology.orchestra.run.smithi022.stdout: "min_size": 1, 2022-04-28T14:41:48.855 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_rule": 0, 2022-04-28T14:41:48.855 INFO:teuthology.orchestra.run.smithi022.stdout: "peering_crush_bucket_count": 0, 2022-04-28T14:41:48.855 INFO:teuthology.orchestra.run.smithi022.stdout: "peering_crush_bucket_target": 0, 2022-04-28T14:41:48.855 INFO:teuthology.orchestra.run.smithi022.stdout: "peering_crush_bucket_barrier": 0, 2022-04-28T14:41:48.855 INFO:teuthology.orchestra.run.smithi022.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2022-04-28T14:41:48.856 INFO:teuthology.orchestra.run.smithi022.stdout: "object_hash": 2, 2022-04-28T14:41:48.856 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscale_mode": "off", 2022-04-28T14:41:48.856 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num": 64, 2022-04-28T14:41:48.856 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_placement_num": 64, 2022-04-28T14:41:48.856 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_placement_num_target": 64, 2022-04-28T14:41:48.856 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num_target": 64, 2022-04-28T14:41:48.856 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num_pending": 64, 2022-04-28T14:41:48.856 INFO:teuthology.orchestra.run.smithi022.stdout: "last_pg_merge_meta": { 2022-04-28T14:41:48.856 INFO:teuthology.orchestra.run.smithi022.stdout: "source_pgid": "0.0", 2022-04-28T14:41:48.856 INFO:teuthology.orchestra.run.smithi022.stdout: "ready_epoch": 0, 2022-04-28T14:41:48.856 INFO:teuthology.orchestra.run.smithi022.stdout: "last_epoch_started": 0, 2022-04-28T14:41:48.857 INFO:teuthology.orchestra.run.smithi022.stdout: "last_epoch_clean": 0, 2022-04-28T14:41:48.857 INFO:teuthology.orchestra.run.smithi022.stdout: "source_version": "0'0", 2022-04-28T14:41:48.857 INFO:teuthology.orchestra.run.smithi022.stdout: "target_version": "0'0" 2022-04-28T14:41:48.857 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.857 INFO:teuthology.orchestra.run.smithi022.stdout: "last_change": "15", 2022-04-28T14:41:48.857 INFO:teuthology.orchestra.run.smithi022.stdout: "last_force_op_resend": "0", 2022-04-28T14:41:48.857 INFO:teuthology.orchestra.run.smithi022.stdout: "last_force_op_resend_prenautilus": "0", 2022-04-28T14:41:48.857 INFO:teuthology.orchestra.run.smithi022.stdout: "last_force_op_resend_preluminous": "0", 2022-04-28T14:41:48.857 INFO:teuthology.orchestra.run.smithi022.stdout: "auid": 0, 2022-04-28T14:41:48.857 INFO:teuthology.orchestra.run.smithi022.stdout: "snap_mode": "selfmanaged", 2022-04-28T14:41:48.858 INFO:teuthology.orchestra.run.smithi022.stdout: "snap_seq": 0, 2022-04-28T14:41:48.858 INFO:teuthology.orchestra.run.smithi022.stdout: "snap_epoch": 0, 2022-04-28T14:41:48.858 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_snaps": [], 2022-04-28T14:41:48.858 INFO:teuthology.orchestra.run.smithi022.stdout: "removed_snaps": "[]", 2022-04-28T14:41:48.858 INFO:teuthology.orchestra.run.smithi022.stdout: "quota_max_bytes": 0, 2022-04-28T14:41:48.858 INFO:teuthology.orchestra.run.smithi022.stdout: "quota_max_objects": 0, 2022-04-28T14:41:48.858 INFO:teuthology.orchestra.run.smithi022.stdout: "tiers": [], 2022-04-28T14:41:48.858 INFO:teuthology.orchestra.run.smithi022.stdout: "tier_of": -1, 2022-04-28T14:41:48.858 INFO:teuthology.orchestra.run.smithi022.stdout: "read_tier": -1, 2022-04-28T14:41:48.858 INFO:teuthology.orchestra.run.smithi022.stdout: "write_tier": -1, 2022-04-28T14:41:48.859 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_mode": "none", 2022-04-28T14:41:48.859 INFO:teuthology.orchestra.run.smithi022.stdout: "target_max_bytes": 0, 2022-04-28T14:41:48.859 INFO:teuthology.orchestra.run.smithi022.stdout: "target_max_objects": 0, 2022-04-28T14:41:48.859 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-04-28T14:41:48.859 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-04-28T14:41:48.859 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_target_full_ratio_micro": 800000, 2022-04-28T14:41:48.859 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_min_flush_age": 0, 2022-04-28T14:41:48.859 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_min_evict_age": 0, 2022-04-28T14:41:48.859 INFO:teuthology.orchestra.run.smithi022.stdout: "erasure_code_profile": "", 2022-04-28T14:41:48.859 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_params": { 2022-04-28T14:41:48.860 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "none" 2022-04-28T14:41:48.860 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.860 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_period": 0, 2022-04-28T14:41:48.860 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_count": 0, 2022-04-28T14:41:48.860 INFO:teuthology.orchestra.run.smithi022.stdout: "use_gmt_hitset": true, 2022-04-28T14:41:48.860 INFO:teuthology.orchestra.run.smithi022.stdout: "min_read_recency_for_promote": 0, 2022-04-28T14:41:48.860 INFO:teuthology.orchestra.run.smithi022.stdout: "min_write_recency_for_promote": 0, 2022-04-28T14:41:48.860 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_grade_decay_rate": 0, 2022-04-28T14:41:48.860 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_search_last_n": 0, 2022-04-28T14:41:48.860 INFO:teuthology.orchestra.run.smithi022.stdout: "grade_table": [], 2022-04-28T14:41:48.861 INFO:teuthology.orchestra.run.smithi022.stdout: "stripe_width": 0, 2022-04-28T14:41:48.861 INFO:teuthology.orchestra.run.smithi022.stdout: "expected_num_objects": 0, 2022-04-28T14:41:48.861 INFO:teuthology.orchestra.run.smithi022.stdout: "fast_read": false, 2022-04-28T14:41:48.861 INFO:teuthology.orchestra.run.smithi022.stdout: "options": { 2022-04-28T14:41:48.861 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscale_bias": 4, 2022-04-28T14:41:48.861 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num_min": 16, 2022-04-28T14:41:48.861 INFO:teuthology.orchestra.run.smithi022.stdout: "recovery_priority": 5 2022-04-28T14:41:48.861 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.861 INFO:teuthology.orchestra.run.smithi022.stdout: "application_metadata": { 2022-04-28T14:41:48.861 INFO:teuthology.orchestra.run.smithi022.stdout: "cephfs": { 2022-04-28T14:41:48.861 INFO:teuthology.orchestra.run.smithi022.stdout: "metadata": "cephfs" 2022-04-28T14:41:48.862 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:41:48.862 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:41:48.862 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.862 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:41:48.862 INFO:teuthology.orchestra.run.smithi022.stdout: "pool": 3, 2022-04-28T14:41:48.862 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_name": "cephfs_data", 2022-04-28T14:41:48.862 INFO:teuthology.orchestra.run.smithi022.stdout: "create_time": "2022-04-28T14:39:12.915097+0000", 2022-04-28T14:41:48.862 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2022-04-28T14:41:48.862 INFO:teuthology.orchestra.run.smithi022.stdout: "flags_names": "hashpspool", 2022-04-28T14:41:48.863 INFO:teuthology.orchestra.run.smithi022.stdout: "type": 1, 2022-04-28T14:41:48.863 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 2, 2022-04-28T14:41:48.863 INFO:teuthology.orchestra.run.smithi022.stdout: "min_size": 1, 2022-04-28T14:41:48.863 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_rule": 0, 2022-04-28T14:41:48.863 INFO:teuthology.orchestra.run.smithi022.stdout: "peering_crush_bucket_count": 0, 2022-04-28T14:41:48.863 INFO:teuthology.orchestra.run.smithi022.stdout: "peering_crush_bucket_target": 0, 2022-04-28T14:41:48.863 INFO:teuthology.orchestra.run.smithi022.stdout: "peering_crush_bucket_barrier": 0, 2022-04-28T14:41:48.863 INFO:teuthology.orchestra.run.smithi022.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2022-04-28T14:41:48.863 INFO:teuthology.orchestra.run.smithi022.stdout: "object_hash": 2, 2022-04-28T14:41:48.863 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscale_mode": "off", 2022-04-28T14:41:48.864 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num": 64, 2022-04-28T14:41:48.864 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_placement_num": 64, 2022-04-28T14:41:48.864 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_placement_num_target": 64, 2022-04-28T14:41:48.864 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num_target": 64, 2022-04-28T14:41:48.864 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num_pending": 64, 2022-04-28T14:41:48.864 INFO:teuthology.orchestra.run.smithi022.stdout: "last_pg_merge_meta": { 2022-04-28T14:41:48.864 INFO:teuthology.orchestra.run.smithi022.stdout: "source_pgid": "0.0", 2022-04-28T14:41:48.864 INFO:teuthology.orchestra.run.smithi022.stdout: "ready_epoch": 0, 2022-04-28T14:41:48.864 INFO:teuthology.orchestra.run.smithi022.stdout: "last_epoch_started": 0, 2022-04-28T14:41:48.864 INFO:teuthology.orchestra.run.smithi022.stdout: "last_epoch_clean": 0, 2022-04-28T14:41:48.864 INFO:teuthology.orchestra.run.smithi022.stdout: "source_version": "0'0", 2022-04-28T14:41:48.865 INFO:teuthology.orchestra.run.smithi022.stdout: "target_version": "0'0" 2022-04-28T14:41:48.865 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.865 INFO:teuthology.orchestra.run.smithi022.stdout: "last_change": "16", 2022-04-28T14:41:48.865 INFO:teuthology.orchestra.run.smithi022.stdout: "last_force_op_resend": "0", 2022-04-28T14:41:48.865 INFO:teuthology.orchestra.run.smithi022.stdout: "last_force_op_resend_prenautilus": "0", 2022-04-28T14:41:48.865 INFO:teuthology.orchestra.run.smithi022.stdout: "last_force_op_resend_preluminous": "0", 2022-04-28T14:41:48.865 INFO:teuthology.orchestra.run.smithi022.stdout: "auid": 0, 2022-04-28T14:41:48.865 INFO:teuthology.orchestra.run.smithi022.stdout: "snap_mode": "selfmanaged", 2022-04-28T14:41:48.865 INFO:teuthology.orchestra.run.smithi022.stdout: "snap_seq": 0, 2022-04-28T14:41:48.865 INFO:teuthology.orchestra.run.smithi022.stdout: "snap_epoch": 0, 2022-04-28T14:41:48.866 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_snaps": [], 2022-04-28T14:41:48.866 INFO:teuthology.orchestra.run.smithi022.stdout: "removed_snaps": "[]", 2022-04-28T14:41:48.866 INFO:teuthology.orchestra.run.smithi022.stdout: "quota_max_bytes": 0, 2022-04-28T14:41:48.866 INFO:teuthology.orchestra.run.smithi022.stdout: "quota_max_objects": 0, 2022-04-28T14:41:48.866 INFO:teuthology.orchestra.run.smithi022.stdout: "tiers": [], 2022-04-28T14:41:48.866 INFO:teuthology.orchestra.run.smithi022.stdout: "tier_of": -1, 2022-04-28T14:41:48.866 INFO:teuthology.orchestra.run.smithi022.stdout: "read_tier": -1, 2022-04-28T14:41:48.866 INFO:teuthology.orchestra.run.smithi022.stdout: "write_tier": -1, 2022-04-28T14:41:48.866 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_mode": "none", 2022-04-28T14:41:48.866 INFO:teuthology.orchestra.run.smithi022.stdout: "target_max_bytes": 0, 2022-04-28T14:41:48.867 INFO:teuthology.orchestra.run.smithi022.stdout: "target_max_objects": 0, 2022-04-28T14:41:48.867 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-04-28T14:41:48.867 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-04-28T14:41:48.867 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_target_full_ratio_micro": 800000, 2022-04-28T14:41:48.867 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_min_flush_age": 0, 2022-04-28T14:41:48.867 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_min_evict_age": 0, 2022-04-28T14:41:48.867 INFO:teuthology.orchestra.run.smithi022.stdout: "erasure_code_profile": "", 2022-04-28T14:41:48.867 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_params": { 2022-04-28T14:41:48.867 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "none" 2022-04-28T14:41:48.867 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.868 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_period": 0, 2022-04-28T14:41:48.868 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_count": 0, 2022-04-28T14:41:48.868 INFO:teuthology.orchestra.run.smithi022.stdout: "use_gmt_hitset": true, 2022-04-28T14:41:48.868 INFO:teuthology.orchestra.run.smithi022.stdout: "min_read_recency_for_promote": 0, 2022-04-28T14:41:48.868 INFO:teuthology.orchestra.run.smithi022.stdout: "min_write_recency_for_promote": 0, 2022-04-28T14:41:48.868 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_grade_decay_rate": 0, 2022-04-28T14:41:48.868 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_search_last_n": 0, 2022-04-28T14:41:48.868 INFO:teuthology.orchestra.run.smithi022.stdout: "grade_table": [], 2022-04-28T14:41:48.868 INFO:teuthology.orchestra.run.smithi022.stdout: "stripe_width": 0, 2022-04-28T14:41:48.868 INFO:teuthology.orchestra.run.smithi022.stdout: "expected_num_objects": 0, 2022-04-28T14:41:48.868 INFO:teuthology.orchestra.run.smithi022.stdout: "fast_read": false, 2022-04-28T14:41:48.869 INFO:teuthology.orchestra.run.smithi022.stdout: "options": { 2022-04-28T14:41:48.869 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num_min": 64, 2022-04-28T14:41:48.869 INFO:teuthology.orchestra.run.smithi022.stdout: "target_size_ratio": 0.89999997615814209 2022-04-28T14:41:48.869 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.869 INFO:teuthology.orchestra.run.smithi022.stdout: "application_metadata": { 2022-04-28T14:41:48.869 INFO:teuthology.orchestra.run.smithi022.stdout: "cephfs": { 2022-04-28T14:41:48.869 INFO:teuthology.orchestra.run.smithi022.stdout: "data": "cephfs" 2022-04-28T14:41:48.869 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:41:48.869 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:41:48.869 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.870 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:41:48.870 INFO:teuthology.orchestra.run.smithi022.stdout: "pool": 4, 2022-04-28T14:41:48.870 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_name": "device_health_metrics", 2022-04-28T14:41:48.870 INFO:teuthology.orchestra.run.smithi022.stdout: "create_time": "2022-04-28T14:41:25.197740+0000", 2022-04-28T14:41:48.870 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2022-04-28T14:41:48.870 INFO:teuthology.orchestra.run.smithi022.stdout: "flags_names": "hashpspool", 2022-04-28T14:41:48.870 INFO:teuthology.orchestra.run.smithi022.stdout: "type": 1, 2022-04-28T14:41:48.870 INFO:teuthology.orchestra.run.smithi022.stdout: "size": 2, 2022-04-28T14:41:48.870 INFO:teuthology.orchestra.run.smithi022.stdout: "min_size": 1, 2022-04-28T14:41:48.870 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_rule": 0, 2022-04-28T14:41:48.871 INFO:teuthology.orchestra.run.smithi022.stdout: "peering_crush_bucket_count": 0, 2022-04-28T14:41:48.871 INFO:teuthology.orchestra.run.smithi022.stdout: "peering_crush_bucket_target": 0, 2022-04-28T14:41:48.871 INFO:teuthology.orchestra.run.smithi022.stdout: "peering_crush_bucket_barrier": 0, 2022-04-28T14:41:48.871 INFO:teuthology.orchestra.run.smithi022.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2022-04-28T14:41:48.871 INFO:teuthology.orchestra.run.smithi022.stdout: "object_hash": 2, 2022-04-28T14:41:48.871 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscale_mode": "off", 2022-04-28T14:41:48.871 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num": 1, 2022-04-28T14:41:48.871 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_placement_num": 1, 2022-04-28T14:41:48.871 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_placement_num_target": 1, 2022-04-28T14:41:48.871 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num_target": 1, 2022-04-28T14:41:48.872 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num_pending": 1, 2022-04-28T14:41:48.872 INFO:teuthology.orchestra.run.smithi022.stdout: "last_pg_merge_meta": { 2022-04-28T14:41:48.872 INFO:teuthology.orchestra.run.smithi022.stdout: "source_pgid": "0.0", 2022-04-28T14:41:48.872 INFO:teuthology.orchestra.run.smithi022.stdout: "ready_epoch": 0, 2022-04-28T14:41:48.872 INFO:teuthology.orchestra.run.smithi022.stdout: "last_epoch_started": 0, 2022-04-28T14:41:48.872 INFO:teuthology.orchestra.run.smithi022.stdout: "last_epoch_clean": 0, 2022-04-28T14:41:48.872 INFO:teuthology.orchestra.run.smithi022.stdout: "source_version": "0'0", 2022-04-28T14:41:48.872 INFO:teuthology.orchestra.run.smithi022.stdout: "target_version": "0'0" 2022-04-28T14:41:48.872 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.872 INFO:teuthology.orchestra.run.smithi022.stdout: "last_change": "21", 2022-04-28T14:41:48.873 INFO:teuthology.orchestra.run.smithi022.stdout: "last_force_op_resend": "0", 2022-04-28T14:41:48.873 INFO:teuthology.orchestra.run.smithi022.stdout: "last_force_op_resend_prenautilus": "0", 2022-04-28T14:41:48.873 INFO:teuthology.orchestra.run.smithi022.stdout: "last_force_op_resend_preluminous": "0", 2022-04-28T14:41:48.873 INFO:teuthology.orchestra.run.smithi022.stdout: "auid": 0, 2022-04-28T14:41:48.873 INFO:teuthology.orchestra.run.smithi022.stdout: "snap_mode": "selfmanaged", 2022-04-28T14:41:48.873 INFO:teuthology.orchestra.run.smithi022.stdout: "snap_seq": 0, 2022-04-28T14:41:48.873 INFO:teuthology.orchestra.run.smithi022.stdout: "snap_epoch": 0, 2022-04-28T14:41:48.873 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_snaps": [], 2022-04-28T14:41:48.873 INFO:teuthology.orchestra.run.smithi022.stdout: "removed_snaps": "[]", 2022-04-28T14:41:48.873 INFO:teuthology.orchestra.run.smithi022.stdout: "quota_max_bytes": 0, 2022-04-28T14:41:48.874 INFO:teuthology.orchestra.run.smithi022.stdout: "quota_max_objects": 0, 2022-04-28T14:41:48.874 INFO:teuthology.orchestra.run.smithi022.stdout: "tiers": [], 2022-04-28T14:41:48.874 INFO:teuthology.orchestra.run.smithi022.stdout: "tier_of": -1, 2022-04-28T14:41:48.874 INFO:teuthology.orchestra.run.smithi022.stdout: "read_tier": -1, 2022-04-28T14:41:48.874 INFO:teuthology.orchestra.run.smithi022.stdout: "write_tier": -1, 2022-04-28T14:41:48.874 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_mode": "none", 2022-04-28T14:41:48.874 INFO:teuthology.orchestra.run.smithi022.stdout: "target_max_bytes": 0, 2022-04-28T14:41:48.874 INFO:teuthology.orchestra.run.smithi022.stdout: "target_max_objects": 0, 2022-04-28T14:41:48.874 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-04-28T14:41:48.874 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-04-28T14:41:48.875 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_target_full_ratio_micro": 800000, 2022-04-28T14:41:48.875 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_min_flush_age": 0, 2022-04-28T14:41:48.875 INFO:teuthology.orchestra.run.smithi022.stdout: "cache_min_evict_age": 0, 2022-04-28T14:41:48.875 INFO:teuthology.orchestra.run.smithi022.stdout: "erasure_code_profile": "", 2022-04-28T14:41:48.875 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_params": { 2022-04-28T14:41:48.875 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "none" 2022-04-28T14:41:48.875 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.875 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_period": 0, 2022-04-28T14:41:48.875 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_count": 0, 2022-04-28T14:41:48.875 INFO:teuthology.orchestra.run.smithi022.stdout: "use_gmt_hitset": true, 2022-04-28T14:41:48.876 INFO:teuthology.orchestra.run.smithi022.stdout: "min_read_recency_for_promote": 0, 2022-04-28T14:41:48.876 INFO:teuthology.orchestra.run.smithi022.stdout: "min_write_recency_for_promote": 0, 2022-04-28T14:41:48.876 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_grade_decay_rate": 0, 2022-04-28T14:41:48.876 INFO:teuthology.orchestra.run.smithi022.stdout: "hit_set_search_last_n": 0, 2022-04-28T14:41:48.876 INFO:teuthology.orchestra.run.smithi022.stdout: "grade_table": [], 2022-04-28T14:41:48.876 INFO:teuthology.orchestra.run.smithi022.stdout: "stripe_width": 0, 2022-04-28T14:41:48.876 INFO:teuthology.orchestra.run.smithi022.stdout: "expected_num_objects": 0, 2022-04-28T14:41:48.876 INFO:teuthology.orchestra.run.smithi022.stdout: "fast_read": false, 2022-04-28T14:41:48.876 INFO:teuthology.orchestra.run.smithi022.stdout: "options": { 2022-04-28T14:41:48.876 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num_min": 1 2022-04-28T14:41:48.876 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.877 INFO:teuthology.orchestra.run.smithi022.stdout: "application_metadata": { 2022-04-28T14:41:48.877 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_devicehealth": {} 2022-04-28T14:41:48.877 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:41:48.877 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:41:48.877 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2022-04-28T14:41:48.877 INFO:teuthology.orchestra.run.smithi022.stdout: "osds": [ 2022-04-28T14:41:48.877 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:41:48.877 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 0, 2022-04-28T14:41:48.877 INFO:teuthology.orchestra.run.smithi022.stdout: "uuid": "782ee638-1ada-48d9-9454-f9e0ca8a3135", 2022-04-28T14:41:48.877 INFO:teuthology.orchestra.run.smithi022.stdout: "up": 1, 2022-04-28T14:41:48.878 INFO:teuthology.orchestra.run.smithi022.stdout: "in": 1, 2022-04-28T14:41:48.878 INFO:teuthology.orchestra.run.smithi022.stdout: "weight": 1, 2022-04-28T14:41:48.878 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity": 1, 2022-04-28T14:41:48.878 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_begin": 9, 2022-04-28T14:41:48.878 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_end": 21, 2022-04-28T14:41:48.878 INFO:teuthology.orchestra.run.smithi022.stdout: "up_from": 27, 2022-04-28T14:41:48.878 INFO:teuthology.orchestra.run.smithi022.stdout: "up_thru": 30, 2022-04-28T14:41:48.878 INFO:teuthology.orchestra.run.smithi022.stdout: "down_at": 22, 2022-04-28T14:41:48.878 INFO:teuthology.orchestra.run.smithi022.stdout: "lost_at": 0, 2022-04-28T14:41:48.878 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrs": { 2022-04-28T14:41:48.879 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2022-04-28T14:41:48.879 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:41:48.879 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2022-04-28T14:41:48.879 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6800", 2022-04-28T14:41:48.879 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 94303 2022-04-28T14:41:48.879 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:41:48.879 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2022-04-28T14:41:48.879 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.879 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addrs": { 2022-04-28T14:41:48.879 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2022-04-28T14:41:48.880 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:41:48.880 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2022-04-28T14:41:48.880 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6801", 2022-04-28T14:41:48.880 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 94303 2022-04-28T14:41:48.880 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:41:48.880 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2022-04-28T14:41:48.880 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.880 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addrs": { 2022-04-28T14:41:48.880 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2022-04-28T14:41:48.880 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:41:48.881 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2022-04-28T14:41:48.881 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6803", 2022-04-28T14:41:48.881 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 94303 2022-04-28T14:41:48.881 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:41:48.881 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2022-04-28T14:41:48.881 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.881 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addrs": { 2022-04-28T14:41:48.881 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2022-04-28T14:41:48.881 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:41:48.881 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2022-04-28T14:41:48.882 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6802", 2022-04-28T14:41:48.882 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 94303 2022-04-28T14:41:48.882 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:41:48.882 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2022-04-28T14:41:48.882 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.882 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "172.21.15.22:6800/94303", 2022-04-28T14:41:48.882 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "172.21.15.22:6801/94303", 2022-04-28T14:41:48.882 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addr": "172.21.15.22:6803/94303", 2022-04-28T14:41:48.882 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addr": "172.21.15.22:6802/94303", 2022-04-28T14:41:48.882 INFO:teuthology.orchestra.run.smithi022.stdout: "state": [ 2022-04-28T14:41:48.883 INFO:teuthology.orchestra.run.smithi022.stdout: "exists", 2022-04-28T14:41:48.883 INFO:teuthology.orchestra.run.smithi022.stdout: "up" 2022-04-28T14:41:48.883 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2022-04-28T14:41:48.883 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.883 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:41:48.883 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 1, 2022-04-28T14:41:48.883 INFO:teuthology.orchestra.run.smithi022.stdout: "uuid": "61ca6f96-fb4f-4c0f-b68b-edf1e7011f1c", 2022-04-28T14:41:48.883 INFO:teuthology.orchestra.run.smithi022.stdout: "up": 1, 2022-04-28T14:41:48.883 INFO:teuthology.orchestra.run.smithi022.stdout: "in": 1, 2022-04-28T14:41:48.883 INFO:teuthology.orchestra.run.smithi022.stdout: "weight": 1, 2022-04-28T14:41:48.884 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity": 1, 2022-04-28T14:41:48.884 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_begin": 9, 2022-04-28T14:41:48.884 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_end": 22, 2022-04-28T14:41:48.884 INFO:teuthology.orchestra.run.smithi022.stdout: "up_from": 28, 2022-04-28T14:41:48.884 INFO:teuthology.orchestra.run.smithi022.stdout: "up_thru": 30, 2022-04-28T14:41:48.884 INFO:teuthology.orchestra.run.smithi022.stdout: "down_at": 23, 2022-04-28T14:41:48.884 INFO:teuthology.orchestra.run.smithi022.stdout: "lost_at": 0, 2022-04-28T14:41:48.884 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrs": { 2022-04-28T14:41:48.884 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2022-04-28T14:41:48.884 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:41:48.885 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2022-04-28T14:41:48.885 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6804", 2022-04-28T14:41:48.885 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 94391 2022-04-28T14:41:48.885 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:41:48.885 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2022-04-28T14:41:48.885 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.885 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addrs": { 2022-04-28T14:41:48.885 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2022-04-28T14:41:48.885 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:41:48.885 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2022-04-28T14:41:48.886 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6805", 2022-04-28T14:41:48.886 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 94391 2022-04-28T14:41:48.886 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:41:48.886 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2022-04-28T14:41:48.886 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.886 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addrs": { 2022-04-28T14:41:48.886 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2022-04-28T14:41:48.886 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:41:48.886 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2022-04-28T14:41:48.886 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6807", 2022-04-28T14:41:48.887 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 94391 2022-04-28T14:41:48.887 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:41:48.887 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2022-04-28T14:41:48.887 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.887 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addrs": { 2022-04-28T14:41:48.887 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2022-04-28T14:41:48.887 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:41:48.887 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2022-04-28T14:41:48.887 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6806", 2022-04-28T14:41:48.887 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 94391 2022-04-28T14:41:48.888 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:41:48.888 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2022-04-28T14:41:48.888 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.888 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "172.21.15.22:6804/94391", 2022-04-28T14:41:48.888 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "172.21.15.22:6805/94391", 2022-04-28T14:41:48.888 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addr": "172.21.15.22:6807/94391", 2022-04-28T14:41:48.888 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addr": "172.21.15.22:6806/94391", 2022-04-28T14:41:48.888 INFO:teuthology.orchestra.run.smithi022.stdout: "state": [ 2022-04-28T14:41:48.888 INFO:teuthology.orchestra.run.smithi022.stdout: "exists", 2022-04-28T14:41:48.889 INFO:teuthology.orchestra.run.smithi022.stdout: "up" 2022-04-28T14:41:48.889 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2022-04-28T14:41:48.889 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.889 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:41:48.889 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 2, 2022-04-28T14:41:48.889 INFO:teuthology.orchestra.run.smithi022.stdout: "uuid": "4b3043b9-50df-4b7f-a55a-ac8e6148c449", 2022-04-28T14:41:48.889 INFO:teuthology.orchestra.run.smithi022.stdout: "up": 1, 2022-04-28T14:41:48.889 INFO:teuthology.orchestra.run.smithi022.stdout: "in": 1, 2022-04-28T14:41:48.889 INFO:teuthology.orchestra.run.smithi022.stdout: "weight": 1, 2022-04-28T14:41:48.889 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity": 1, 2022-04-28T14:41:48.890 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_begin": 9, 2022-04-28T14:41:48.890 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_end": 23, 2022-04-28T14:41:48.890 INFO:teuthology.orchestra.run.smithi022.stdout: "up_from": 29, 2022-04-28T14:41:48.890 INFO:teuthology.orchestra.run.smithi022.stdout: "up_thru": 30, 2022-04-28T14:41:48.890 INFO:teuthology.orchestra.run.smithi022.stdout: "down_at": 24, 2022-04-28T14:41:48.890 INFO:teuthology.orchestra.run.smithi022.stdout: "lost_at": 0, 2022-04-28T14:41:48.890 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrs": { 2022-04-28T14:41:48.890 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2022-04-28T14:41:48.890 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:41:48.890 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2022-04-28T14:41:48.891 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6809", 2022-04-28T14:41:48.891 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 94493 2022-04-28T14:41:48.891 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:41:48.891 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2022-04-28T14:41:48.891 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.891 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addrs": { 2022-04-28T14:41:48.891 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2022-04-28T14:41:48.891 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:41:48.891 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2022-04-28T14:41:48.891 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6810", 2022-04-28T14:41:48.892 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 94493 2022-04-28T14:41:48.892 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:41:48.892 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2022-04-28T14:41:48.892 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.892 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addrs": { 2022-04-28T14:41:48.892 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2022-04-28T14:41:48.892 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:41:48.892 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2022-04-28T14:41:48.892 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6812", 2022-04-28T14:41:48.892 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 94493 2022-04-28T14:41:48.893 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:41:48.893 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2022-04-28T14:41:48.893 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.893 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addrs": { 2022-04-28T14:41:48.893 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2022-04-28T14:41:48.893 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:41:48.893 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2022-04-28T14:41:48.893 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6811", 2022-04-28T14:41:48.894 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 94493 2022-04-28T14:41:48.894 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:41:48.894 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2022-04-28T14:41:48.894 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.894 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "172.21.15.22:6809/94493", 2022-04-28T14:41:48.894 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "172.21.15.22:6810/94493", 2022-04-28T14:41:48.894 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addr": "172.21.15.22:6812/94493", 2022-04-28T14:41:48.894 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addr": "172.21.15.22:6811/94493", 2022-04-28T14:41:48.894 INFO:teuthology.orchestra.run.smithi022.stdout: "state": [ 2022-04-28T14:41:48.894 INFO:teuthology.orchestra.run.smithi022.stdout: "exists", 2022-04-28T14:41:48.895 INFO:teuthology.orchestra.run.smithi022.stdout: "up" 2022-04-28T14:41:48.895 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2022-04-28T14:41:48.895 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.895 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:41:48.895 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 3, 2022-04-28T14:41:48.895 INFO:teuthology.orchestra.run.smithi022.stdout: "uuid": "7807bcd1-53f8-44b5-9992-57c328e5b299", 2022-04-28T14:41:48.895 INFO:teuthology.orchestra.run.smithi022.stdout: "up": 1, 2022-04-28T14:41:48.895 INFO:teuthology.orchestra.run.smithi022.stdout: "in": 1, 2022-04-28T14:41:48.895 INFO:teuthology.orchestra.run.smithi022.stdout: "weight": 1, 2022-04-28T14:41:48.895 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_affinity": 1, 2022-04-28T14:41:48.896 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_begin": 9, 2022-04-28T14:41:48.896 INFO:teuthology.orchestra.run.smithi022.stdout: "last_clean_end": 24, 2022-04-28T14:41:48.896 INFO:teuthology.orchestra.run.smithi022.stdout: "up_from": 30, 2022-04-28T14:41:48.896 INFO:teuthology.orchestra.run.smithi022.stdout: "up_thru": 30, 2022-04-28T14:41:48.896 INFO:teuthology.orchestra.run.smithi022.stdout: "down_at": 25, 2022-04-28T14:41:48.896 INFO:teuthology.orchestra.run.smithi022.stdout: "lost_at": 0, 2022-04-28T14:41:48.896 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addrs": { 2022-04-28T14:41:48.896 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2022-04-28T14:41:48.896 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:41:48.896 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2022-04-28T14:41:48.897 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6813", 2022-04-28T14:41:48.897 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 94624 2022-04-28T14:41:48.897 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:41:48.897 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2022-04-28T14:41:48.897 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.897 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addrs": { 2022-04-28T14:41:48.897 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2022-04-28T14:41:48.897 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:41:48.897 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2022-04-28T14:41:48.897 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6814", 2022-04-28T14:41:48.898 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 94624 2022-04-28T14:41:48.898 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:41:48.898 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2022-04-28T14:41:48.898 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.898 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addrs": { 2022-04-28T14:41:48.898 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2022-04-28T14:41:48.898 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:41:48.898 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2022-04-28T14:41:48.898 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6816", 2022-04-28T14:41:48.898 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 94624 2022-04-28T14:41:48.899 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:41:48.899 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2022-04-28T14:41:48.899 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.899 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addrs": { 2022-04-28T14:41:48.899 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2022-04-28T14:41:48.899 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:41:48.899 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2022-04-28T14:41:48.899 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6815", 2022-04-28T14:41:48.899 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 94624 2022-04-28T14:41:48.899 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:41:48.900 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2022-04-28T14:41:48.900 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.900 INFO:teuthology.orchestra.run.smithi022.stdout: "public_addr": "172.21.15.22:6813/94624", 2022-04-28T14:41:48.900 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_addr": "172.21.15.22:6814/94624", 2022-04-28T14:41:48.900 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_back_addr": "172.21.15.22:6816/94624", 2022-04-28T14:41:48.900 INFO:teuthology.orchestra.run.smithi022.stdout: "heartbeat_front_addr": "172.21.15.22:6815/94624", 2022-04-28T14:41:48.900 INFO:teuthology.orchestra.run.smithi022.stdout: "state": [ 2022-04-28T14:41:48.900 INFO:teuthology.orchestra.run.smithi022.stdout: "exists", 2022-04-28T14:41:48.900 INFO:teuthology.orchestra.run.smithi022.stdout: "up" 2022-04-28T14:41:48.900 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2022-04-28T14:41:48.900 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:41:48.901 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2022-04-28T14:41:48.901 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_xinfo": [ 2022-04-28T14:41:48.901 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:41:48.901 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 0, 2022-04-28T14:41:48.901 INFO:teuthology.orchestra.run.smithi022.stdout: "down_stamp": "0.000000", 2022-04-28T14:41:48.901 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_probability": 0, 2022-04-28T14:41:48.901 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_interval": 0, 2022-04-28T14:41:48.901 INFO:teuthology.orchestra.run.smithi022.stdout: "features": 4540138297136906239, 2022-04-28T14:41:48.901 INFO:teuthology.orchestra.run.smithi022.stdout: "old_weight": 0, 2022-04-28T14:41:48.901 INFO:teuthology.orchestra.run.smithi022.stdout: "last_purged_snaps_scrub": "0.000000", 2022-04-28T14:41:48.902 INFO:teuthology.orchestra.run.smithi022.stdout: "dead_epoch": 0 2022-04-28T14:41:48.902 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.902 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:41:48.902 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 1, 2022-04-28T14:41:48.902 INFO:teuthology.orchestra.run.smithi022.stdout: "down_stamp": "0.000000", 2022-04-28T14:41:48.902 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_probability": 0, 2022-04-28T14:41:48.902 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_interval": 0, 2022-04-28T14:41:48.902 INFO:teuthology.orchestra.run.smithi022.stdout: "features": 4540138297136906239, 2022-04-28T14:41:48.902 INFO:teuthology.orchestra.run.smithi022.stdout: "old_weight": 0, 2022-04-28T14:41:48.902 INFO:teuthology.orchestra.run.smithi022.stdout: "last_purged_snaps_scrub": "0.000000", 2022-04-28T14:41:48.903 INFO:teuthology.orchestra.run.smithi022.stdout: "dead_epoch": 0 2022-04-28T14:41:48.903 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.903 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:41:48.903 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 2, 2022-04-28T14:41:48.903 INFO:teuthology.orchestra.run.smithi022.stdout: "down_stamp": "0.000000", 2022-04-28T14:41:48.903 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_probability": 0, 2022-04-28T14:41:48.903 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_interval": 0, 2022-04-28T14:41:48.903 INFO:teuthology.orchestra.run.smithi022.stdout: "features": 4540138297136906239, 2022-04-28T14:41:48.903 INFO:teuthology.orchestra.run.smithi022.stdout: "old_weight": 0, 2022-04-28T14:41:48.903 INFO:teuthology.orchestra.run.smithi022.stdout: "last_purged_snaps_scrub": "0.000000", 2022-04-28T14:41:48.904 INFO:teuthology.orchestra.run.smithi022.stdout: "dead_epoch": 0 2022-04-28T14:41:48.904 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.904 INFO:teuthology.orchestra.run.smithi022.stdout: { 2022-04-28T14:41:48.904 INFO:teuthology.orchestra.run.smithi022.stdout: "osd": 3, 2022-04-28T14:41:48.904 INFO:teuthology.orchestra.run.smithi022.stdout: "down_stamp": "2022-04-28T14:41:38.872482+0000", 2022-04-28T14:41:48.904 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_probability": 0, 2022-04-28T14:41:48.904 INFO:teuthology.orchestra.run.smithi022.stdout: "laggy_interval": 0, 2022-04-28T14:41:48.904 INFO:teuthology.orchestra.run.smithi022.stdout: "features": 4540138297136906239, 2022-04-28T14:41:48.904 INFO:teuthology.orchestra.run.smithi022.stdout: "old_weight": 0, 2022-04-28T14:41:48.904 INFO:teuthology.orchestra.run.smithi022.stdout: "last_purged_snaps_scrub": "0.000000", 2022-04-28T14:41:48.904 INFO:teuthology.orchestra.run.smithi022.stdout: "dead_epoch": 0 2022-04-28T14:41:48.905 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:41:48.905 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2022-04-28T14:41:48.905 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_upmap": [], 2022-04-28T14:41:48.905 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_upmap_items": [], 2022-04-28T14:41:48.905 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_temp": [], 2022-04-28T14:41:48.905 INFO:teuthology.orchestra.run.smithi022.stdout: "primary_temp": [], 2022-04-28T14:41:48.905 INFO:teuthology.orchestra.run.smithi022.stdout: "blocklist": { 2022-04-28T14:41:48.905 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.22:6819/356491488": "2022-04-29T14:41:48.026821+0000", 2022-04-28T14:41:48.905 INFO:teuthology.orchestra.run.smithi022.stdout: "172.21.15.22:6808/86956": "2022-04-29T14:41:24.302858+0000" 2022-04-28T14:41:48.905 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.906 INFO:teuthology.orchestra.run.smithi022.stdout: "erasure_code_profiles": { 2022-04-28T14:41:48.906 INFO:teuthology.orchestra.run.smithi022.stdout: "default": { 2022-04-28T14:41:48.906 INFO:teuthology.orchestra.run.smithi022.stdout: "crush-failure-domain": "osd", 2022-04-28T14:41:48.906 INFO:teuthology.orchestra.run.smithi022.stdout: "k": "2", 2022-04-28T14:41:48.906 INFO:teuthology.orchestra.run.smithi022.stdout: "m": "1", 2022-04-28T14:41:48.906 INFO:teuthology.orchestra.run.smithi022.stdout: "plugin": "jerasure", 2022-04-28T14:41:48.906 INFO:teuthology.orchestra.run.smithi022.stdout: "ruleset-failure-domain": "osd", 2022-04-28T14:41:48.906 INFO:teuthology.orchestra.run.smithi022.stdout: "technique": "reed_sol_van" 2022-04-28T14:41:48.906 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:41:48.906 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2022-04-28T14:41:48.907 INFO:teuthology.orchestra.run.smithi022.stdout: "removed_snaps_queue": [], 2022-04-28T14:41:48.907 INFO:teuthology.orchestra.run.smithi022.stdout: "new_removed_snaps": [], 2022-04-28T14:41:48.907 INFO:teuthology.orchestra.run.smithi022.stdout: "new_purged_snaps": [], 2022-04-28T14:41:48.907 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_node_flags": {}, 2022-04-28T14:41:48.907 INFO:teuthology.orchestra.run.smithi022.stdout: "device_class_flags": {}, 2022-04-28T14:41:48.907 INFO:teuthology.orchestra.run.smithi022.stdout: "stretch_mode": { 2022-04-28T14:41:48.907 INFO:teuthology.orchestra.run.smithi022.stdout: "stretch_mode_enabled": false, 2022-04-28T14:41:48.907 INFO:teuthology.orchestra.run.smithi022.stdout: "stretch_bucket_count": 0, 2022-04-28T14:41:48.907 INFO:teuthology.orchestra.run.smithi022.stdout: "degraded_stretch_mode": 0, 2022-04-28T14:41:48.907 INFO:teuthology.orchestra.run.smithi022.stdout: "recovering_stretch_mode": 0, 2022-04-28T14:41:48.907 INFO:teuthology.orchestra.run.smithi022.stdout: "stretch_mode_bucket": 0 2022-04-28T14:41:48.908 INFO:teuthology.orchestra.run.smithi022.stdout: } 2022-04-28T14:41:48.908 INFO:teuthology.orchestra.run.smithi022.stdout:} 2022-04-28T14:41:48.909 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.841+0000 7fc6a3d41700 1 -- 172.21.15.22:0/2620425359 >> v1:172.21.15.22:6808/92758 conn(0x7fc67c041b00 legacy=0x7fc67c043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:48.910 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.841+0000 7fc6a3d41700 1 -- 172.21.15.22:0/2620425359 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc69c05e510 msgr2=0x7fc69c147440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:48.910 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.841+0000 7fc6a3d41700 1 --2- 172.21.15.22:0/2620425359 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc69c05e510 0x7fc69c147440 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fc69800ea50 tx=0x7fc698009060).stop 2022-04-28T14:41:48.910 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.841+0000 7fc6a3d41700 1 -- 172.21.15.22:0/2620425359 shutdown_connections 2022-04-28T14:41:48.910 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.841+0000 7fc6a3d41700 1 --2- 172.21.15.22:0/2620425359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc69c13d060 0x7fc69c0a2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:48.910 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.841+0000 7fc6a3d41700 1 --2- 172.21.15.22:0/2620425359 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc69c05e510 0x7fc69c147440 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:48.910 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.841+0000 7fc6a3d41700 1 --2- 172.21.15.22:0/2620425359 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc69c067ed0 0x7fc69c0a4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:48.910 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.841+0000 7fc6a3d41700 1 -- 172.21.15.22:0/2620425359 >> 172.21.15.22:0/2620425359 conn(0x7fc69c0a7110 msgr2=0x7fc69c0a53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:48.910 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.841+0000 7fc6a3d41700 1 -- 172.21.15.22:0/2620425359 shutdown_connections 2022-04-28T14:41:48.910 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:48.841+0000 7fc6a3d41700 1 -- 172.21.15.22:0/2620425359 wait complete. 2022-04-28T14:41:48.911 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd require-osd-release pacific' 2022-04-28T14:41:48.933 INFO:tasks.ceph.mon.a.smithi022.stderr:2022-04-28T14:41:48.929+0000 7f9befd43700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-04-28T14:41:49.032 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.027+0000 7f28a34ca700 1 Processor -- start 2022-04-28T14:41:49.032 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.027+0000 7f28a34ca700 1 -- start start 2022-04-28T14:41:49.038 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.028+0000 7f28a34ca700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f289c09ed40 0x7f289c13bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:49.038 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.028+0000 7f28a34ca700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f289c13bff0 0x7f289c135670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:49.038 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.028+0000 7f28a34ca700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f289c0a47a0 0x7f289c135b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:49.038 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.028+0000 7f28a34ca700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f289c0a4cf0 con 0x7f289c0a47a0 2022-04-28T14:41:49.038 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.028+0000 7f28a34ca700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289c063860 con 0x7f289c13bff0 2022-04-28T14:41:49.038 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.028+0000 7f28a34ca700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f289c09f120 con 0x7f289c09ed40 2022-04-28T14:41:49.038 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.028+0000 7f28a1266700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f289c09ed40 0x7f289c13bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:49.038 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.028+0000 7f28a1a67700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f289c0a47a0 0x7f289c135b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:49.039 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.028+0000 7f28a0a65700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f289c13bff0 0x7f289c135670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:49.039 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.028+0000 7f28a0a65700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f289c13bff0 0x7f289c135670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48630/0 (socket says 172.21.15.22:48630) 2022-04-28T14:41:49.039 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.028+0000 7f28a1a67700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f289c0a47a0 0x7f289c135b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51066/0 (socket says 172.21.15.22:51066) 2022-04-28T14:41:49.039 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.028+0000 7f28a1266700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f289c09ed40 0x7f289c13bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48414/0 (socket says 172.21.15.22:48414) 2022-04-28T14:41:49.039 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.028+0000 7f28a0a65700 1 -- 172.21.15.22:0/20484851 learned_addr learned my addr 172.21.15.22:0/20484851 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:49.039 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.028+0000 7f28a1a67700 1 -- 172.21.15.22:0/20484851 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f289c09ed40 msgr2=0x7f289c13bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:49.039 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.028+0000 7f28a1a67700 1 --2- 172.21.15.22:0/20484851 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f289c09ed40 0x7f289c13bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:49.039 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.028+0000 7f28a1a67700 1 -- 172.21.15.22:0/20484851 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f289c13bff0 msgr2=0x7f289c135670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:49.039 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.028+0000 7f28a1a67700 1 --2- 172.21.15.22:0/20484851 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f289c13bff0 0x7f289c135670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:49.040 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.028+0000 7f28a1a67700 1 -- 172.21.15.22:0/20484851 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289c13c4d0 con 0x7f289c0a47a0 2022-04-28T14:41:49.040 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.028+0000 7f28a0a65700 1 --2- 172.21.15.22:0/20484851 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f289c13bff0 0x7f289c135670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:49.040 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.028+0000 7f28a1266700 1 --2- 172.21.15.22:0/20484851 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f289c09ed40 0x7f289c13bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:49.040 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.028+0000 7f28a1a67700 1 --2- 172.21.15.22:0/20484851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f289c0a47a0 0x7f289c135b60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f2894009e60 tx=0x7f2894009780).ready entity=mon.0 client_cookie=67b72a9db5c29ca8 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:49.040 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.028+0000 7f288bfff700 1 -- 172.21.15.22:0/20484851 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289400e070 con 0x7f289c0a47a0 2022-04-28T14:41:49.040 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.029+0000 7f288bfff700 1 -- 172.21.15.22:0/20484851 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289400ba50 con 0x7f289c0a47a0 2022-04-28T14:41:49.040 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.029+0000 7f288bfff700 1 -- 172.21.15.22:0/20484851 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289400bdd0 con 0x7f289c0a47a0 2022-04-28T14:41:49.040 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.029+0000 7f28a34ca700 1 -- 172.21.15.22:0/20484851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f289c0a47a0 msgr2=0x7f289c135b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:49.040 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.029+0000 7f28a34ca700 1 --2- 172.21.15.22:0/20484851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f289c0a47a0 0x7f289c135b60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f2894009e60 tx=0x7f2894009780).stop 2022-04-28T14:41:49.040 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.029+0000 7f28a34ca700 1 -- 172.21.15.22:0/20484851 shutdown_connections 2022-04-28T14:41:49.041 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.029+0000 7f28a34ca700 1 --2- 172.21.15.22:0/20484851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f289c0a47a0 0x7f289c135b60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:49.041 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.029+0000 7f28a34ca700 1 --2- 172.21.15.22:0/20484851 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f289c09ed40 0x7f289c13bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:49.041 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.029+0000 7f28a34ca700 1 --2- 172.21.15.22:0/20484851 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f289c13bff0 0x7f289c135670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:49.041 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.029+0000 7f28a34ca700 1 -- 172.21.15.22:0/20484851 >> 172.21.15.22:0/20484851 conn(0x7f289c067090 msgr2=0x7f289c05dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:49.042 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.029+0000 7f28a34ca700 1 -- 172.21.15.22:0/20484851 shutdown_connections 2022-04-28T14:41:49.042 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.029+0000 7f28a34ca700 1 -- 172.21.15.22:0/20484851 wait complete. 2022-04-28T14:41:49.042 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.030+0000 7f28a34ca700 1 Processor -- start 2022-04-28T14:41:49.042 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.030+0000 7f28a34ca700 1 -- start start 2022-04-28T14:41:49.042 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.031+0000 7f28a34ca700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f289c09ed40 0x7f289c137980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:49.042 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.031+0000 7f28a34ca700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f289c0a47a0 0x7f289c0a5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:49.042 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.031+0000 7f28a34ca700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f289c13bff0 0x7f289c14b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:49.042 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.031+0000 7f28a34ca700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289c13b370 con 0x7f289c13bff0 2022-04-28T14:41:49.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.031+0000 7f28a34ca700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289c0a7c70 con 0x7f289c09ed40 2022-04-28T14:41:49.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.031+0000 7f28a34ca700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f289c14b390 con 0x7f289c0a47a0 2022-04-28T14:41:49.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.031+0000 7f28a1266700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f289c09ed40 0x7f289c137980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:49.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.031+0000 7f28a1a67700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f289c13bff0 0x7f289c14b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:49.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.031+0000 7f28a0a65700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f289c0a47a0 0x7f289c0a5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:49.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.031+0000 7f28a1266700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f289c09ed40 0x7f289c137980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48636/0 (socket says 172.21.15.22:48636) 2022-04-28T14:41:49.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.031+0000 7f28a1266700 1 -- 172.21.15.22:0/1994500368 learned_addr learned my addr 172.21.15.22:0/1994500368 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:49.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.031+0000 7f28a1266700 1 -- 172.21.15.22:0/1994500368 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f289c0a47a0 msgr2=0x7f289c0a5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:49.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.031+0000 7f28a1266700 1 --2- 172.21.15.22:0/1994500368 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f289c0a47a0 0x7f289c0a5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:49.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.031+0000 7f28a1266700 1 -- 172.21.15.22:0/1994500368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f289c13bff0 msgr2=0x7f289c14b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:49.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.031+0000 7f28a1266700 1 --2- 172.21.15.22:0/1994500368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f289c13bff0 0x7f289c14b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:49.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.031+0000 7f28a1266700 1 -- 172.21.15.22:0/1994500368 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288c0092a0 con 0x7f289c09ed40 2022-04-28T14:41:49.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.031+0000 7f28a1a67700 1 --2- 172.21.15.22:0/1994500368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f289c13bff0 0x7f289c14b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:49.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.031+0000 7f28a1266700 1 --2- 172.21.15.22:0/1994500368 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f289c09ed40 0x7f289c137980 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f288c00e980 tx=0x7f288c009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:49.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.032+0000 7f28897fa700 1 -- 172.21.15.22:0/1994500368 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c00c6a0 con 0x7f289c09ed40 2022-04-28T14:41:49.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.032+0000 7f28897fa700 1 -- 172.21.15.22:0/1994500368 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288c00c800 con 0x7f289c09ed40 2022-04-28T14:41:49.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.032+0000 7f28a34ca700 1 -- 172.21.15.22:0/1994500368 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2898009370 con 0x7f289c09ed40 2022-04-28T14:41:49.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.032+0000 7f28897fa700 1 -- 172.21.15.22:0/1994500368 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c00cb80 con 0x7f289c09ed40 2022-04-28T14:41:49.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.032+0000 7f28a34ca700 1 -- 172.21.15.22:0/1994500368 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2894009a20 con 0x7f289c09ed40 2022-04-28T14:41:49.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.033+0000 7f28a34ca700 1 -- 172.21.15.22:0/1994500368 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f289c0a6990 con 0x7f289c09ed40 2022-04-28T14:41:49.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.033+0000 7f28897fa700 1 -- 172.21.15.22:0/1994500368 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f288c022070 con 0x7f289c09ed40 2022-04-28T14:41:49.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.033+0000 7f28897fa700 1 -- 172.21.15.22:0/1994500368 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 3745+0+0 (secure 0 0 0) 0x7f288c055850 con 0x7f289c09ed40 2022-04-28T14:41:49.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.036+0000 7f28897fa700 1 -- 172.21.15.22:0/1994500368 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f288c035ee0 con 0x7f289c09ed40 2022-04-28T14:41:49.191 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.186+0000 7f28a34ca700 1 -- 172.21.15.22:0/1994500368 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd require-osd-release", "release": "pacific"} v 0) v1 -- 0x7f289c06c350 con 0x7f289c09ed40 2022-04-28T14:41:49.949 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.941+0000 7f28897fa700 1 -- 172.21.15.22:0/1994500368 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd require-osd-release", "release": "pacific"}]=0 v35) v1 ==== 93+0+0 (secure 0 0 0) 0x7f288c039650 con 0x7f289c09ed40 2022-04-28T14:41:49.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.947+0000 7f28a34ca700 1 -- 172.21.15.22:0/1994500368 >> v1:172.21.15.22:6808/92758 conn(0x7f287c041b00 legacy=0x7f287c043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:49.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.947+0000 7f28a34ca700 1 -- 172.21.15.22:0/1994500368 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f289c09ed40 msgr2=0x7f289c137980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:49.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.947+0000 7f28a34ca700 1 --2- 172.21.15.22:0/1994500368 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f289c09ed40 0x7f289c137980 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f288c00e980 tx=0x7f288c009060).stop 2022-04-28T14:41:49.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.947+0000 7f28a34ca700 1 -- 172.21.15.22:0/1994500368 shutdown_connections 2022-04-28T14:41:49.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.947+0000 7f28a34ca700 1 --2- 172.21.15.22:0/1994500368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f289c13bff0 0x7f289c14b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:49.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.947+0000 7f28a34ca700 1 --2- 172.21.15.22:0/1994500368 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f289c09ed40 0x7f289c137980 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:49.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.947+0000 7f28a34ca700 1 --2- 172.21.15.22:0/1994500368 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f289c0a47a0 0x7f289c0a5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:49.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.947+0000 7f28a34ca700 1 -- 172.21.15.22:0/1994500368 >> 172.21.15.22:0/1994500368 conn(0x7f289c067090 msgr2=0x7f289c135440 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:49.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.947+0000 7f28a34ca700 1 -- 172.21.15.22:0/1994500368 shutdown_connections 2022-04-28T14:41:49.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:49.947+0000 7f28a34ca700 1 -- 172.21.15.22:0/1994500368 wait complete. 2022-04-28T14:41:49.966 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done' 2022-04-28T14:41:50.130 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.125+0000 7fa2b2694700 1 Processor -- start 2022-04-28T14:41:50.130 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.126+0000 7fa2b2694700 1 -- start start 2022-04-28T14:41:50.133 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.126+0000 7fa2b2694700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa2ac135750 0x7fa2ac095e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:50.133 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.126+0000 7fa2b2694700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa2ac097120 0x7fa2ac06b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:50.133 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.126+0000 7fa2b2694700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2ac097850 con 0x7fa2ac138120 2022-04-28T14:41:50.133 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.126+0000 7fa2b2694700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2ac0abeb0 con 0x7fa2ac097120 2022-04-28T14:41:50.133 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.126+0000 7fa2b2694700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac138930 con 0x7fa2ac135750 2022-04-28T14:41:50.133 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.126+0000 7fa2abfff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa2ac135750 0x7fa2ac095e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:50.134 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.126+0000 7fa2ab7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa2ac097120 0x7fa2ac06b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:50.134 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.126+0000 7fa2b0c31700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa2ac138120 0x7fa2ac13b6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40480/0 (socket says 172.21.15.22:40480) 2022-04-28T14:41:50.134 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.126+0000 7fa2b0c31700 1 -- 172.21.15.22:0/1764380264 learned_addr learned my addr 172.21.15.22:0/1764380264 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:41:50.134 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.127+0000 7fa2ab7fe700 1 -- 172.21.15.22:0/1764380264 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa2ac135750 msgr2=0x7fa2ac095e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:50.134 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.127+0000 7fa2ab7fe700 1 --2- 172.21.15.22:0/1764380264 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa2ac135750 0x7fa2ac095e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:50.134 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.127+0000 7fa2ab7fe700 1 -- 172.21.15.22:0/1764380264 >> v1:172.21.15.22:6789/0 conn(0x7fa2ac138120 legacy=0x7fa2ac13b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:50.134 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.127+0000 7fa2ab7fe700 1 -- 172.21.15.22:0/1764380264 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ac138bf0 con 0x7fa2ac097120 2022-04-28T14:41:50.134 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.127+0000 7fa2aaffd700 1 -- 172.21.15.22:0/1764380264 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1284379448 0 0) 0x7fa2ac097850 con 0x7fa2ac138120 2022-04-28T14:41:50.134 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.127+0000 7fa2abfff700 1 --2- 172.21.15.22:0/1764380264 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa2ac135750 0x7fa2ac095e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:50.134 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.127+0000 7fa2ab7fe700 1 --2- 172.21.15.22:0/1764380264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2ac097120 0x7fa2ac06b0f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fa2a0009760 tx=0x7fa2a0009060).ready entity=mon.0 client_cookie=57f79edba3dfe06d server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:50.135 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.127+0000 7fa2aaffd700 1 -- 172.21.15.22:0/1764380264 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a000f510 con 0x7fa2ac097120 2022-04-28T14:41:50.135 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.127+0000 7fa2aaffd700 1 -- 172.21.15.22:0/1764380264 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a000f670 con 0x7fa2ac097120 2022-04-28T14:41:50.135 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.127+0000 7fa2aaffd700 1 -- 172.21.15.22:0/1764380264 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a000f9f0 con 0x7fa2ac097120 2022-04-28T14:41:50.135 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.127+0000 7fa2b2694700 1 -- 172.21.15.22:0/1764380264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2ac097120 msgr2=0x7fa2ac06b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:50.135 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.127+0000 7fa2b2694700 1 --2- 172.21.15.22:0/1764380264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2ac097120 0x7fa2ac06b0f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fa2a0009760 tx=0x7fa2a0009060).stop 2022-04-28T14:41:50.135 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.127+0000 7fa2b2694700 1 -- 172.21.15.22:0/1764380264 shutdown_connections 2022-04-28T14:41:50.135 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.127+0000 7fa2b2694700 1 --2- 172.21.15.22:0/1764380264 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa2ac135750 0x7fa2ac095e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:50.135 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.127+0000 7fa2b2694700 1 --2- 172.21.15.22:0/1764380264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2ac097120 0x7fa2ac06b0f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:50.135 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.127+0000 7fa2b2694700 1 -- 172.21.15.22:0/1764380264 >> 172.21.15.22:0/1764380264 conn(0x7fa2ac0629e0 msgr2=0x7fa2ac063700 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:50.135 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.127+0000 7fa2b2694700 1 -- 172.21.15.22:0/1764380264 shutdown_connections 2022-04-28T14:41:50.136 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.128+0000 7fa2b2694700 1 -- 172.21.15.22:0/1764380264 wait complete. 2022-04-28T14:41:50.136 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.128+0000 7fa2b2694700 1 Processor -- start 2022-04-28T14:41:50.136 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.129+0000 7fa2b2694700 1 -- start start 2022-04-28T14:41:50.138 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.129+0000 7fa2b2694700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa2ac097120 0x7fa2ac069140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:50.138 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.129+0000 7fa2b2694700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa2ac135750 0x7fa2ac14b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:50.138 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.129+0000 7fa2b2694700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2ac138120 0x7fa2ac0676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:50.138 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.129+0000 7fa2b2694700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac068860 con 0x7fa2ac138120 2022-04-28T14:41:50.138 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.129+0000 7fa2b2694700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac068a60 con 0x7fa2ac135750 2022-04-28T14:41:50.138 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.129+0000 7fa2b2694700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ac14c2e0 con 0x7fa2ac097120 2022-04-28T14:41:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.129+0000 7fa2abfff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa2ac097120 0x7fa2ac069140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.129+0000 7fa2ab7fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa2ac135750 0x7fa2ac14b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.129+0000 7fa2b0c31700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2ac138120 0x7fa2ac0676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.129+0000 7fa2abfff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa2ac097120 0x7fa2ac069140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48438/0 (socket says 172.21.15.22:48438) 2022-04-28T14:41:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.129+0000 7fa2ab7fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa2ac135750 0x7fa2ac14b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48656/0 (socket says 172.21.15.22:48656) 2022-04-28T14:41:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.129+0000 7fa2abfff700 1 -- 172.21.15.22:0/2156772042 learned_addr learned my addr 172.21.15.22:0/2156772042 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.130+0000 7fa2abfff700 1 -- 172.21.15.22:0/2156772042 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa2ac135750 msgr2=0x7fa2ac14b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.130+0000 7fa2abfff700 1 --2- 172.21.15.22:0/2156772042 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa2ac135750 0x7fa2ac14b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.130+0000 7fa2abfff700 1 -- 172.21.15.22:0/2156772042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2ac138120 msgr2=0x7fa2ac0676d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.130+0000 7fa2abfff700 1 --2- 172.21.15.22:0/2156772042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2ac138120 0x7fa2ac0676d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.130+0000 7fa2abfff700 1 -- 172.21.15.22:0/2156772042 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c0092a0 con 0x7fa2ac097120 2022-04-28T14:41:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.130+0000 7fa2b0c31700 1 --2- 172.21.15.22:0/2156772042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2ac138120 0x7fa2ac0676d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.130+0000 7fa2ab7fe700 1 --2- 172.21.15.22:0/2156772042 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa2ac135750 0x7fa2ac14b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.130+0000 7fa2abfff700 1 --2- 172.21.15.22:0/2156772042 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa2ac097120 0x7fa2ac069140 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fa29c00ea50 tx=0x7fa29c009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.130+0000 7fa293fff700 1 -- 172.21.15.22:0/2156772042 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c00ee90 con 0x7fa2ac097120 2022-04-28T14:41:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.130+0000 7fa293fff700 1 -- 172.21.15.22:0/2156772042 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29c00c8e0 con 0x7fa2ac097120 2022-04-28T14:41:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.130+0000 7fa293fff700 1 -- 172.21.15.22:0/2156772042 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29c00cc60 con 0x7fa2ac097120 2022-04-28T14:41:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.130+0000 7fa2b2694700 1 -- 172.21.15.22:0/2156772042 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a00092a0 con 0x7fa2ac097120 2022-04-28T14:41:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.130+0000 7fa2b2694700 1 -- 172.21.15.22:0/2156772042 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ac13bdc0 con 0x7fa2ac097120 2022-04-28T14:41:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.131+0000 7fa293fff700 1 -- 172.21.15.22:0/2156772042 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7fa29c022070 con 0x7fa2ac097120 2022-04-28T14:41:50.141 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.131+0000 7fa2b2694700 1 -- 172.21.15.22:0/2156772042 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ac066880 con 0x7fa2ac097120 2022-04-28T14:41:50.141 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.131+0000 7fa293fff700 1 -- 172.21.15.22:0/2156772042 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3793+0+0 (secure 0 0 0) 0x7fa29c0558b0 con 0x7fa2ac097120 2022-04-28T14:41:50.141 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.135+0000 7fa293fff700 1 -- 172.21.15.22:0/2156772042 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7fa29c035e90 con 0x7fa2ac097120 2022-04-28T14:41:50.279 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.274+0000 7fa2b2694700 1 -- 172.21.15.22:0/2156772042 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "osd pool ls"} v 0) v1 -- 0x7fa2ac13bf50 con 0x7fa2ac097120 2022-04-28T14:41:50.279 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.274+0000 7fa293fff700 1 -- 172.21.15.22:0/2156772042 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v35) v1 ==== 59+0+54 (secure 0 0 0) 0x7fa29c039680 con 0x7fa2ac097120 2022-04-28T14:41:50.281 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.276+0000 7fa2b2694700 1 -- 172.21.15.22:0/2156772042 >> v1:172.21.15.22:6808/92758 conn(0x7fa28c041b00 legacy=0x7fa28c043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:50.281 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.276+0000 7fa2b2694700 1 -- 172.21.15.22:0/2156772042 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa2ac097120 msgr2=0x7fa2ac069140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:50.281 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.276+0000 7fa2b2694700 1 --2- 172.21.15.22:0/2156772042 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa2ac097120 0x7fa2ac069140 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fa29c00ea50 tx=0x7fa29c009060).stop 2022-04-28T14:41:50.281 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.276+0000 7fa2b2694700 1 -- 172.21.15.22:0/2156772042 shutdown_connections 2022-04-28T14:41:50.281 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.276+0000 7fa2b2694700 1 --2- 172.21.15.22:0/2156772042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2ac138120 0x7fa2ac0676d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:50.281 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.276+0000 7fa2b2694700 1 --2- 172.21.15.22:0/2156772042 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa2ac097120 0x7fa2ac069140 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:50.281 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.276+0000 7fa2b2694700 1 --2- 172.21.15.22:0/2156772042 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa2ac135750 0x7fa2ac14b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:50.281 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.276+0000 7fa2b2694700 1 -- 172.21.15.22:0/2156772042 >> 172.21.15.22:0/2156772042 conn(0x7fa2ac0629e0 msgr2=0x7fa2ac0aa610 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:50.282 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.276+0000 7fa2b2694700 1 -- 172.21.15.22:0/2156772042 shutdown_connections 2022-04-28T14:41:50.282 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.276+0000 7fa2b2694700 1 -- 172.21.15.22:0/2156772042 wait complete. 2022-04-28T14:41:50.386 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.379+0000 7f44f245c700 1 Processor -- start 2022-04-28T14:41:50.386 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.379+0000 7f44f245c700 1 -- start start 2022-04-28T14:41:50.386 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.380+0000 7f44f245c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f44ec05e090 0x7f44ec061f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.380+0000 7f44f245c700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f44ec0627d0 0x7f44ec0ac150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.380+0000 7f44f245c700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44ec05e470 con 0x7f44ec0ac640 2022-04-28T14:41:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.380+0000 7f44f245c700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44ec0ab8e0 con 0x7f44ec05e090 2022-04-28T14:41:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.380+0000 7f44f245c700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec0ad4b0 con 0x7f44ec0627d0 2022-04-28T14:41:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.380+0000 7f44eb7fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f44ec0627d0 0x7f44ec0ac150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.380+0000 7f44ebfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f44ec05e090 0x7f44ec061f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.380+0000 7f44eb7fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f44ec0627d0 0x7f44ec0ac150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48662/0 (socket says 172.21.15.22:48662) 2022-04-28T14:41:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.380+0000 7f44eb7fe700 1 -- 172.21.15.22:0/1483664163 learned_addr learned my addr 172.21.15.22:0/1483664163 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.380+0000 7f44ebfff700 1 -- 172.21.15.22:0/1483664163 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f44ec0627d0 msgr2=0x7f44ec0ac150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:50.387 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.380+0000 7f44ebfff700 1 --2- 172.21.15.22:0/1483664163 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f44ec0627d0 0x7f44ec0ac150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.380+0000 7f44ebfff700 1 -- 172.21.15.22:0/1483664163 >> v1:172.21.15.22:6789/0 conn(0x7f44ec0ac640 legacy=0x7f44ec13b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.380+0000 7f44ebfff700 1 -- 172.21.15.22:0/1483664163 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ec0abad0 con 0x7f44ec05e090 2022-04-28T14:41:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.380+0000 7f44eb7fe700 1 --2- 172.21.15.22:0/1483664163 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f44ec0627d0 0x7f44ec0ac150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.380+0000 7f44ebfff700 1 --2- 172.21.15.22:0/1483664163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44ec05e090 0x7f44ec061f10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f44dc009760 tx=0x7f44dc009060).ready entity=mon.0 client_cookie=98ddf653c53898a1 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.380+0000 7f44eaffd700 1 -- 172.21.15.22:0/1483664163 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc00d4a0 con 0x7f44ec05e090 2022-04-28T14:41:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.380+0000 7f44eaffd700 1 -- 172.21.15.22:0/1483664163 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44dc00d600 con 0x7f44ec05e090 2022-04-28T14:41:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.380+0000 7f44eaffd700 1 -- 172.21.15.22:0/1483664163 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc00d980 con 0x7f44ec05e090 2022-04-28T14:41:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.381+0000 7f44f245c700 1 -- 172.21.15.22:0/1483664163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44ec05e090 msgr2=0x7f44ec061f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:50.388 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.381+0000 7f44f245c700 1 --2- 172.21.15.22:0/1483664163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44ec05e090 0x7f44ec061f10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f44dc009760 tx=0x7f44dc009060).stop 2022-04-28T14:41:50.389 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.381+0000 7f44f245c700 1 -- 172.21.15.22:0/1483664163 shutdown_connections 2022-04-28T14:41:50.389 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.381+0000 7f44f245c700 1 --2- 172.21.15.22:0/1483664163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44ec05e090 0x7f44ec061f10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:50.389 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.381+0000 7f44f245c700 1 --2- 172.21.15.22:0/1483664163 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f44ec0627d0 0x7f44ec0ac150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:50.389 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.381+0000 7f44f245c700 1 -- 172.21.15.22:0/1483664163 >> 172.21.15.22:0/1483664163 conn(0x7f44ec05dac0 msgr2=0x7f44ec069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:50.389 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.381+0000 7f44f245c700 1 -- 172.21.15.22:0/1483664163 shutdown_connections 2022-04-28T14:41:50.389 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.381+0000 7f44f245c700 1 -- 172.21.15.22:0/1483664163 wait complete. 2022-04-28T14:41:50.392 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.382+0000 7f44f245c700 1 Processor -- start 2022-04-28T14:41:50.392 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.382+0000 7f44f245c700 1 -- start start 2022-04-28T14:41:50.392 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.383+0000 7f44f245c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f44ec05e090 0x7f44ec094dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:50.392 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.383+0000 7f44f245c700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f44ec0627d0 0x7f44ec14bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:50.392 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.383+0000 7f44f245c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44ec0ac640 0x7f44ec1485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:50.393 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.383+0000 7f44f245c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec148130 con 0x7f44ec0ac640 2022-04-28T14:41:50.393 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.383+0000 7f44f245c700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec0945e0 con 0x7f44ec0627d0 2022-04-28T14:41:50.393 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.383+0000 7f44f245c700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44ec148350 con 0x7f44ec05e090 2022-04-28T14:41:50.393 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.383+0000 7f44ebfff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f44ec05e090 0x7f44ec094dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:50.393 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.383+0000 7f44eb7fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f44ec0627d0 0x7f44ec14bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:50.393 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.383+0000 7f44ebfff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f44ec05e090 0x7f44ec094dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48452/0 (socket says 172.21.15.22:48452) 2022-04-28T14:41:50.393 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.383+0000 7f44ebfff700 1 -- 172.21.15.22:0/1339175194 learned_addr learned my addr 172.21.15.22:0/1339175194 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:50.393 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.383+0000 7f44f09f9700 1 --2- 172.21.15.22:0/1339175194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44ec0ac640 0x7f44ec1485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:50.393 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.383+0000 7f44f09f9700 1 -- 172.21.15.22:0/1339175194 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f44ec05e090 msgr2=0x7f44ec094dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:50.394 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.383+0000 7f44f09f9700 1 --2- 172.21.15.22:0/1339175194 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f44ec05e090 0x7f44ec094dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:50.394 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.383+0000 7f44f09f9700 1 -- 172.21.15.22:0/1339175194 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f44ec0627d0 msgr2=0x7f44ec14bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:50.394 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.383+0000 7f44f09f9700 1 --2- 172.21.15.22:0/1339175194 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f44ec0627d0 0x7f44ec14bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:50.394 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.383+0000 7f44f09f9700 1 -- 172.21.15.22:0/1339175194 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e0009370 con 0x7f44ec0ac640 2022-04-28T14:41:50.394 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.383+0000 7f44ebfff700 1 --2- 172.21.15.22:0/1339175194 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f44ec05e090 0x7f44ec094dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:50.394 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.383+0000 7f44eb7fe700 1 --2- 172.21.15.22:0/1339175194 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f44ec0627d0 0x7f44ec14bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:50.394 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.383+0000 7f44f09f9700 1 --2- 172.21.15.22:0/1339175194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44ec0ac640 0x7f44ec1485f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f44e400c810 tx=0x7f44e4001550).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:50.394 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.383+0000 7f44d3fff700 1 -- 172.21.15.22:0/1339175194 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e4010510 con 0x7f44ec0ac640 2022-04-28T14:41:50.394 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.384+0000 7f44d3fff700 1 -- 172.21.15.22:0/1339175194 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e4010690 con 0x7f44ec0ac640 2022-04-28T14:41:50.394 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.384+0000 7f44f245c700 1 -- 172.21.15.22:0/1339175194 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44dc0092a0 con 0x7f44ec0ac640 2022-04-28T14:41:50.395 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.384+0000 7f44d3fff700 1 -- 172.21.15.22:0/1339175194 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e4010a50 con 0x7f44ec0ac640 2022-04-28T14:41:50.395 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.384+0000 7f44f245c700 1 -- 172.21.15.22:0/1339175194 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44ec0952b0 con 0x7f44ec0ac640 2022-04-28T14:41:50.395 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.385+0000 7f44f245c700 1 -- 172.21.15.22:0/1339175194 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44ec14be00 con 0x7f44ec0ac640 2022-04-28T14:41:50.395 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.385+0000 7f44d3fff700 1 -- 172.21.15.22:0/1339175194 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f44e4018020 con 0x7f44ec0ac640 2022-04-28T14:41:50.395 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.385+0000 7f44d3fff700 1 -- 172.21.15.22:0/1339175194 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3793+0+0 (secure 0 0 0) 0x7f44e4054b70 con 0x7f44ec0ac640 2022-04-28T14:41:50.395 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.388+0000 7f44d3fff700 1 -- 172.21.15.22:0/1339175194 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f44e4035150 con 0x7f44ec0ac640 2022-04-28T14:41:50.531 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.527+0000 7f44f245c700 1 -- 172.21.15.22:0/1339175194 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f44ec13a520 con 0x7f44ec0ac640 2022-04-28T14:41:50.957 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.952+0000 7f44d3fff700 1 -- 172.21.15.22:0/1339175194 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 1 pg_autoscale_mode to off v36) v1 ==== 152+0+0 (secure 0 0 0) 0x7f44e4016020 con 0x7f44ec0ac640 2022-04-28T14:41:50.961 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.956+0000 7f44f245c700 1 -- 172.21.15.22:0/1339175194 >> v1:172.21.15.22:6808/92758 conn(0x7f44cc041b00 legacy=0x7f44cc043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:50.961 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.956+0000 7f44f245c700 1 -- 172.21.15.22:0/1339175194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44ec0ac640 msgr2=0x7f44ec1485f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:50.961 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.956+0000 7f44f245c700 1 --2- 172.21.15.22:0/1339175194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44ec0ac640 0x7f44ec1485f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f44e400c810 tx=0x7f44e4001550).stop 2022-04-28T14:41:50.962 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.956+0000 7f44f245c700 1 -- 172.21.15.22:0/1339175194 shutdown_connections 2022-04-28T14:41:50.962 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.956+0000 7f44f245c700 1 --2- 172.21.15.22:0/1339175194 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f44ec0ac640 0x7f44ec1485f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:50.962 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.956+0000 7f44f245c700 1 --2- 172.21.15.22:0/1339175194 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f44ec05e090 0x7f44ec094dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:50.962 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.956+0000 7f44f245c700 1 --2- 172.21.15.22:0/1339175194 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f44ec0627d0 0x7f44ec14bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:50.962 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.956+0000 7f44f245c700 1 -- 172.21.15.22:0/1339175194 >> 172.21.15.22:0/1339175194 conn(0x7f44ec05dac0 msgr2=0x7f44ec13c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:50.962 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.957+0000 7f44f245c700 1 -- 172.21.15.22:0/1339175194 shutdown_connections 2022-04-28T14:41:50.962 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:50.957+0000 7f44f245c700 1 -- 172.21.15.22:0/1339175194 wait complete. 2022-04-28T14:41:50.963 INFO:teuthology.orchestra.run.smithi022.stderr:set pool 1 pg_autoscale_mode to off 2022-04-28T14:41:51.073 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.068+0000 7f589f04a700 1 Processor -- start 2022-04-28T14:41:51.073 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.068+0000 7f589f04a700 1 -- start start 2022-04-28T14:41:51.076 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.069+0000 7f589f04a700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f589813b780 0x7f58980a3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:51.076 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.069+0000 7f589f04a700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f58980a40c0 0x7f5898142b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:51.076 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.069+0000 7f589f04a700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58980a4960 con 0x7f58980aeda0 2022-04-28T14:41:51.076 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.069+0000 7f589f04a700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58980a4550 con 0x7f58980a40c0 2022-04-28T14:41:51.076 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.069+0000 7f589f04a700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f589813bc10 con 0x7f589813b780 2022-04-28T14:41:51.076 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.069+0000 7f589cde6700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f58980aeda0 0x7f58980ac080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40504/0 (socket says 172.21.15.22:40504) 2022-04-28T14:41:51.076 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.069+0000 7f589cde6700 1 -- 172.21.15.22:0/2839489399 learned_addr learned my addr 172.21.15.22:0/2839489399 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:41:51.077 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.069+0000 7f5897fff700 1 --2- 172.21.15.22:0/2839489399 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f589813b780 0x7f58980a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:51.077 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.069+0000 7f589d5e7700 1 --2- 172.21.15.22:0/2839489399 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f58980a40c0 0x7f5898142b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:51.077 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.069+0000 7f58977fe700 1 -- 172.21.15.22:0/2839489399 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3459240527 0 0) 0x7f58980a4960 con 0x7f58980aeda0 2022-04-28T14:41:51.077 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.069+0000 7f58977fe700 1 -- 172.21.15.22:0/2839489399 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f587c0033f0 con 0x7f58980aeda0 2022-04-28T14:41:51.077 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.069+0000 7f5897fff700 1 -- 172.21.15.22:0/2839489399 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f58980a40c0 msgr2=0x7f5898142b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:51.077 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.069+0000 7f5897fff700 1 --2- 172.21.15.22:0/2839489399 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f58980a40c0 0x7f5898142b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:51.077 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.069+0000 7f5897fff700 1 -- 172.21.15.22:0/2839489399 >> v1:172.21.15.22:6789/0 conn(0x7f58980aeda0 legacy=0x7f58980ac080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:51.077 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.069+0000 7f5897fff700 1 -- 172.21.15.22:0/2839489399 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589813beb0 con 0x7f589813b780 2022-04-28T14:41:51.077 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.069+0000 7f589d5e7700 1 --2- 172.21.15.22:0/2839489399 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f58980a40c0 0x7f5898142b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:51.078 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.069+0000 7f5897fff700 1 --2- 172.21.15.22:0/2839489399 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f589813b780 0x7f58980a3890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f5884009790 tx=0x7f5884009060).ready entity=mon.2 client_cookie=c148beaf189e0256 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:51.078 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.069+0000 7f58977fe700 1 -- 172.21.15.22:0/2839489399 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58840090d0 con 0x7f589813b780 2022-04-28T14:41:51.078 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.070+0000 7f58977fe700 1 -- 172.21.15.22:0/2839489399 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588400d4a0 con 0x7f589813b780 2022-04-28T14:41:51.078 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.070+0000 7f58977fe700 1 -- 172.21.15.22:0/2839489399 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588400d820 con 0x7f589813b780 2022-04-28T14:41:51.078 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.070+0000 7f589f04a700 1 -- 172.21.15.22:0/2839489399 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f589813b780 msgr2=0x7f58980a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:51.078 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.070+0000 7f589f04a700 1 --2- 172.21.15.22:0/2839489399 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f589813b780 0x7f58980a3890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f5884009790 tx=0x7f5884009060).stop 2022-04-28T14:41:51.078 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.070+0000 7f589f04a700 1 -- 172.21.15.22:0/2839489399 shutdown_connections 2022-04-28T14:41:51.078 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.070+0000 7f589f04a700 1 --2- 172.21.15.22:0/2839489399 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f58980a40c0 0x7f5898142b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:51.078 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.070+0000 7f589f04a700 1 --2- 172.21.15.22:0/2839489399 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f589813b780 0x7f58980a3890 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:51.078 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.070+0000 7f589f04a700 1 -- 172.21.15.22:0/2839489399 >> 172.21.15.22:0/2839489399 conn(0x7f5898062b70 msgr2=0x7f5898062f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:51.079 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.070+0000 7f589f04a700 1 -- 172.21.15.22:0/2839489399 shutdown_connections 2022-04-28T14:41:51.079 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.070+0000 7f589f04a700 1 -- 172.21.15.22:0/2839489399 wait complete. 2022-04-28T14:41:51.079 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.071+0000 7f589f04a700 1 Processor -- start 2022-04-28T14:41:51.079 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.071+0000 7f589f04a700 1 -- start start 2022-04-28T14:41:51.081 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.072+0000 7f589f04a700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58980a40c0 0x7f589813f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:51.081 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.072+0000 7f589f04a700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f58980aeda0 0x7f58980aa450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:51.081 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.072+0000 7f589f04a700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f58980a5dc0 0x7f58980a6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:51.082 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.072+0000 7f589f04a700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58980ab3a0 con 0x7f58980a40c0 2022-04-28T14:41:51.082 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.072+0000 7f589f04a700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58980a8000 con 0x7f58980a5dc0 2022-04-28T14:41:51.082 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.072+0000 7f589f04a700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58980a9c70 con 0x7f58980aeda0 2022-04-28T14:41:51.082 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.072+0000 7f589cde6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58980a40c0 0x7f589813f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:51.082 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.072+0000 7f5897fff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f58980aeda0 0x7f58980aa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:51.082 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.072+0000 7f589cde6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58980a40c0 0x7f589813f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51114/0 (socket says 172.21.15.22:51114) 2022-04-28T14:41:51.082 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.072+0000 7f5897fff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f58980aeda0 0x7f58980aa450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48468/0 (socket says 172.21.15.22:48468) 2022-04-28T14:41:51.082 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.072+0000 7f589cde6700 1 -- 172.21.15.22:0/3532015837 learned_addr learned my addr 172.21.15.22:0/3532015837 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:51.082 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.072+0000 7f589d5e7700 1 --2- 172.21.15.22:0/3532015837 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f58980a5dc0 0x7f58980a6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:51.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.072+0000 7f589cde6700 1 -- 172.21.15.22:0/3532015837 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f58980aeda0 msgr2=0x7f58980aa450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:51.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.072+0000 7f589cde6700 1 --2- 172.21.15.22:0/3532015837 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f58980aeda0 0x7f58980aa450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:51.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.072+0000 7f589cde6700 1 -- 172.21.15.22:0/3532015837 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f58980a5dc0 msgr2=0x7f58980a6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:51.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.072+0000 7f589cde6700 1 --2- 172.21.15.22:0/3532015837 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f58980a5dc0 0x7f58980a6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:51.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.072+0000 7f589cde6700 1 -- 172.21.15.22:0/3532015837 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5890009a20 con 0x7f58980a40c0 2022-04-28T14:41:51.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.072+0000 7f5897fff700 1 --2- 172.21.15.22:0/3532015837 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f58980aeda0 0x7f58980aa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:51.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.072+0000 7f589cde6700 1 --2- 172.21.15.22:0/3532015837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58980a40c0 0x7f589813f450 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f588c00c590 tx=0x7f588c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:51.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.073+0000 7f5894ff9700 1 -- 172.21.15.22:0/3532015837 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c0072e0 con 0x7f58980a40c0 2022-04-28T14:41:51.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.073+0000 7f5894ff9700 1 -- 172.21.15.22:0/3532015837 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588c007440 con 0x7f58980a40c0 2022-04-28T14:41:51.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.073+0000 7f589f04a700 1 -- 172.21.15.22:0/3532015837 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58840092a0 con 0x7f58980a40c0 2022-04-28T14:41:51.084 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.073+0000 7f5894ff9700 1 -- 172.21.15.22:0/3532015837 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c0057a0 con 0x7f58980a40c0 2022-04-28T14:41:51.084 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.073+0000 7f589f04a700 1 -- 172.21.15.22:0/3532015837 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58980aa940 con 0x7f58980a40c0 2022-04-28T14:41:51.084 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.074+0000 7f5894ff9700 1 -- 172.21.15.22:0/3532015837 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f588c01a060 con 0x7f58980a40c0 2022-04-28T14:41:51.084 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.074+0000 7f589f04a700 1 -- 172.21.15.22:0/3532015837 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f589806c350 con 0x7f58980a40c0 2022-04-28T14:41:51.084 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.074+0000 7f5894ff9700 1 -- 172.21.15.22:0/3532015837 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 3793+0+0 (secure 0 0 0) 0x7f588c054860 con 0x7f58980a40c0 2022-04-28T14:41:51.084 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.077+0000 7f5894ff9700 1 -- 172.21.15.22:0/3532015837 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f588c035010 con 0x7f58980a40c0 2022-04-28T14:41:51.222 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.217+0000 7f589f04a700 1 -- 172.21.15.22:0/3532015837 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f58980a2a90 con 0x7f58980a40c0 2022-04-28T14:41:51.958 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.953+0000 7f5894ff9700 1 -- 172.21.15.22:0/3532015837 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 2 pg_autoscale_mode to off v37) v1 ==== 164+0+0 (secure 0 0 0) 0x7f588c018070 con 0x7f58980a40c0 2022-04-28T14:41:51.962 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.957+0000 7f589f04a700 1 -- 172.21.15.22:0/3532015837 >> v1:172.21.15.22:6808/92758 conn(0x7f5880041b00 legacy=0x7f5880043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:51.962 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.957+0000 7f589f04a700 1 -- 172.21.15.22:0/3532015837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58980a40c0 msgr2=0x7f589813f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:51.962 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.957+0000 7f589f04a700 1 --2- 172.21.15.22:0/3532015837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58980a40c0 0x7f589813f450 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f588c00c590 tx=0x7f588c007c80).stop 2022-04-28T14:41:51.962 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.957+0000 7f589f04a700 1 -- 172.21.15.22:0/3532015837 shutdown_connections 2022-04-28T14:41:51.962 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.957+0000 7f589f04a700 1 --2- 172.21.15.22:0/3532015837 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f58980a5dc0 0x7f58980a6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:51.962 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.957+0000 7f589f04a700 1 --2- 172.21.15.22:0/3532015837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f58980a40c0 0x7f589813f450 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0x7f588c00c590 tx=0x7f588c007c80).stop 2022-04-28T14:41:51.962 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.957+0000 7f589f04a700 1 --2- 172.21.15.22:0/3532015837 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f58980aeda0 0x7f58980aa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:51.963 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.957+0000 7f589f04a700 1 -- 172.21.15.22:0/3532015837 >> 172.21.15.22:0/3532015837 conn(0x7f5898062b70 msgr2=0x7f5898062f50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:51.964 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.959+0000 7f589f04a700 1 -- 172.21.15.22:0/3532015837 shutdown_connections 2022-04-28T14:41:51.964 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:51.960+0000 7f589f04a700 1 -- 172.21.15.22:0/3532015837 wait complete. 2022-04-28T14:41:51.965 INFO:tasks.ceph.mds.c.smithi022.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.7-969-g4fa079ba/rpm/el8/BUILD/ceph-16.2.7-969-g4fa079ba/src/mds/CDir.cc: In function 'bool CDir::check_rstats(bool)' thread 7fe4dcec9700 time 2022-04-28T14:41:51.962522+0000 2022-04-28T14:41:51.965 INFO:tasks.ceph.mds.c.smithi022.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.7-969-g4fa079ba/rpm/el8/BUILD/ceph-16.2.7-969-g4fa079ba/src/mds/CDir.cc: 292: FAILED ceph_assert(frag_info.nsubdirs == fnode->fragstat.nsubdirs) 2022-04-28T14:41:51.966 INFO:teuthology.orchestra.run.smithi022.stderr:set pool 2 pg_autoscale_mode to off 2022-04-28T14:41:51.967 INFO:tasks.ceph.mds.c.smithi022.stderr: ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable) 2022-04-28T14:41:51.967 INFO:tasks.ceph.mds.c.smithi022.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fe4e9ee8d48] 2022-04-28T14:41:51.967 INFO:tasks.ceph.mds.c.smithi022.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x276f62) [0x7fe4e9ee8f62] 2022-04-28T14:41:51.967 INFO:tasks.ceph.mds.c.smithi022.stderr: 3: (CDir::check_rstats(bool)+0x17dd) [0x556d72a8642d] 2022-04-28T14:41:51.967 INFO:tasks.ceph.mds.c.smithi022.stderr: 4: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0xd56) [0x556d72937206] 2022-04-28T14:41:51.967 INFO:tasks.ceph.mds.c.smithi022.stderr: 5: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x8de) [0x556d729392de] 2022-04-28T14:41:51.967 INFO:tasks.ceph.mds.c.smithi022.stderr: 6: (MDCache::populate_mydir()+0x806) [0x556d7297fbb6] 2022-04-28T14:41:51.967 INFO:tasks.ceph.mds.c.smithi022.stderr: 7: (MDCache::open_root()+0xd8) [0x556d7297fea8] 2022-04-28T14:41:51.967 INFO:tasks.ceph.mds.c.smithi022.stderr: 8: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x556d729e4ab7] 2022-04-28T14:41:51.968 INFO:tasks.ceph.mds.c.smithi022.stderr: 9: (MDSContext::complete(int)+0x203) [0x556d72b43f93] 2022-04-28T14:41:51.968 INFO:tasks.ceph.mds.c.smithi022.stderr: 10: (MDSRank::_advance_queues()+0x84) [0x556d7283cc64] 2022-04-28T14:41:51.968 INFO:tasks.ceph.mds.c.smithi022.stderr: 11: (MDSRank::ProgressThread::entry()+0xc5) [0x556d7283d385] 2022-04-28T14:41:51.968 INFO:tasks.ceph.mds.c.smithi022.stderr: 12: /lib64/libpthread.so.0(+0x81cf) [0x7fe4e8ecc1cf] 2022-04-28T14:41:51.968 INFO:tasks.ceph.mds.c.smithi022.stderr: 13: clone() 2022-04-28T14:41:51.968 INFO:tasks.ceph.mds.c.smithi022.stderr:2022-04-28T14:41:51.962+0000 7fe4dcec9700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.7-969-g4fa079ba/rpm/el8/BUILD/ceph-16.2.7-969-g4fa079ba/src/mds/CDir.cc: In function 'bool CDir::check_rstats(bool)' thread 7fe4dcec9700 time 2022-04-28T14:41:51.962522+0000 2022-04-28T14:41:51.968 INFO:tasks.ceph.mds.c.smithi022.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.7-969-g4fa079ba/rpm/el8/BUILD/ceph-16.2.7-969-g4fa079ba/src/mds/CDir.cc: 292: FAILED ceph_assert(frag_info.nsubdirs == fnode->fragstat.nsubdirs) 2022-04-28T14:41:51.968 INFO:tasks.ceph.mds.c.smithi022.stderr: 2022-04-28T14:41:51.968 INFO:tasks.ceph.mds.c.smithi022.stderr: ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable) 2022-04-28T14:41:51.968 INFO:tasks.ceph.mds.c.smithi022.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fe4e9ee8d48] 2022-04-28T14:41:51.969 INFO:tasks.ceph.mds.c.smithi022.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x276f62) [0x7fe4e9ee8f62] 2022-04-28T14:41:51.969 INFO:tasks.ceph.mds.c.smithi022.stderr: 3: (CDir::check_rstats(bool)+0x17dd) [0x556d72a8642d] 2022-04-28T14:41:51.969 INFO:tasks.ceph.mds.c.smithi022.stderr: 4: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0xd56) [0x556d72937206] 2022-04-28T14:41:51.969 INFO:tasks.ceph.mds.c.smithi022.stderr: 5: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x8de) [0x556d729392de] 2022-04-28T14:41:51.969 INFO:tasks.ceph.mds.c.smithi022.stderr: 6: (MDCache::populate_mydir()+0x806) [0x556d7297fbb6] 2022-04-28T14:41:51.969 INFO:tasks.ceph.mds.c.smithi022.stderr: 7: (MDCache::open_root()+0xd8) [0x556d7297fea8] 2022-04-28T14:41:51.969 INFO:tasks.ceph.mds.c.smithi022.stderr: 8: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x556d729e4ab7] 2022-04-28T14:41:51.969 INFO:tasks.ceph.mds.c.smithi022.stderr: 9: (MDSContext::complete(int)+0x203) [0x556d72b43f93] 2022-04-28T14:41:51.969 INFO:tasks.ceph.mds.c.smithi022.stderr: 10: (MDSRank::_advance_queues()+0x84) [0x556d7283cc64] 2022-04-28T14:41:51.969 INFO:tasks.ceph.mds.c.smithi022.stderr: 11: (MDSRank::ProgressThread::entry()+0xc5) [0x556d7283d385] 2022-04-28T14:41:51.970 INFO:tasks.ceph.mds.c.smithi022.stderr: 12: /lib64/libpthread.so.0(+0x81cf) [0x7fe4e8ecc1cf] 2022-04-28T14:41:51.970 INFO:tasks.ceph.mds.c.smithi022.stderr: 13: clone() 2022-04-28T14:41:51.970 INFO:tasks.ceph.mds.c.smithi022.stderr: 2022-04-28T14:41:51.970 INFO:tasks.ceph.mds.c.smithi022.stderr:*** Caught signal (Aborted) ** 2022-04-28T14:41:51.970 INFO:tasks.ceph.mds.c.smithi022.stderr: in thread 7fe4dcec9700 thread_name:mds_rank_progr 2022-04-28T14:41:51.971 INFO:tasks.ceph.mds.c.smithi022.stderr: ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable) 2022-04-28T14:41:51.971 INFO:tasks.ceph.mds.c.smithi022.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fe4e8ed6ce0] 2022-04-28T14:41:51.971 INFO:tasks.ceph.mds.c.smithi022.stderr: 2: gsignal() 2022-04-28T14:41:51.971 INFO:tasks.ceph.mds.c.smithi022.stderr: 3: abort() 2022-04-28T14:41:51.971 INFO:tasks.ceph.mds.c.smithi022.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7fe4e9ee8d99] 2022-04-28T14:41:51.971 INFO:tasks.ceph.mds.c.smithi022.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x276f62) [0x7fe4e9ee8f62] 2022-04-28T14:41:51.971 INFO:tasks.ceph.mds.c.smithi022.stderr: 6: (CDir::check_rstats(bool)+0x17dd) [0x556d72a8642d] 2022-04-28T14:41:51.972 INFO:tasks.ceph.mds.c.smithi022.stderr: 7: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0xd56) [0x556d72937206] 2022-04-28T14:41:51.972 INFO:tasks.ceph.mds.c.smithi022.stderr: 8: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x8de) [0x556d729392de] 2022-04-28T14:41:51.972 INFO:tasks.ceph.mds.c.smithi022.stderr: 9: (MDCache::populate_mydir()+0x806) [0x556d7297fbb6] 2022-04-28T14:41:51.972 INFO:tasks.ceph.mds.c.smithi022.stderr: 10: (MDCache::open_root()+0xd8) [0x556d7297fea8] 2022-04-28T14:41:51.972 INFO:tasks.ceph.mds.c.smithi022.stderr: 11: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x556d729e4ab7] 2022-04-28T14:41:51.972 INFO:tasks.ceph.mds.c.smithi022.stderr: 12: (MDSContext::complete(int)+0x203) [0x556d72b43f93] 2022-04-28T14:41:51.972 INFO:tasks.ceph.mds.c.smithi022.stderr: 13: (MDSRank::_advance_queues()+0x84) [0x556d7283cc64] 2022-04-28T14:41:51.972 INFO:tasks.ceph.mds.c.smithi022.stderr: 14: (MDSRank::ProgressThread::entry()+0xc5) [0x556d7283d385] 2022-04-28T14:41:51.972 INFO:tasks.ceph.mds.c.smithi022.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7fe4e8ecc1cf] 2022-04-28T14:41:51.972 INFO:tasks.ceph.mds.c.smithi022.stderr: 16: clone() 2022-04-28T14:41:51.973 INFO:tasks.ceph.mds.c.smithi022.stderr:2022-04-28T14:41:51.963+0000 7fe4dcec9700 -1 *** Caught signal (Aborted) ** 2022-04-28T14:41:51.973 INFO:tasks.ceph.mds.c.smithi022.stderr: in thread 7fe4dcec9700 thread_name:mds_rank_progr 2022-04-28T14:41:51.973 INFO:tasks.ceph.mds.c.smithi022.stderr: 2022-04-28T14:41:51.973 INFO:tasks.ceph.mds.c.smithi022.stderr: ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable) 2022-04-28T14:41:51.973 INFO:tasks.ceph.mds.c.smithi022.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fe4e8ed6ce0] 2022-04-28T14:41:51.973 INFO:tasks.ceph.mds.c.smithi022.stderr: 2: gsignal() 2022-04-28T14:41:51.973 INFO:tasks.ceph.mds.c.smithi022.stderr: 3: abort() 2022-04-28T14:41:51.973 INFO:tasks.ceph.mds.c.smithi022.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7fe4e9ee8d99] 2022-04-28T14:41:51.973 INFO:tasks.ceph.mds.c.smithi022.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x276f62) [0x7fe4e9ee8f62] 2022-04-28T14:41:51.973 INFO:tasks.ceph.mds.c.smithi022.stderr: 6: (CDir::check_rstats(bool)+0x17dd) [0x556d72a8642d] 2022-04-28T14:41:51.974 INFO:tasks.ceph.mds.c.smithi022.stderr: 7: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0xd56) [0x556d72937206] 2022-04-28T14:41:51.974 INFO:tasks.ceph.mds.c.smithi022.stderr: 8: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x8de) [0x556d729392de] 2022-04-28T14:41:51.974 INFO:tasks.ceph.mds.c.smithi022.stderr: 9: (MDCache::populate_mydir()+0x806) [0x556d7297fbb6] 2022-04-28T14:41:51.974 INFO:tasks.ceph.mds.c.smithi022.stderr: 10: (MDCache::open_root()+0xd8) [0x556d7297fea8] 2022-04-28T14:41:51.974 INFO:tasks.ceph.mds.c.smithi022.stderr: 11: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x556d729e4ab7] 2022-04-28T14:41:51.974 INFO:tasks.ceph.mds.c.smithi022.stderr: 12: (MDSContext::complete(int)+0x203) [0x556d72b43f93] 2022-04-28T14:41:51.974 INFO:tasks.ceph.mds.c.smithi022.stderr: 13: (MDSRank::_advance_queues()+0x84) [0x556d7283cc64] 2022-04-28T14:41:51.974 INFO:tasks.ceph.mds.c.smithi022.stderr: 14: (MDSRank::ProgressThread::entry()+0xc5) [0x556d7283d385] 2022-04-28T14:41:51.974 INFO:tasks.ceph.mds.c.smithi022.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7fe4e8ecc1cf] 2022-04-28T14:41:51.975 INFO:tasks.ceph.mds.c.smithi022.stderr: 16: clone() 2022-04-28T14:41:51.975 INFO:tasks.ceph.mds.c.smithi022.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-04-28T14:41:51.975 INFO:tasks.ceph.mds.c.smithi022.stderr: 2022-04-28T14:41:51.975 INFO:tasks.ceph.mds.c.smithi022.stderr: -1> 2022-04-28T14:41:51.962+0000 7fe4dcec9700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.7-969-g4fa079ba/rpm/el8/BUILD/ceph-16.2.7-969-g4fa079ba/src/mds/CDir.cc: In function 'bool CDir::check_rstats(bool)' thread 7fe4dcec9700 time 2022-04-28T14:41:51.962522+0000 2022-04-28T14:41:51.975 INFO:tasks.ceph.mds.c.smithi022.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.7-969-g4fa079ba/rpm/el8/BUILD/ceph-16.2.7-969-g4fa079ba/src/mds/CDir.cc: 292: FAILED ceph_assert(frag_info.nsubdirs == fnode->fragstat.nsubdirs) 2022-04-28T14:41:51.975 INFO:tasks.ceph.mds.c.smithi022.stderr: 2022-04-28T14:41:51.975 INFO:tasks.ceph.mds.c.smithi022.stderr: ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable) 2022-04-28T14:41:51.975 INFO:tasks.ceph.mds.c.smithi022.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fe4e9ee8d48] 2022-04-28T14:41:51.975 INFO:tasks.ceph.mds.c.smithi022.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x276f62) [0x7fe4e9ee8f62] 2022-04-28T14:41:51.976 INFO:tasks.ceph.mds.c.smithi022.stderr: 3: (CDir::check_rstats(bool)+0x17dd) [0x556d72a8642d] 2022-04-28T14:41:51.976 INFO:tasks.ceph.mds.c.smithi022.stderr: 4: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0xd56) [0x556d72937206] 2022-04-28T14:41:51.976 INFO:tasks.ceph.mds.c.smithi022.stderr: 5: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x8de) [0x556d729392de] 2022-04-28T14:41:51.976 INFO:tasks.ceph.mds.c.smithi022.stderr: 6: (MDCache::populate_mydir()+0x806) [0x556d7297fbb6] 2022-04-28T14:41:51.976 INFO:tasks.ceph.mds.c.smithi022.stderr: 7: (MDCache::open_root()+0xd8) [0x556d7297fea8] 2022-04-28T14:41:51.976 INFO:tasks.ceph.mds.c.smithi022.stderr: 8: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x556d729e4ab7] 2022-04-28T14:41:51.976 INFO:tasks.ceph.mds.c.smithi022.stderr: 9: (MDSContext::complete(int)+0x203) [0x556d72b43f93] 2022-04-28T14:41:51.976 INFO:tasks.ceph.mds.c.smithi022.stderr: 10: (MDSRank::_advance_queues()+0x84) [0x556d7283cc64] 2022-04-28T14:41:51.976 INFO:tasks.ceph.mds.c.smithi022.stderr: 11: (MDSRank::ProgressThread::entry()+0xc5) [0x556d7283d385] 2022-04-28T14:41:51.976 INFO:tasks.ceph.mds.c.smithi022.stderr: 12: /lib64/libpthread.so.0(+0x81cf) [0x7fe4e8ecc1cf] 2022-04-28T14:41:51.977 INFO:tasks.ceph.mds.c.smithi022.stderr: 13: clone() 2022-04-28T14:41:51.977 INFO:tasks.ceph.mds.c.smithi022.stderr: 2022-04-28T14:41:51.977 INFO:tasks.ceph.mds.c.smithi022.stderr: 0> 2022-04-28T14:41:51.963+0000 7fe4dcec9700 -1 *** Caught signal (Aborted) ** 2022-04-28T14:41:51.977 INFO:tasks.ceph.mds.c.smithi022.stderr: in thread 7fe4dcec9700 thread_name:mds_rank_progr 2022-04-28T14:41:51.977 INFO:tasks.ceph.mds.c.smithi022.stderr: 2022-04-28T14:41:51.977 INFO:tasks.ceph.mds.c.smithi022.stderr: ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable) 2022-04-28T14:41:51.977 INFO:tasks.ceph.mds.c.smithi022.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fe4e8ed6ce0] 2022-04-28T14:41:51.977 INFO:tasks.ceph.mds.c.smithi022.stderr: 2: gsignal() 2022-04-28T14:41:51.977 INFO:tasks.ceph.mds.c.smithi022.stderr: 3: abort() 2022-04-28T14:41:51.977 INFO:tasks.ceph.mds.c.smithi022.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7fe4e9ee8d99] 2022-04-28T14:41:51.978 INFO:tasks.ceph.mds.c.smithi022.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x276f62) [0x7fe4e9ee8f62] 2022-04-28T14:41:51.978 INFO:tasks.ceph.mds.c.smithi022.stderr: 6: (CDir::check_rstats(bool)+0x17dd) [0x556d72a8642d] 2022-04-28T14:41:51.978 INFO:tasks.ceph.mds.c.smithi022.stderr: 7: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0xd56) [0x556d72937206] 2022-04-28T14:41:51.978 INFO:tasks.ceph.mds.c.smithi022.stderr: 8: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x8de) [0x556d729392de] 2022-04-28T14:41:51.978 INFO:tasks.ceph.mds.c.smithi022.stderr: 9: (MDCache::populate_mydir()+0x806) [0x556d7297fbb6] 2022-04-28T14:41:51.978 INFO:tasks.ceph.mds.c.smithi022.stderr: 10: (MDCache::open_root()+0xd8) [0x556d7297fea8] 2022-04-28T14:41:51.978 INFO:tasks.ceph.mds.c.smithi022.stderr: 11: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x556d729e4ab7] 2022-04-28T14:41:51.978 INFO:tasks.ceph.mds.c.smithi022.stderr: 12: (MDSContext::complete(int)+0x203) [0x556d72b43f93] 2022-04-28T14:41:51.978 INFO:tasks.ceph.mds.c.smithi022.stderr: 13: (MDSRank::_advance_queues()+0x84) [0x556d7283cc64] 2022-04-28T14:41:51.979 INFO:tasks.ceph.mds.c.smithi022.stderr: 14: (MDSRank::ProgressThread::entry()+0xc5) [0x556d7283d385] 2022-04-28T14:41:51.979 INFO:tasks.ceph.mds.c.smithi022.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7fe4e8ecc1cf] 2022-04-28T14:41:51.979 INFO:tasks.ceph.mds.c.smithi022.stderr: 16: clone() 2022-04-28T14:41:51.979 INFO:tasks.ceph.mds.c.smithi022.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-04-28T14:41:51.979 INFO:tasks.ceph.mds.c.smithi022.stderr: 2022-04-28T14:41:51.979 INFO:tasks.ceph.mds.c.smithi022.stderr: -1> 2022-04-28T14:41:51.962+0000 7fe4dcec9700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.7-969-g4fa079ba/rpm/el8/BUILD/ceph-16.2.7-969-g4fa079ba/src/mds/CDir.cc: In function 'bool CDir::check_rstats(bool)' thread 7fe4dcec9700 time 2022-04-28T14:41:51.962522+0000 2022-04-28T14:41:51.979 INFO:tasks.ceph.mds.c.smithi022.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.7-969-g4fa079ba/rpm/el8/BUILD/ceph-16.2.7-969-g4fa079ba/src/mds/CDir.cc: 292: FAILED ceph_assert(frag_info.nsubdirs == fnode->fragstat.nsubdirs) 2022-04-28T14:41:51.980 INFO:tasks.ceph.mds.c.smithi022.stderr: 2022-04-28T14:41:51.980 INFO:tasks.ceph.mds.c.smithi022.stderr: ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable) 2022-04-28T14:41:51.980 INFO:tasks.ceph.mds.c.smithi022.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7fe4e9ee8d48] 2022-04-28T14:41:51.980 INFO:tasks.ceph.mds.c.smithi022.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x276f62) [0x7fe4e9ee8f62] 2022-04-28T14:41:51.980 INFO:tasks.ceph.mds.c.smithi022.stderr: 3: (CDir::check_rstats(bool)+0x17dd) [0x556d72a8642d] 2022-04-28T14:41:51.980 INFO:tasks.ceph.mds.c.smithi022.stderr: 4: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0xd56) [0x556d72937206] 2022-04-28T14:41:51.980 INFO:tasks.ceph.mds.c.smithi022.stderr: 5: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x8de) [0x556d729392de] 2022-04-28T14:41:51.980 INFO:tasks.ceph.mds.c.smithi022.stderr: 6: (MDCache::populate_mydir()+0x806) [0x556d7297fbb6] 2022-04-28T14:41:51.980 INFO:tasks.ceph.mds.c.smithi022.stderr: 7: (MDCache::open_root()+0xd8) [0x556d7297fea8] 2022-04-28T14:41:51.980 INFO:tasks.ceph.mds.c.smithi022.stderr: 8: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x556d729e4ab7] 2022-04-28T14:41:51.981 INFO:tasks.ceph.mds.c.smithi022.stderr: 9: (MDSContext::complete(int)+0x203) [0x556d72b43f93] 2022-04-28T14:41:51.981 INFO:tasks.ceph.mds.c.smithi022.stderr: 10: (MDSRank::_advance_queues()+0x84) [0x556d7283cc64] 2022-04-28T14:41:51.981 INFO:tasks.ceph.mds.c.smithi022.stderr: 11: (MDSRank::ProgressThread::entry()+0xc5) [0x556d7283d385] 2022-04-28T14:41:51.981 INFO:tasks.ceph.mds.c.smithi022.stderr: 12: /lib64/libpthread.so.0(+0x81cf) [0x7fe4e8ecc1cf] 2022-04-28T14:41:51.981 INFO:tasks.ceph.mds.c.smithi022.stderr: 13: clone() 2022-04-28T14:41:51.981 INFO:tasks.ceph.mds.c.smithi022.stderr: 2022-04-28T14:41:51.981 INFO:tasks.ceph.mds.c.smithi022.stderr: 0> 2022-04-28T14:41:51.963+0000 7fe4dcec9700 -1 *** Caught signal (Aborted) ** 2022-04-28T14:41:51.981 INFO:tasks.ceph.mds.c.smithi022.stderr: in thread 7fe4dcec9700 thread_name:mds_rank_progr 2022-04-28T14:41:51.981 INFO:tasks.ceph.mds.c.smithi022.stderr: 2022-04-28T14:41:51.982 INFO:tasks.ceph.mds.c.smithi022.stderr: ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable) 2022-04-28T14:41:51.982 INFO:tasks.ceph.mds.c.smithi022.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7fe4e8ed6ce0] 2022-04-28T14:41:51.982 INFO:tasks.ceph.mds.c.smithi022.stderr: 2: gsignal() 2022-04-28T14:41:51.982 INFO:tasks.ceph.mds.c.smithi022.stderr: 3: abort() 2022-04-28T14:41:51.982 INFO:tasks.ceph.mds.c.smithi022.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7fe4e9ee8d99] 2022-04-28T14:41:51.982 INFO:tasks.ceph.mds.c.smithi022.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x276f62) [0x7fe4e9ee8f62] 2022-04-28T14:41:51.982 INFO:tasks.ceph.mds.c.smithi022.stderr: 6: (CDir::check_rstats(bool)+0x17dd) [0x556d72a8642d] 2022-04-28T14:41:51.982 INFO:tasks.ceph.mds.c.smithi022.stderr: 7: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0xd56) [0x556d72937206] 2022-04-28T14:41:51.982 INFO:tasks.ceph.mds.c.smithi022.stderr: 8: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x8de) [0x556d729392de] 2022-04-28T14:41:51.982 INFO:tasks.ceph.mds.c.smithi022.stderr: 9: (MDCache::populate_mydir()+0x806) [0x556d7297fbb6] 2022-04-28T14:41:51.983 INFO:tasks.ceph.mds.c.smithi022.stderr: 10: (MDCache::open_root()+0xd8) [0x556d7297fea8] 2022-04-28T14:41:51.983 INFO:tasks.ceph.mds.c.smithi022.stderr: 11: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x556d729e4ab7] 2022-04-28T14:41:51.983 INFO:tasks.ceph.mds.c.smithi022.stderr: 12: (MDSContext::complete(int)+0x203) [0x556d72b43f93] 2022-04-28T14:41:51.983 INFO:tasks.ceph.mds.c.smithi022.stderr: 13: (MDSRank::_advance_queues()+0x84) [0x556d7283cc64] 2022-04-28T14:41:51.983 INFO:tasks.ceph.mds.c.smithi022.stderr: 14: (MDSRank::ProgressThread::entry()+0xc5) [0x556d7283d385] 2022-04-28T14:41:51.983 INFO:tasks.ceph.mds.c.smithi022.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7fe4e8ecc1cf] 2022-04-28T14:41:51.983 INFO:tasks.ceph.mds.c.smithi022.stderr: 16: clone() 2022-04-28T14:41:51.983 INFO:tasks.ceph.mds.c.smithi022.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-04-28T14:41:51.983 INFO:tasks.ceph.mds.c.smithi022.stderr: 2022-04-28T14:41:52.079 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.074+0000 7fa674af5700 1 Processor -- start 2022-04-28T14:41:52.079 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.074+0000 7fa674af5700 1 -- start start 2022-04-28T14:41:52.082 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.075+0000 7fa674af5700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa6700aec20 0x7fa67013b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:52.082 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.075+0000 7fa674af5700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa6700a55b0 0x7fa6700a3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:52.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.075+0000 7fa674af5700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6700af000 con 0x7fa6700a4170 2022-04-28T14:41:52.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.075+0000 7fa674af5700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa670135b90 con 0x7fa6700aec20 2022-04-28T14:41:52.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.075+0000 7fa674af5700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa67013bc60 con 0x7fa6700a55b0 2022-04-28T14:41:52.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.075+0000 7fa66e59c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa6700aec20 0x7fa67013b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:52.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.075+0000 7fa66ed9d700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa6700a4170 0x7fa6700abfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40524/0 (socket says 172.21.15.22:40524) 2022-04-28T14:41:52.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.075+0000 7fa66ed9d700 1 -- 172.21.15.22:0/1872879564 learned_addr learned my addr 172.21.15.22:0/1872879564 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:41:52.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.075+0000 7fa66dd9b700 1 --2- 172.21.15.22:0/1872879564 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa6700a55b0 0x7fa6700a3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:52.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.076+0000 7fa66d59a700 1 -- 172.21.15.22:0/1872879564 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 798550341 0 0) 0x7fa6700af000 con 0x7fa6700a4170 2022-04-28T14:41:52.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.076+0000 7fa66d59a700 1 -- 172.21.15.22:0/1872879564 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6500033f0 con 0x7fa6700a4170 2022-04-28T14:41:52.084 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.076+0000 7fa66e59c700 1 -- 172.21.15.22:0/1872879564 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa6700a55b0 msgr2=0x7fa6700a3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:52.084 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.076+0000 7fa66e59c700 1 --2- 172.21.15.22:0/1872879564 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa6700a55b0 0x7fa6700a3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:52.084 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.076+0000 7fa66e59c700 1 -- 172.21.15.22:0/1872879564 >> v1:172.21.15.22:6789/0 conn(0x7fa6700a4170 legacy=0x7fa6700abfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:52.084 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.076+0000 7fa66e59c700 1 -- 172.21.15.22:0/1872879564 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67013bf00 con 0x7fa6700aec20 2022-04-28T14:41:52.084 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.076+0000 7fa66dd9b700 1 --2- 172.21.15.22:0/1872879564 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa6700a55b0 0x7fa6700a3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:52.084 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.076+0000 7fa66e59c700 1 --2- 172.21.15.22:0/1872879564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6700aec20 0x7fa67013b640 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fa660009760 tx=0x7fa660009060).ready entity=mon.0 client_cookie=b07efa837ee876be server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:52.084 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.076+0000 7fa66d59a700 1 -- 172.21.15.22:0/1872879564 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66000d4a0 con 0x7fa6700aec20 2022-04-28T14:41:52.084 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.076+0000 7fa66d59a700 1 -- 172.21.15.22:0/1872879564 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66000d600 con 0x7fa6700aec20 2022-04-28T14:41:52.084 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.076+0000 7fa66d59a700 1 -- 172.21.15.22:0/1872879564 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66000d980 con 0x7fa6700aec20 2022-04-28T14:41:52.085 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.077+0000 7fa674af5700 1 -- 172.21.15.22:0/1872879564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6700aec20 msgr2=0x7fa67013b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:52.085 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.077+0000 7fa674af5700 1 --2- 172.21.15.22:0/1872879564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6700aec20 0x7fa67013b640 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fa660009760 tx=0x7fa660009060).stop 2022-04-28T14:41:52.085 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.077+0000 7fa674af5700 1 -- 172.21.15.22:0/1872879564 shutdown_connections 2022-04-28T14:41:52.085 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.077+0000 7fa674af5700 1 --2- 172.21.15.22:0/1872879564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6700aec20 0x7fa67013b640 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:52.085 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.077+0000 7fa674af5700 1 --2- 172.21.15.22:0/1872879564 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa6700a55b0 0x7fa6700a3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:52.085 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.077+0000 7fa674af5700 1 -- 172.21.15.22:0/1872879564 >> 172.21.15.22:0/1872879564 conn(0x7fa6700692a0 msgr2=0x7fa670062ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:52.085 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.077+0000 7fa674af5700 1 -- 172.21.15.22:0/1872879564 shutdown_connections 2022-04-28T14:41:52.085 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.077+0000 7fa674af5700 1 -- 172.21.15.22:0/1872879564 wait complete. 2022-04-28T14:41:52.085 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.078+0000 7fa674af5700 1 Processor -- start 2022-04-28T14:41:52.085 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.078+0000 7fa674af5700 1 -- start start 2022-04-28T14:41:52.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.078+0000 7fa674af5700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa6700a4170 0x7fa670147d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:52.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.078+0000 7fa674af5700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa6700aec20 0x7fa6700a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:52.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.078+0000 7fa674af5700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6700a7a80 0x7fa6700ab280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:52.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.078+0000 7fa674af5700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6700a6dc0 con 0x7fa6700a7a80 2022-04-28T14:41:52.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.078+0000 7fa674af5700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6701483e0 con 0x7fa6700aec20 2022-04-28T14:41:52.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.078+0000 7fa674af5700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa670148680 con 0x7fa6700a4170 2022-04-28T14:41:52.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.078+0000 7fa66e59c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa6700a4170 0x7fa670147d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:52.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.079+0000 7fa66e59c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa6700a4170 0x7fa670147d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48484/0 (socket says 172.21.15.22:48484) 2022-04-28T14:41:52.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.079+0000 7fa66e59c700 1 -- 172.21.15.22:0/4031906368 learned_addr learned my addr 172.21.15.22:0/4031906368 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:52.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.079+0000 7fa66ed9d700 1 --2- 172.21.15.22:0/4031906368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6700a7a80 0x7fa6700ab280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:52.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.079+0000 7fa66dd9b700 1 --2- 172.21.15.22:0/4031906368 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa6700aec20 0x7fa6700a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:52.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.079+0000 7fa66e59c700 1 -- 172.21.15.22:0/4031906368 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa6700aec20 msgr2=0x7fa6700a62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:52.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.079+0000 7fa66e59c700 1 --2- 172.21.15.22:0/4031906368 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa6700aec20 0x7fa6700a62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:52.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.079+0000 7fa66e59c700 1 -- 172.21.15.22:0/4031906368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6700a7a80 msgr2=0x7fa6700ab280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:52.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.079+0000 7fa66e59c700 1 --2- 172.21.15.22:0/4031906368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6700a7a80 0x7fa6700ab280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:52.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.079+0000 7fa66e59c700 1 -- 172.21.15.22:0/4031906368 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6580092a0 con 0x7fa6700a4170 2022-04-28T14:41:52.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.079+0000 7fa66e59c700 1 --2- 172.21.15.22:0/4031906368 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa6700a4170 0x7fa670147d60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fa660009d50 tx=0x7fa660016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:52.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.079+0000 7fa6667fc700 1 -- 172.21.15.22:0/4031906368 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66000dd30 con 0x7fa6700a4170 2022-04-28T14:41:52.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.079+0000 7fa6667fc700 1 -- 172.21.15.22:0/4031906368 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66000de90 con 0x7fa6700a4170 2022-04-28T14:41:52.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.079+0000 7fa674af5700 1 -- 172.21.15.22:0/4031906368 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6600092a0 con 0x7fa6700a4170 2022-04-28T14:41:52.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.079+0000 7fa6667fc700 1 -- 172.21.15.22:0/4031906368 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66000d980 con 0x7fa6700a4170 2022-04-28T14:41:52.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.079+0000 7fa674af5700 1 -- 172.21.15.22:0/4031906368 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6700a6790 con 0x7fa6700a4170 2022-04-28T14:41:52.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.080+0000 7fa6667fc700 1 -- 172.21.15.22:0/4031906368 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7fa66000f070 con 0x7fa6700a4170 2022-04-28T14:41:52.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.080+0000 7fa674af5700 1 -- 172.21.15.22:0/4031906368 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6701418d0 con 0x7fa6700a4170 2022-04-28T14:41:52.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.080+0000 7fa6667fc700 1 -- 172.21.15.22:0/4031906368 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 3793+0+0 (secure 0 0 0) 0x7fa660056c30 con 0x7fa6700a4170 2022-04-28T14:41:52.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.084+0000 7fa6667fc700 1 -- 172.21.15.22:0/4031906368 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7fa660002950 con 0x7fa6700a4170 2022-04-28T14:41:52.198 INFO:tasks.ceph.mds.c.smithi022.stderr:daemon-helper: command crashed with signal 6 2022-04-28T14:41:52.227 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.223+0000 7fa674af5700 1 -- 172.21.15.22:0/4031906368 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fa67006c350 con 0x7fa6700a4170 2022-04-28T14:41:52.964 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.957+0000 7fa6667fc700 1 -- 172.21.15.22:0/4031906368 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 3 pg_autoscale_mode to off v38) v1 ==== 160+0+0 (secure 0 0 0) 0x7fa660002950 con 0x7fa6700a4170 2022-04-28T14:41:52.965 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.961+0000 7fa674af5700 1 -- 172.21.15.22:0/4031906368 >> v1:172.21.15.22:6808/92758 conn(0x7fa654041b00 legacy=0x7fa654043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:52.965 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.961+0000 7fa674af5700 1 -- 172.21.15.22:0/4031906368 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa6700a4170 msgr2=0x7fa670147d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:52.965 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.961+0000 7fa674af5700 1 --2- 172.21.15.22:0/4031906368 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa6700a4170 0x7fa670147d60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fa660009d50 tx=0x7fa660016000).stop 2022-04-28T14:41:52.966 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.962+0000 7fa674af5700 1 -- 172.21.15.22:0/4031906368 shutdown_connections 2022-04-28T14:41:52.967 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.962+0000 7fa674af5700 1 --2- 172.21.15.22:0/4031906368 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6700a7a80 0x7fa6700ab280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:52.967 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.962+0000 7fa674af5700 1 --2- 172.21.15.22:0/4031906368 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa6700a4170 0x7fa670147d60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:52.967 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.962+0000 7fa674af5700 1 --2- 172.21.15.22:0/4031906368 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa6700aec20 0x7fa6700a62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:52.967 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.962+0000 7fa674af5700 1 -- 172.21.15.22:0/4031906368 >> 172.21.15.22:0/4031906368 conn(0x7fa6700692a0 msgr2=0x7fa67013ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:52.967 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.962+0000 7fa674af5700 1 -- 172.21.15.22:0/4031906368 shutdown_connections 2022-04-28T14:41:52.967 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:52.962+0000 7fa674af5700 1 -- 172.21.15.22:0/4031906368 wait complete. 2022-04-28T14:41:52.967 INFO:teuthology.orchestra.run.smithi022.stderr:set pool 3 pg_autoscale_mode to off 2022-04-28T14:41:53.078 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.073+0000 7f1493dfa700 1 Processor -- start 2022-04-28T14:41:53.078 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.074+0000 7f1493dfa700 1 -- start start 2022-04-28T14:41:53.081 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.074+0000 7f1493dfa700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f148c0abc80 0x7f148c13bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:53.081 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.074+0000 7f1493dfa700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f148c13c460 0x7f148c138ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:53.081 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.074+0000 7f1493dfa700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f148c0a3e20 0x7f148c05dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:53.081 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.074+0000 7f1493dfa700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148c0ac060 con 0x7f148c13c460 2022-04-28T14:41:53.082 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.074+0000 7f1493dfa700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c138420 con 0x7f148c0abc80 2022-04-28T14:41:53.082 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.074+0000 7f1493dfa700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f148c138680 con 0x7f148c0a3e20 2022-04-28T14:41:53.082 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.074+0000 7f1491b96700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f148c0abc80 0x7f148c13bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:53.082 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.074+0000 7f1491395700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f148c13c460 0x7f148c138ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:53.082 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.074+0000 7f1492397700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f148c0a3e20 0x7f148c05dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:53.082 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.074+0000 7f1491395700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f148c13c460 0x7f148c138ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51152/0 (socket says 172.21.15.22:51152) 2022-04-28T14:41:53.082 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.074+0000 7f1492397700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f148c0a3e20 0x7f148c05dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48506/0 (socket says 172.21.15.22:48506) 2022-04-28T14:41:53.082 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.074+0000 7f1491b96700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f148c0abc80 0x7f148c13bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48718/0 (socket says 172.21.15.22:48718) 2022-04-28T14:41:53.082 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.074+0000 7f1491395700 1 -- 172.21.15.22:0/802172234 learned_addr learned my addr 172.21.15.22:0/802172234 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:53.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.075+0000 7f1491395700 1 -- 172.21.15.22:0/802172234 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f148c0a3e20 msgr2=0x7f148c05dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:53.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.075+0000 7f1491395700 1 --2- 172.21.15.22:0/802172234 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f148c0a3e20 0x7f148c05dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:53.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.075+0000 7f1491395700 1 -- 172.21.15.22:0/802172234 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f148c0abc80 msgr2=0x7f148c13bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:53.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.075+0000 7f1491395700 1 --2- 172.21.15.22:0/802172234 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f148c0abc80 0x7f148c13bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:53.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.075+0000 7f1491395700 1 -- 172.21.15.22:0/802172234 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c0698f0 con 0x7f148c13c460 2022-04-28T14:41:53.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.075+0000 7f1492397700 1 --2- 172.21.15.22:0/802172234 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f148c0a3e20 0x7f148c05dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:53.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.075+0000 7f1491b96700 1 --2- 172.21.15.22:0/802172234 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f148c0abc80 0x7f148c13bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:53.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.075+0000 7f1491395700 1 --2- 172.21.15.22:0/802172234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f148c13c460 0x7f148c138ab0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f1488006fd0 tx=0x7f14880090f0).ready entity=mon.0 client_cookie=bcc6627815c0bac server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:53.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.075+0000 7f1490b94700 1 -- 172.21.15.22:0/802172234 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148800f510 con 0x7f148c13c460 2022-04-28T14:41:53.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.075+0000 7f1490b94700 1 -- 172.21.15.22:0/802172234 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148800f670 con 0x7f148c13c460 2022-04-28T14:41:53.083 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.075+0000 7f1490b94700 1 -- 172.21.15.22:0/802172234 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148800f9f0 con 0x7f148c13c460 2022-04-28T14:41:53.084 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.075+0000 7f1493dfa700 1 -- 172.21.15.22:0/802172234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f148c13c460 msgr2=0x7f148c138ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:53.084 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.075+0000 7f1493dfa700 1 --2- 172.21.15.22:0/802172234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f148c13c460 0x7f148c138ab0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f1488006fd0 tx=0x7f14880090f0).stop 2022-04-28T14:41:53.084 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.076+0000 7f1493dfa700 1 -- 172.21.15.22:0/802172234 shutdown_connections 2022-04-28T14:41:53.084 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.076+0000 7f1493dfa700 1 --2- 172.21.15.22:0/802172234 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f148c0a3e20 0x7f148c05dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:53.084 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.076+0000 7f1493dfa700 1 --2- 172.21.15.22:0/802172234 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f148c0abc80 0x7f148c13bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:53.084 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.076+0000 7f1493dfa700 1 --2- 172.21.15.22:0/802172234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f148c13c460 0x7f148c138ab0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:53.084 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.076+0000 7f1493dfa700 1 -- 172.21.15.22:0/802172234 >> 172.21.15.22:0/802172234 conn(0x7f148c06b2e0 msgr2=0x7f148c065f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:53.084 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.076+0000 7f1493dfa700 1 -- 172.21.15.22:0/802172234 shutdown_connections 2022-04-28T14:41:53.084 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.076+0000 7f1493dfa700 1 -- 172.21.15.22:0/802172234 wait complete. 2022-04-28T14:41:53.084 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.077+0000 7f1493dfa700 1 Processor -- start 2022-04-28T14:41:53.085 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.077+0000 7f1493dfa700 1 -- start start 2022-04-28T14:41:53.087 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.077+0000 7f1493dfa700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f148c0a3e20 0x7f148c136840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:53.087 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.077+0000 7f1493dfa700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f148c0abc80 0x7f148c0a7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:53.087 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.077+0000 7f1493dfa700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f148c13c460 0x7f148c135430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:53.087 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.077+0000 7f1493dfa700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c0a7540 con 0x7f148c0abc80 2022-04-28T14:41:53.087 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.077+0000 7f1493dfa700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c0a59a0 con 0x7f148c13c460 2022-04-28T14:41:53.087 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.077+0000 7f1493dfa700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f148c0a5c60 con 0x7f148c0a3e20 2022-04-28T14:41:53.087 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.077+0000 7f1491b96700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f148c0a3e20 0x7f148c136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:53.087 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.077+0000 7f1491b96700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f148c0a3e20 0x7f148c136840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48508/0 (socket says 172.21.15.22:48508) 2022-04-28T14:41:53.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.077+0000 7f1491b96700 1 -- 172.21.15.22:0/3952067288 learned_addr learned my addr 172.21.15.22:0/3952067288 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:53.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.077+0000 7f1492397700 1 --2- 172.21.15.22:0/3952067288 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f148c13c460 0x7f148c135430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:53.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.077+0000 7f1491395700 1 --2- 172.21.15.22:0/3952067288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f148c0abc80 0x7f148c0a7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:53.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.078+0000 7f1491b96700 1 -- 172.21.15.22:0/3952067288 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f148c13c460 msgr2=0x7f148c135430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:53.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.078+0000 7f1491b96700 1 --2- 172.21.15.22:0/3952067288 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f148c13c460 0x7f148c135430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:53.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.078+0000 7f1491b96700 1 -- 172.21.15.22:0/3952067288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f148c0abc80 msgr2=0x7f148c0a7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:53.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.078+0000 7f1491b96700 1 --2- 172.21.15.22:0/3952067288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f148c0abc80 0x7f148c0a7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:53.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.078+0000 7f1491b96700 1 -- 172.21.15.22:0/3952067288 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1484009a20 con 0x7f148c0a3e20 2022-04-28T14:41:53.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.078+0000 7f1491395700 1 --2- 172.21.15.22:0/3952067288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f148c0abc80 0x7f148c0a7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:53.088 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.078+0000 7f1492397700 1 --2- 172.21.15.22:0/3952067288 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f148c13c460 0x7f148c135430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:53.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.078+0000 7f1491b96700 1 --2- 172.21.15.22:0/3952067288 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f148c0a3e20 0x7f148c136840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f147c00ea20 tx=0x7f147c009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:53.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.078+0000 7f1479ffb700 1 -- 172.21.15.22:0/3952067288 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c00ee60 con 0x7f148c0a3e20 2022-04-28T14:41:53.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.078+0000 7f1479ffb700 1 -- 172.21.15.22:0/3952067288 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147c00c8e0 con 0x7f148c0a3e20 2022-04-28T14:41:53.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.078+0000 7f1493dfa700 1 -- 172.21.15.22:0/3952067288 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147c0092a0 con 0x7f148c0a3e20 2022-04-28T14:41:53.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.078+0000 7f1479ffb700 1 -- 172.21.15.22:0/3952067288 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c00cc60 con 0x7f148c0a3e20 2022-04-28T14:41:53.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.078+0000 7f1493dfa700 1 -- 172.21.15.22:0/3952067288 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1488009370 con 0x7f148c0a3e20 2022-04-28T14:41:53.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.079+0000 7f1479ffb700 1 -- 172.21.15.22:0/3952067288 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f147c022070 con 0x7f148c0a3e20 2022-04-28T14:41:53.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.079+0000 7f1493dfa700 1 -- 172.21.15.22:0/3952067288 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148c13ba60 con 0x7f148c0a3e20 2022-04-28T14:41:53.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.079+0000 7f1479ffb700 1 -- 172.21.15.22:0/3952067288 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 3793+0+0 (secure 0 0 0) 0x7f147c0558a0 con 0x7f148c0a3e20 2022-04-28T14:41:53.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.083+0000 7f1479ffb700 1 -- 172.21.15.22:0/3952067288 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f147c035ec0 con 0x7f148c0a3e20 2022-04-28T14:41:53.227 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.223+0000 7f1493dfa700 1 -- 172.21.15.22:0/3952067288 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f148c06c350 con 0x7f148c0a3e20 2022-04-28T14:41:53.967 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.962+0000 7f1479ffb700 1 -- 172.21.15.22:0/3952067288 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "device_health_metrics", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 4 pg_autoscale_mode to off v39) v1 ==== 170+0+0 (secure 0 0 0) 0x7f147c039670 con 0x7f148c0a3e20 2022-04-28T14:41:53.970 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.965+0000 7f1493dfa700 1 -- 172.21.15.22:0/3952067288 >> v1:172.21.15.22:6808/92758 conn(0x7f146c041b30 legacy=0x7f146c043ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:53.970 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.965+0000 7f1493dfa700 1 -- 172.21.15.22:0/3952067288 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f148c0a3e20 msgr2=0x7f148c136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:53.970 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.965+0000 7f1493dfa700 1 --2- 172.21.15.22:0/3952067288 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f148c0a3e20 0x7f148c136840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f147c00ea20 tx=0x7f147c009060).stop 2022-04-28T14:41:53.971 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.965+0000 7f1493dfa700 1 -- 172.21.15.22:0/3952067288 shutdown_connections 2022-04-28T14:41:53.971 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.965+0000 7f1493dfa700 1 --2- 172.21.15.22:0/3952067288 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f148c13c460 0x7f148c135430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:53.971 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.965+0000 7f1493dfa700 1 --2- 172.21.15.22:0/3952067288 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f148c0a3e20 0x7f148c136840 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:53.971 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.965+0000 7f1493dfa700 1 --2- 172.21.15.22:0/3952067288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f148c0abc80 0x7f148c0a7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:53.971 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.965+0000 7f1493dfa700 1 -- 172.21.15.22:0/3952067288 >> 172.21.15.22:0/3952067288 conn(0x7f148c06b2e0 msgr2=0x7f148c062660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:53.971 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.966+0000 7f1493dfa700 1 -- 172.21.15.22:0/3952067288 shutdown_connections 2022-04-28T14:41:53.971 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:53.966+0000 7f1493dfa700 1 -- 172.21.15.22:0/3952067288 wait complete. 2022-04-28T14:41:53.973 INFO:teuthology.orchestra.run.smithi022.stderr:set pool 4 pg_autoscale_mode to off 2022-04-28T14:41:53.986 INFO:teuthology.run_tasks:Running task ceph.healthy... 2022-04-28T14:41:54.002 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2022-04-28T14:41:54.002 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2022-04-28T14:41:54.002 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2022-04-28T14:41:54.150 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.146+0000 7ff8e3ad4700 1 Processor -- start 2022-04-28T14:41:54.151 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.146+0000 7ff8e3ad4700 1 -- start start 2022-04-28T14:41:54.153 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.146+0000 7ff8e3ad4700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff8dc069200 0x7ff8dc138680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:54.153 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.146+0000 7ff8e3ad4700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff8dc138b70 0x7ff8dc139020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.147+0000 7ff8e3ad4700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8dc0624d0 con 0x7ff8dc0620f0 2022-04-28T14:41:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.147+0000 7ff8e3ad4700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc067ca0 con 0x7ff8dc138b70 2022-04-28T14:41:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.147+0000 7ff8e3ad4700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc0679e0 con 0x7ff8dc069200 2022-04-28T14:41:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.147+0000 7ff8e2071700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff8dc138b70 0x7ff8dc139020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.147+0000 7ff8e106f700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff8dc069200 0x7ff8dc138680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.147+0000 7ff8e1870700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff8dc0620f0 0x7ff8dc0672d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40566/0 (socket says 172.21.15.22:40566) 2022-04-28T14:41:54.154 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.147+0000 7ff8e1870700 1 -- 172.21.15.22:0/3748399748 learned_addr learned my addr 172.21.15.22:0/3748399748 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:41:54.155 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.147+0000 7ff8e106f700 1 -- 172.21.15.22:0/3748399748 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff8dc138b70 msgr2=0x7ff8dc139020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:54.155 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.147+0000 7ff8e086e700 1 -- 172.21.15.22:0/3748399748 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3859882015 0 0) 0x7ff8dc0624d0 con 0x7ff8dc0620f0 2022-04-28T14:41:54.155 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.147+0000 7ff8e106f700 1 --2- 172.21.15.22:0/3748399748 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff8dc138b70 0x7ff8dc139020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:54.155 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.147+0000 7ff8e106f700 1 -- 172.21.15.22:0/3748399748 >> v1:172.21.15.22:6789/0 conn(0x7ff8dc0620f0 legacy=0x7ff8dc0672d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:54.155 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.147+0000 7ff8e106f700 1 -- 172.21.15.22:0/3748399748 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc068a20 con 0x7ff8dc069200 2022-04-28T14:41:54.155 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.147+0000 7ff8e2071700 1 --2- 172.21.15.22:0/3748399748 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff8dc138b70 0x7ff8dc139020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:54.155 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.147+0000 7ff8e106f700 1 --2- 172.21.15.22:0/3748399748 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff8dc069200 0x7ff8dc138680 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7ff8d80097c0 tx=0x7ff8d8009060).ready entity=mon.2 client_cookie=f055c6155d2c0b60 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:54.155 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.147+0000 7ff8e086e700 1 -- 172.21.15.22:0/3748399748 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d800f510 con 0x7ff8dc069200 2022-04-28T14:41:54.155 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.147+0000 7ff8e086e700 1 -- 172.21.15.22:0/3748399748 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d800f670 con 0x7ff8dc069200 2022-04-28T14:41:54.156 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.147+0000 7ff8e086e700 1 -- 172.21.15.22:0/3748399748 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d800f9f0 con 0x7ff8dc069200 2022-04-28T14:41:54.156 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.148+0000 7ff8e3ad4700 1 -- 172.21.15.22:0/3748399748 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff8dc069200 msgr2=0x7ff8dc138680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:54.156 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.148+0000 7ff8e3ad4700 1 --2- 172.21.15.22:0/3748399748 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff8dc069200 0x7ff8dc138680 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7ff8d80097c0 tx=0x7ff8d8009060).stop 2022-04-28T14:41:54.156 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.148+0000 7ff8e3ad4700 1 -- 172.21.15.22:0/3748399748 shutdown_connections 2022-04-28T14:41:54.156 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.148+0000 7ff8e3ad4700 1 --2- 172.21.15.22:0/3748399748 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff8dc138b70 0x7ff8dc139020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:54.156 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.148+0000 7ff8e3ad4700 1 --2- 172.21.15.22:0/3748399748 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff8dc069200 0x7ff8dc138680 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:54.156 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.148+0000 7ff8e3ad4700 1 -- 172.21.15.22:0/3748399748 >> 172.21.15.22:0/3748399748 conn(0x7ff8dc0aa5c0 msgr2=0x7ff8dc0aa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:54.156 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.148+0000 7ff8e3ad4700 1 -- 172.21.15.22:0/3748399748 shutdown_connections 2022-04-28T14:41:54.157 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.148+0000 7ff8e3ad4700 1 -- 172.21.15.22:0/3748399748 wait complete. 2022-04-28T14:41:54.157 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.149+0000 7ff8e3ad4700 1 Processor -- start 2022-04-28T14:41:54.157 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.149+0000 7ff8e3ad4700 1 -- start start 2022-04-28T14:41:54.162 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.149+0000 7ff8e3ad4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8dc0620f0 0x7ff8dc062980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:54.162 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.149+0000 7ff8e3ad4700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff8dc069200 0x7ff8dc0a39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:54.162 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.149+0000 7ff8e3ad4700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff8dc138b70 0x7ff8dc14b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:54.162 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.149+0000 7ff8e3ad4700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc0a1460 con 0x7ff8dc0620f0 2022-04-28T14:41:54.162 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.149+0000 7ff8e3ad4700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc0a1720 con 0x7ff8dc138b70 2022-04-28T14:41:54.163 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.149+0000 7ff8e3ad4700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc0a4530 con 0x7ff8dc069200 2022-04-28T14:41:54.163 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.150+0000 7ff8e1870700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8dc0620f0 0x7ff8dc062980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:54.163 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.150+0000 7ff8e2071700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff8dc138b70 0x7ff8dc14b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:54.163 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.150+0000 7ff8e2071700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff8dc138b70 0x7ff8dc14b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48748/0 (socket says 172.21.15.22:48748) 2022-04-28T14:41:54.163 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.150+0000 7ff8e1870700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8dc0620f0 0x7ff8dc062980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51176/0 (socket says 172.21.15.22:51176) 2022-04-28T14:41:54.163 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.150+0000 7ff8e2071700 1 -- 172.21.15.22:0/2081430327 learned_addr learned my addr 172.21.15.22:0/2081430327 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:54.163 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.150+0000 7ff8e106f700 1 --2- 172.21.15.22:0/2081430327 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff8dc069200 0x7ff8dc0a39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:54.163 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.150+0000 7ff8e2071700 1 -- 172.21.15.22:0/2081430327 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff8dc069200 msgr2=0x7ff8dc0a39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:54.163 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.150+0000 7ff8e2071700 1 --2- 172.21.15.22:0/2081430327 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff8dc069200 0x7ff8dc0a39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:54.163 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.150+0000 7ff8e2071700 1 -- 172.21.15.22:0/2081430327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8dc0620f0 msgr2=0x7ff8dc062980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:54.164 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.150+0000 7ff8e2071700 1 --2- 172.21.15.22:0/2081430327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8dc0620f0 0x7ff8dc062980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:54.164 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.150+0000 7ff8e2071700 1 -- 172.21.15.22:0/2081430327 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d4009a20 con 0x7ff8dc138b70 2022-04-28T14:41:54.164 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.150+0000 7ff8e106f700 1 --2- 172.21.15.22:0/2081430327 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff8dc069200 0x7ff8dc0a39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:54.164 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.150+0000 7ff8e1870700 1 --2- 172.21.15.22:0/2081430327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8dc0620f0 0x7ff8dc062980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:54.164 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.150+0000 7ff8e2071700 1 --2- 172.21.15.22:0/2081430327 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff8dc138b70 0x7ff8dc14b230 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7ff8d4009f20 tx=0x7ff8d400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:54.164 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.150+0000 7ff8c9ffb700 1 -- 172.21.15.22:0/2081430327 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d400cc00 con 0x7ff8dc138b70 2022-04-28T14:41:54.164 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.150+0000 7ff8c9ffb700 1 -- 172.21.15.22:0/2081430327 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d400f040 con 0x7ff8dc138b70 2022-04-28T14:41:54.164 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.150+0000 7ff8e3ad4700 1 -- 172.21.15.22:0/2081430327 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d80092a0 con 0x7ff8dc138b70 2022-04-28T14:41:54.165 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.150+0000 7ff8c9ffb700 1 -- 172.21.15.22:0/2081430327 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4013400 con 0x7ff8dc138b70 2022-04-28T14:41:54.165 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.150+0000 7ff8e3ad4700 1 -- 172.21.15.22:0/2081430327 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8dc063590 con 0x7ff8dc138b70 2022-04-28T14:41:54.165 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.151+0000 7ff8e3ad4700 1 -- 172.21.15.22:0/2081430327 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8dc0a4860 con 0x7ff8dc138b70 2022-04-28T14:41:54.165 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.151+0000 7ff8c9ffb700 1 -- 172.21.15.22:0/2081430327 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7ff8d40137f0 con 0x7ff8dc138b70 2022-04-28T14:41:54.165 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.152+0000 7ff8c9ffb700 1 -- 172.21.15.22:0/2081430327 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7ff8d4055ef0 con 0x7ff8dc138b70 2022-04-28T14:41:54.165 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.155+0000 7ff8c9ffb700 1 -- 172.21.15.22:0/2081430327 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7ff8dc0a4860 con 0x7ff8dc138b70 2022-04-28T14:41:54.327 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.322+0000 7ff8e3ad4700 1 -- 172.21.15.22:0/2081430327 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff8dc0a4860 con 0x7ff8dc138b70 2022-04-28T14:41:54.329 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.324+0000 7ff8c9ffb700 1 -- 172.21.15.22:0/2081430327 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v8) v1 ==== 74+0+97655 (secure 0 0 0) 0x7ff8dc0a4860 con 0x7ff8dc138b70 2022-04-28T14:41:54.330 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:41:54.332 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.326+0000 7ff8e3ad4700 1 -- 172.21.15.22:0/2081430327 >> v1:172.21.15.22:6808/92758 conn(0x7ff8bc041b00 legacy=0x7ff8bc043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:54.332 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.326+0000 7ff8e3ad4700 1 -- 172.21.15.22:0/2081430327 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff8dc138b70 msgr2=0x7ff8dc14b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:54.332 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.326+0000 7ff8e3ad4700 1 --2- 172.21.15.22:0/2081430327 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff8dc138b70 0x7ff8dc14b230 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7ff8d4009f20 tx=0x7ff8d400b040).stop 2022-04-28T14:41:54.332 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.326+0000 7ff8e3ad4700 1 -- 172.21.15.22:0/2081430327 shutdown_connections 2022-04-28T14:41:54.332 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.326+0000 7ff8e3ad4700 1 --2- 172.21.15.22:0/2081430327 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff8dc138b70 0x7ff8dc14b230 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:54.332 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.326+0000 7ff8e3ad4700 1 --2- 172.21.15.22:0/2081430327 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8dc0620f0 0x7ff8dc062980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:54.332 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.326+0000 7ff8e3ad4700 1 --2- 172.21.15.22:0/2081430327 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff8dc069200 0x7ff8dc0a39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:54.333 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.326+0000 7ff8e3ad4700 1 -- 172.21.15.22:0/2081430327 >> 172.21.15.22:0/2081430327 conn(0x7ff8dc0aa5c0 msgr2=0x7ff8dc0a9980 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:54.333 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.326+0000 7ff8e3ad4700 1 -- 172.21.15.22:0/2081430327 shutdown_connections 2022-04-28T14:41:54.333 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.326+0000 7ff8e3ad4700 1 -- 172.21.15.22:0/2081430327 wait complete. 2022-04-28T14:41:54.342 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"active_gid":14100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6808","nonce":92758}]},"active_addr":"172.21.15.22:6808/92758","active_change":"2022-04-28T14:41:24.303169+0000","active_mgr_features":4540138297136906239,"available":true,"standbys":[{"gid":14104,"name":"x","mgr_features":4540138297136906239,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":18,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":77447584}]},{"addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":2103168742}]},{"addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":3812817240}]},{"addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":1730821186}]},{"addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":3133241437}]}]}} 2022-04-28T14:41:54.355 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2022-04-28T14:41:54.355 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2022-04-28T14:41:54.356 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-28T14:41:54.474 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.470+0000 7fe28d1c1700 1 Processor -- start 2022-04-28T14:41:54.474 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.470+0000 7fe28d1c1700 1 -- start start 2022-04-28T14:41:54.477 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.470+0000 7fe28d1c1700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe2880a5450 0x7fe288067010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:54.477 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.470+0000 7fe28d1c1700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe288135740 0x7fe28813b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:54.477 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.470+0000 7fe28d1c1700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2880a5cd0 con 0x7fe28813be70 2022-04-28T14:41:54.478 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.470+0000 7fe28d1c1700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2880a5830 con 0x7fe288135740 2022-04-28T14:41:54.478 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.470+0000 7fe28d1c1700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28813c350 con 0x7fe2880a5450 2022-04-28T14:41:54.478 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.470+0000 7fe28659c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe288135740 0x7fe28813b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:54.478 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.470+0000 7fe28759e700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe28813be70 0x7fe2881381e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40584/0 (socket says 172.21.15.22:40584) 2022-04-28T14:41:54.478 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.470+0000 7fe28759e700 1 -- 172.21.15.22:0/1058027783 learned_addr learned my addr 172.21.15.22:0/1058027783 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:41:54.478 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.470+0000 7fe286d9d700 1 --2- 172.21.15.22:0/1058027783 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe2880a5450 0x7fe288067010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:54.478 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.471+0000 7fe28659c700 1 -- 172.21.15.22:0/1058027783 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe2880a5450 msgr2=0x7fe288067010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:54.478 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.471+0000 7fe28659c700 1 --2- 172.21.15.22:0/1058027783 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe2880a5450 0x7fe288067010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:54.479 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.471+0000 7fe28659c700 1 -- 172.21.15.22:0/1058027783 >> v1:172.21.15.22:6789/0 conn(0x7fe28813be70 legacy=0x7fe2881381e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:54.479 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.471+0000 7fe285d9b700 1 -- 172.21.15.22:0/1058027783 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 468881293 0 0) 0x7fe2880a5cd0 con 0x7fe28813be70 2022-04-28T14:41:54.479 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.471+0000 7fe28659c700 1 -- 172.21.15.22:0/1058027783 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28813c5f0 con 0x7fe288135740 2022-04-28T14:41:54.479 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.471+0000 7fe28659c700 1 --2- 172.21.15.22:0/1058027783 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe288135740 0x7fe28813b980 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fe27c009760 tx=0x7fe27c009060).ready entity=mon.0 client_cookie=f5af4091b2b72e5a server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:54.479 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.471+0000 7fe285d9b700 1 -- 172.21.15.22:0/1058027783 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c00f510 con 0x7fe288135740 2022-04-28T14:41:54.479 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.471+0000 7fe285d9b700 1 -- 172.21.15.22:0/1058027783 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27c00f670 con 0x7fe288135740 2022-04-28T14:41:54.479 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.471+0000 7fe285d9b700 1 -- 172.21.15.22:0/1058027783 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c00f9f0 con 0x7fe288135740 2022-04-28T14:41:54.479 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.471+0000 7fe28d1c1700 1 -- 172.21.15.22:0/1058027783 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe288135740 msgr2=0x7fe28813b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:54.479 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.471+0000 7fe28d1c1700 1 --2- 172.21.15.22:0/1058027783 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe288135740 0x7fe28813b980 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fe27c009760 tx=0x7fe27c009060).stop 2022-04-28T14:41:54.480 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.471+0000 7fe28d1c1700 1 -- 172.21.15.22:0/1058027783 shutdown_connections 2022-04-28T14:41:54.480 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.471+0000 7fe28d1c1700 1 --2- 172.21.15.22:0/1058027783 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe2880a5450 0x7fe288067010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:54.480 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.471+0000 7fe28d1c1700 1 --2- 172.21.15.22:0/1058027783 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe288135740 0x7fe28813b980 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:54.480 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.471+0000 7fe28d1c1700 1 -- 172.21.15.22:0/1058027783 >> 172.21.15.22:0/1058027783 conn(0x7fe288069860 msgr2=0x7fe288069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:54.480 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.471+0000 7fe28d1c1700 1 -- 172.21.15.22:0/1058027783 shutdown_connections 2022-04-28T14:41:54.480 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.471+0000 7fe28d1c1700 1 -- 172.21.15.22:0/1058027783 wait complete. 2022-04-28T14:41:54.480 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.472+0000 7fe28d1c1700 1 Processor -- start 2022-04-28T14:41:54.480 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.473+0000 7fe28d1c1700 1 -- start start 2022-04-28T14:41:54.483 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.473+0000 7fe28d1c1700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe2880a5450 0x7fe288117330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:54.483 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.473+0000 7fe28d1c1700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe288135740 0x7fe288115c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:54.483 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.473+0000 7fe28d1c1700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe28813be70 0x7fe288148450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:54.483 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.473+0000 7fe28d1c1700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2880a9f50 con 0x7fe288135740 2022-04-28T14:41:54.483 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.473+0000 7fe28d1c1700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe288114df0 con 0x7fe28813be70 2022-04-28T14:41:54.483 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.473+0000 7fe28d1c1700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe288134500 con 0x7fe2880a5450 2022-04-28T14:41:54.484 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.473+0000 7fe28759e700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe28813be70 0x7fe288148450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:54.484 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.473+0000 7fe286d9d700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe2880a5450 0x7fe288117330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:54.484 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.473+0000 7fe28659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe288135740 0x7fe288115c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:54.484 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.473+0000 7fe286d9d700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe2880a5450 0x7fe288117330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48542/0 (socket says 172.21.15.22:48542) 2022-04-28T14:41:54.484 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.473+0000 7fe28759e700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe28813be70 0x7fe288148450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48762/0 (socket says 172.21.15.22:48762) 2022-04-28T14:41:54.484 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.473+0000 7fe286d9d700 1 -- 172.21.15.22:0/2334282707 learned_addr learned my addr 172.21.15.22:0/2334282707 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:54.484 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.474+0000 7fe286d9d700 1 -- 172.21.15.22:0/2334282707 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe28813be70 msgr2=0x7fe288148450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:54.484 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.474+0000 7fe286d9d700 1 --2- 172.21.15.22:0/2334282707 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe28813be70 0x7fe288148450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:54.484 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.474+0000 7fe286d9d700 1 -- 172.21.15.22:0/2334282707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe288135740 msgr2=0x7fe288115c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:54.484 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.474+0000 7fe286d9d700 1 --2- 172.21.15.22:0/2334282707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe288135740 0x7fe288115c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:54.485 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.474+0000 7fe286d9d700 1 -- 172.21.15.22:0/2334282707 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27c0092a0 con 0x7fe2880a5450 2022-04-28T14:41:54.485 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.474+0000 7fe28659c700 1 --2- 172.21.15.22:0/2334282707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe288135740 0x7fe288115c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:54.485 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.474+0000 7fe286d9d700 1 --2- 172.21.15.22:0/2334282707 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe2880a5450 0x7fe288117330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fe27800e930 tx=0x7fe278009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:54.485 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.474+0000 7fe26effd700 1 -- 172.21.15.22:0/2334282707 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27800c680 con 0x7fe2880a5450 2022-04-28T14:41:54.485 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.474+0000 7fe26effd700 1 -- 172.21.15.22:0/2334282707 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27800c7e0 con 0x7fe2880a5450 2022-04-28T14:41:54.485 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.474+0000 7fe28d1c1700 1 -- 172.21.15.22:0/2334282707 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2881480f0 con 0x7fe2880a5450 2022-04-28T14:41:54.485 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.474+0000 7fe26effd700 1 -- 172.21.15.22:0/2334282707 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27800cb60 con 0x7fe2880a5450 2022-04-28T14:41:54.485 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.474+0000 7fe28d1c1700 1 -- 172.21.15.22:0/2334282707 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe288114a80 con 0x7fe2880a5450 2022-04-28T14:41:54.485 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.475+0000 7fe26effd700 1 -- 172.21.15.22:0/2334282707 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7fe278022070 con 0x7fe2880a5450 2022-04-28T14:41:54.485 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.475+0000 7fe28d1c1700 1 -- 172.21.15.22:0/2334282707 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2880ac350 con 0x7fe2880a5450 2022-04-28T14:41:54.485 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.475+0000 7fe26effd700 1 -- 172.21.15.22:0/2334282707 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7fe2780557c0 con 0x7fe2880a5450 2022-04-28T14:41:54.486 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.479+0000 7fe26effd700 1 -- 172.21.15.22:0/2334282707 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7fe278035f70 con 0x7fe2880a5450 2022-04-28T14:41:54.622 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.618+0000 7fe28d1c1700 1 -- 172.21.15.22:0/2334282707 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe28809f510 con 0x7fe2880a5450 2022-04-28T14:41:54.623 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.619+0000 7fe26effd700 1 -- 172.21.15.22:0/2334282707 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11369 (secure 0 0 0) 0x7fe278039590 con 0x7fe2880a5450 2022-04-28T14:41:54.623 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:41:54.624 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":39,"fsid":"3047163a-0285-4058-8e05-ce74c6fbb9c5","created":"2022-04-28T14:38:54.232890+0000","modified":"2022-04-28T14:41:53.956290+0000","last_up_change":"2022-04-28T14:41:44.899394+0000","last_in_change":"2022-04-28T14:39:00.269721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-04-28T14:39:03.639717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-04-28T14:39:12.000229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-04-28T14:39:12.915097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"device_health_metrics","create_time":"2022-04-28T14:41:25.197740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"782ee638-1ada-48d9-9454-f9e0ca8a3135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":21,"up_from":27,"up_thru":30,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6800","nonce":94303}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":94303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":94303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":94303}]},"public_addr":"172.21.15.22:6800/94303","cluster_addr":"172.21.15.22:6801/94303","heartbeat_back_addr":"172.21.15.22:6803/94303","heartbeat_front_addr":"172.21.15.22:6802/94303","state":["exists","up"]},{"osd":1,"uuid":"61ca6f96-fb4f-4c0f-b68b-edf1e7011f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":30,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":94391}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":94391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":94391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":94391}]},"public_addr":"172.21.15.22:6804/94391","cluster_addr":"172.21.15.22:6805/94391","heartbeat_back_addr":"172.21.15.22:6807/94391","heartbeat_front_addr":"172.21.15.22:6806/94391","state":["exists","up"]},{"osd":2,"uuid":"4b3043b9-50df-4b7f-a55a-ac8e6148c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":30,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":94493}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":94493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":94493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":94493}]},"public_addr":"172.21.15.22:6809/94493","cluster_addr":"172.21.15.22:6810/94493","heartbeat_back_addr":"172.21.15.22:6812/94493","heartbeat_front_addr":"172.21.15.22:6811/94493","state":["exists","up"]},{"osd":3,"uuid":"7807bcd1-53f8-44b5-9992-57c328e5b299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":30,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":94624}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":94624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":94624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":94624}]},"public_addr":"172.21.15.22:6813/94624","cluster_addr":"172.21.15.22:6814/94624","heartbeat_back_addr":"172.21.15.22:6816/94624","heartbeat_front_addr":"172.21.15.22:6815/94624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"2022-04-28T14:41:38.872482+0000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:6819/356491488":"2022-04-29T14:41:48.026821+0000","172.21.15.22:6808/86956":"2022-04-29T14:41:24.302858+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-04-28T14:41:54.625 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.620+0000 7fe28d1c1700 1 -- 172.21.15.22:0/2334282707 >> v1:172.21.15.22:6808/92758 conn(0x7fe268041b30 legacy=0x7fe268043ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:54.625 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.620+0000 7fe28d1c1700 1 -- 172.21.15.22:0/2334282707 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe2880a5450 msgr2=0x7fe288117330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:54.625 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.620+0000 7fe28d1c1700 1 --2- 172.21.15.22:0/2334282707 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe2880a5450 0x7fe288117330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fe27800e930 tx=0x7fe278009060).stop 2022-04-28T14:41:54.625 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.620+0000 7fe28d1c1700 1 -- 172.21.15.22:0/2334282707 shutdown_connections 2022-04-28T14:41:54.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.620+0000 7fe28d1c1700 1 --2- 172.21.15.22:0/2334282707 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fe28813be70 0x7fe288148450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:54.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.620+0000 7fe28d1c1700 1 --2- 172.21.15.22:0/2334282707 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fe2880a5450 0x7fe288117330 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:54.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.620+0000 7fe28d1c1700 1 --2- 172.21.15.22:0/2334282707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe288135740 0x7fe288115c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:54.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.620+0000 7fe28d1c1700 1 -- 172.21.15.22:0/2334282707 >> 172.21.15.22:0/2334282707 conn(0x7fe288069860 msgr2=0x7fe288135030 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:54.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.620+0000 7fe28d1c1700 1 -- 172.21.15.22:0/2334282707 shutdown_connections 2022-04-28T14:41:54.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.620+0000 7fe28d1c1700 1 -- 172.21.15.22:0/2334282707 wait complete. 2022-04-28T14:41:54.637 INFO:tasks.ceph.ceph_manager.ceph:all up! 2022-04-28T14:41:54.637 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-28T14:41:54.757 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.750+0000 7f7bd987c700 1 Processor -- start 2022-04-28T14:41:54.757 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.750+0000 7f7bd987c700 1 -- start start 2022-04-28T14:41:54.758 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.750+0000 7f7bd987c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f7bd4068130 0x7f7bd4066c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:54.758 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.750+0000 7f7bd987c700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f7bd4062640 0x7f7bd4062af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:54.758 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.750+0000 7f7bd987c700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bd4067330 con 0x7f7bd4068d00 2022-04-28T14:41:54.758 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.750+0000 7f7bd987c700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd40aa710 con 0x7f7bd4062640 2022-04-28T14:41:54.758 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.750+0000 7f7bd987c700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd40a5bc0 con 0x7f7bd4068130 2022-04-28T14:41:54.758 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.751+0000 7f7bd37fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f7bd4062640 0x7f7bd4062af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:54.758 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.751+0000 7f7bd2ffd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f7bd4068130 0x7f7bd4066c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:54.758 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.751+0000 7f7bd27fc700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7bd4068d00 0x7f7bd4061f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40594/0 (socket says 172.21.15.22:40594) 2022-04-28T14:41:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.751+0000 7f7bd27fc700 1 -- 172.21.15.22:0/1031106765 learned_addr learned my addr 172.21.15.22:0/1031106765 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:41:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.751+0000 7f7bd37fe700 1 -- 172.21.15.22:0/1031106765 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f7bd4068130 msgr2=0x7f7bd4066c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.751+0000 7f7bd37fe700 1 --2- 172.21.15.22:0/1031106765 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f7bd4068130 0x7f7bd4066c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.751+0000 7f7bd1ffb700 1 -- 172.21.15.22:0/1031106765 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 696985067 0 0) 0x7f7bd4067330 con 0x7f7bd4068d00 2022-04-28T14:41:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.751+0000 7f7bd37fe700 1 -- 172.21.15.22:0/1031106765 >> v1:172.21.15.22:6789/0 conn(0x7f7bd4068d00 legacy=0x7f7bd4061f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.751+0000 7f7bd37fe700 1 -- 172.21.15.22:0/1031106765 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd40aa290 con 0x7f7bd4062640 2022-04-28T14:41:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.751+0000 7f7bd2ffd700 1 --2- 172.21.15.22:0/1031106765 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f7bd4068130 0x7f7bd4066c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.751+0000 7f7bd37fe700 1 --2- 172.21.15.22:0/1031106765 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f7bd4062640 0x7f7bd4062af0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7bcc009790 tx=0x7f7bcc009060).ready entity=mon.1 client_cookie=dce4523730159d9d server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.751+0000 7f7bd1ffb700 1 -- 172.21.15.22:0/1031106765 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc00f510 con 0x7f7bd4062640 2022-04-28T14:41:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.751+0000 7f7bd1ffb700 1 -- 172.21.15.22:0/1031106765 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bcc00f670 con 0x7f7bd4062640 2022-04-28T14:41:54.760 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.751+0000 7f7bd1ffb700 1 -- 172.21.15.22:0/1031106765 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc00f9f0 con 0x7f7bd4062640 2022-04-28T14:41:54.760 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.752+0000 7f7bd987c700 1 -- 172.21.15.22:0/1031106765 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f7bd4062640 msgr2=0x7f7bd4062af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:54.760 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.752+0000 7f7bd987c700 1 --2- 172.21.15.22:0/1031106765 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f7bd4062640 0x7f7bd4062af0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7bcc009790 tx=0x7f7bcc009060).stop 2022-04-28T14:41:54.760 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.752+0000 7f7bd987c700 1 -- 172.21.15.22:0/1031106765 shutdown_connections 2022-04-28T14:41:54.760 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.752+0000 7f7bd987c700 1 --2- 172.21.15.22:0/1031106765 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f7bd4062640 0x7f7bd4062af0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:54.760 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.752+0000 7f7bd987c700 1 --2- 172.21.15.22:0/1031106765 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f7bd4068130 0x7f7bd4066c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:54.760 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.752+0000 7f7bd987c700 1 -- 172.21.15.22:0/1031106765 >> 172.21.15.22:0/1031106765 conn(0x7f7bd40ae9d0 msgr2=0x7f7bd40aede0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:54.760 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.752+0000 7f7bd987c700 1 -- 172.21.15.22:0/1031106765 shutdown_connections 2022-04-28T14:41:54.760 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.752+0000 7f7bd987c700 1 -- 172.21.15.22:0/1031106765 wait complete. 2022-04-28T14:41:54.760 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.753+0000 7f7bd987c700 1 Processor -- start 2022-04-28T14:41:54.760 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.753+0000 7f7bd987c700 1 -- start start 2022-04-28T14:41:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.753+0000 7f7bd987c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bd4062640 0x7f7bd4097980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.753+0000 7f7bd987c700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f7bd4068130 0x7f7bd40964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.753+0000 7f7bd987c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f7bd4068d00 0x7f7bd40a6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.753+0000 7f7bd987c700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd4096c20 con 0x7f7bd4062640 2022-04-28T14:41:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.753+0000 7f7bd987c700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd413b760 con 0x7f7bd4068130 2022-04-28T14:41:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.753+0000 7f7bd987c700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd4094fa0 con 0x7f7bd4068d00 2022-04-28T14:41:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.753+0000 7f7bd27fc700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f7bd4068130 0x7f7bd40964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.753+0000 7f7bd37fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f7bd4068d00 0x7f7bd40a6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.753+0000 7f7bd27fc700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f7bd4068130 0x7f7bd40964c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48770/0 (socket says 172.21.15.22:48770) 2022-04-28T14:41:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.753+0000 7f7bd27fc700 1 -- 172.21.15.22:0/4018250380 learned_addr learned my addr 172.21.15.22:0/4018250380 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.753+0000 7f7bd2ffd700 1 --2- 172.21.15.22:0/4018250380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bd4062640 0x7f7bd4097980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.754+0000 7f7bd37fe700 1 -- 172.21.15.22:0/4018250380 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f7bd4068130 msgr2=0x7f7bd40964c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.754+0000 7f7bd37fe700 1 --2- 172.21.15.22:0/4018250380 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f7bd4068130 0x7f7bd40964c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.754+0000 7f7bd37fe700 1 -- 172.21.15.22:0/4018250380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bd4062640 msgr2=0x7f7bd4097980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.754+0000 7f7bd37fe700 1 --2- 172.21.15.22:0/4018250380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bd4062640 0x7f7bd4097980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.754+0000 7f7bd37fe700 1 -- 172.21.15.22:0/4018250380 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc4009a20 con 0x7f7bd4068d00 2022-04-28T14:41:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.754+0000 7f7bd27fc700 1 --2- 172.21.15.22:0/4018250380 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f7bd4068130 0x7f7bd40964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.754+0000 7f7bd2ffd700 1 --2- 172.21.15.22:0/4018250380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bd4062640 0x7f7bd4097980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.754+0000 7f7bd37fe700 1 --2- 172.21.15.22:0/4018250380 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f7bd4068d00 0x7f7bd40a6e10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f7bd40af960 tx=0x7f7bcc017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.754+0000 7f7bcaffd700 1 -- 172.21.15.22:0/4018250380 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc00f9f0 con 0x7f7bd4068d00 2022-04-28T14:41:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.754+0000 7f7bcaffd700 1 -- 172.21.15.22:0/4018250380 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bcc00fe80 con 0x7f7bd4068d00 2022-04-28T14:41:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.754+0000 7f7bcaffd700 1 -- 172.21.15.22:0/4018250380 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc01b690 con 0x7f7bd4068d00 2022-04-28T14:41:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.754+0000 7f7bd987c700 1 -- 172.21.15.22:0/4018250380 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bcc0092a0 con 0x7f7bd4068d00 2022-04-28T14:41:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.754+0000 7f7bd987c700 1 -- 172.21.15.22:0/4018250380 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd4095950 con 0x7f7bd4068d00 2022-04-28T14:41:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.755+0000 7f7bd987c700 1 -- 172.21.15.22:0/4018250380 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd4065a50 con 0x7f7bd4068d00 2022-04-28T14:41:54.766 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.755+0000 7f7bcaffd700 1 -- 172.21.15.22:0/4018250380 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f7bcc00f070 con 0x7f7bd4068d00 2022-04-28T14:41:54.766 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.755+0000 7f7bcaffd700 1 -- 172.21.15.22:0/4018250380 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7f7bcc056b80 con 0x7f7bd4068d00 2022-04-28T14:41:54.766 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.759+0000 7f7bcaffd700 1 -- 172.21.15.22:0/4018250380 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f7bcc03ab30 con 0x7f7bd4068d00 2022-04-28T14:41:54.902 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.898+0000 7f7bd987c700 1 -- 172.21.15.22:0/4018250380 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7bd4046540 con 0x7f7bd4068d00 2022-04-28T14:41:54.903 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.898+0000 7f7bcaffd700 1 -- 172.21.15.22:0/4018250380 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11369 (secure 0 0 0) 0x7f7bcc03a950 con 0x7f7bd4068d00 2022-04-28T14:41:54.903 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:41:54.904 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":39,"fsid":"3047163a-0285-4058-8e05-ce74c6fbb9c5","created":"2022-04-28T14:38:54.232890+0000","modified":"2022-04-28T14:41:53.956290+0000","last_up_change":"2022-04-28T14:41:44.899394+0000","last_in_change":"2022-04-28T14:39:00.269721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-04-28T14:39:03.639717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-04-28T14:39:12.000229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-04-28T14:39:12.915097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"device_health_metrics","create_time":"2022-04-28T14:41:25.197740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"782ee638-1ada-48d9-9454-f9e0ca8a3135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":21,"up_from":27,"up_thru":30,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6800","nonce":94303}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":94303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":94303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":94303}]},"public_addr":"172.21.15.22:6800/94303","cluster_addr":"172.21.15.22:6801/94303","heartbeat_back_addr":"172.21.15.22:6803/94303","heartbeat_front_addr":"172.21.15.22:6802/94303","state":["exists","up"]},{"osd":1,"uuid":"61ca6f96-fb4f-4c0f-b68b-edf1e7011f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":30,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":94391}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":94391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":94391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":94391}]},"public_addr":"172.21.15.22:6804/94391","cluster_addr":"172.21.15.22:6805/94391","heartbeat_back_addr":"172.21.15.22:6807/94391","heartbeat_front_addr":"172.21.15.22:6806/94391","state":["exists","up"]},{"osd":2,"uuid":"4b3043b9-50df-4b7f-a55a-ac8e6148c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":30,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":94493}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":94493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":94493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":94493}]},"public_addr":"172.21.15.22:6809/94493","cluster_addr":"172.21.15.22:6810/94493","heartbeat_back_addr":"172.21.15.22:6812/94493","heartbeat_front_addr":"172.21.15.22:6811/94493","state":["exists","up"]},{"osd":3,"uuid":"7807bcd1-53f8-44b5-9992-57c328e5b299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":30,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":94624}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":94624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":94624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":94624}]},"public_addr":"172.21.15.22:6813/94624","cluster_addr":"172.21.15.22:6814/94624","heartbeat_back_addr":"172.21.15.22:6816/94624","heartbeat_front_addr":"172.21.15.22:6815/94624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"2022-04-28T14:41:38.872482+0000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:6819/356491488":"2022-04-29T14:41:48.026821+0000","172.21.15.22:6808/86956":"2022-04-29T14:41:24.302858+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-04-28T14:41:54.905 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.900+0000 7f7bd987c700 1 -- 172.21.15.22:0/4018250380 >> v1:172.21.15.22:6808/92758 conn(0x7f7bb8041b00 legacy=0x7f7bb8043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:54.905 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.900+0000 7f7bd987c700 1 -- 172.21.15.22:0/4018250380 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f7bd4068d00 msgr2=0x7f7bd40a6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:54.905 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.900+0000 7f7bd987c700 1 --2- 172.21.15.22:0/4018250380 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f7bd4068d00 0x7f7bd40a6e10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f7bd40af960 tx=0x7f7bcc017000).stop 2022-04-28T14:41:54.905 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.900+0000 7f7bd987c700 1 -- 172.21.15.22:0/4018250380 shutdown_connections 2022-04-28T14:41:54.905 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.900+0000 7f7bd987c700 1 --2- 172.21.15.22:0/4018250380 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f7bd4068d00 0x7f7bd40a6e10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:54.905 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.900+0000 7f7bd987c700 1 --2- 172.21.15.22:0/4018250380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bd4062640 0x7f7bd4097980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:54.906 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.900+0000 7f7bd987c700 1 --2- 172.21.15.22:0/4018250380 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f7bd4068130 0x7f7bd40964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:54.906 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.900+0000 7f7bd987c700 1 -- 172.21.15.22:0/4018250380 >> 172.21.15.22:0/4018250380 conn(0x7f7bd40ae9d0 msgr2=0x7f7bd40abc40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:54.906 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.900+0000 7f7bd987c700 1 -- 172.21.15.22:0/4018250380 shutdown_connections 2022-04-28T14:41:54.906 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:54.900+0000 7f7bd987c700 1 -- 172.21.15.22:0/4018250380 wait complete. 2022-04-28T14:41:54.917 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2022-04-28T14:41:55.036 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.031+0000 7fc940c97700 1 Processor -- start 2022-04-28T14:41:55.037 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.032+0000 7fc940c97700 1 -- start start 2022-04-28T14:41:55.042 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.032+0000 7fc940c97700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc93c067010 0x7fc93c13b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:55.042 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.032+0000 7fc940c97700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc93c13be70 0x7fc93c142b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:55.042 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.032+0000 7fc940c97700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc93c0a5cd0 con 0x7fc93c0a5450 2022-04-28T14:41:55.042 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.032+0000 7fc940c97700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc93c0673f0 con 0x7fc93c13be70 2022-04-28T14:41:55.042 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.032+0000 7fc940c97700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c0a5830 con 0x7fc93c067010 2022-04-28T14:41:55.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.032+0000 7fc93ad9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fc93c13be70 0x7fc93c142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:55.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.032+0000 7fc939d9b700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc93c067010 0x7fc93c13b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:55.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.032+0000 7fc93a59c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fc93c0a5450 0x7fc93c135740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40610/0 (socket says 172.21.15.22:40610) 2022-04-28T14:41:55.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.032+0000 7fc93a59c700 1 -- 172.21.15.22:0/2074791378 learned_addr learned my addr 172.21.15.22:0/2074791378 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:41:55.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.032+0000 7fc93ad9d700 1 --2- 172.21.15.22:0/2074791378 >> v2:172.21.15.22:3300/0 conn(0x7fc93c13be70 0x7fc93c142b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51218/0 (socket says 172.21.15.22:51218) 2022-04-28T14:41:55.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.033+0000 7fc93959a700 1 -- 172.21.15.22:0/2074791378 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221722088 0 0) 0x7fc93c0a5cd0 con 0x7fc93c0a5450 2022-04-28T14:41:55.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.033+0000 7fc939d9b700 1 -- 172.21.15.22:0/2074791378 >> v2:172.21.15.22:3300/0 conn(0x7fc93c13be70 msgr2=0x7fc93c142b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:55.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.033+0000 7fc939d9b700 1 --2- 172.21.15.22:0/2074791378 >> v2:172.21.15.22:3300/0 conn(0x7fc93c13be70 0x7fc93c142b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.033+0000 7fc939d9b700 1 -- 172.21.15.22:0/2074791378 >> v1:172.21.15.22:6789/0 conn(0x7fc93c0a5450 legacy=0x7fc93c135740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.033+0000 7fc939d9b700 1 -- 172.21.15.22:0/2074791378 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c13c350 con 0x7fc93c067010 2022-04-28T14:41:55.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.033+0000 7fc93ad9d700 1 --2- 172.21.15.22:0/2074791378 >> v2:172.21.15.22:3300/0 conn(0x7fc93c13be70 0x7fc93c142b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:55.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.033+0000 7fc939d9b700 1 --2- 172.21.15.22:0/2074791378 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc93c067010 0x7fc93c13b980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fc924009790 tx=0x7fc924009060).ready entity=mon.1 client_cookie=113025e31b4e6fe6 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:55.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.033+0000 7fc93959a700 1 -- 172.21.15.22:0/2074791378 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92400f510 con 0x7fc93c067010 2022-04-28T14:41:55.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.033+0000 7fc93959a700 1 -- 172.21.15.22:0/2074791378 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92400f670 con 0x7fc93c067010 2022-04-28T14:41:55.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.033+0000 7fc93959a700 1 -- 172.21.15.22:0/2074791378 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92400f9f0 con 0x7fc93c067010 2022-04-28T14:41:55.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.034+0000 7fc940c97700 1 -- 172.21.15.22:0/2074791378 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc93c067010 msgr2=0x7fc93c13b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.034+0000 7fc940c97700 1 --2- 172.21.15.22:0/2074791378 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc93c067010 0x7fc93c13b980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fc924009790 tx=0x7fc924009060).stop 2022-04-28T14:41:55.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.034+0000 7fc940c97700 1 -- 172.21.15.22:0/2074791378 shutdown_connections 2022-04-28T14:41:55.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.034+0000 7fc940c97700 1 --2- 172.21.15.22:0/2074791378 >> v2:172.21.15.22:3300/0 conn(0x7fc93c13be70 0x7fc93c142b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.034+0000 7fc940c97700 1 --2- 172.21.15.22:0/2074791378 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc93c067010 0x7fc93c13b980 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.034+0000 7fc940c97700 1 -- 172.21.15.22:0/2074791378 >> 172.21.15.22:0/2074791378 conn(0x7fc93c069860 msgr2=0x7fc93c069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:55.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.034+0000 7fc940c97700 1 -- 172.21.15.22:0/2074791378 shutdown_connections 2022-04-28T14:41:55.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.034+0000 7fc940c97700 1 -- 172.21.15.22:0/2074791378 wait complete. 2022-04-28T14:41:55.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.035+0000 7fc940c97700 1 Processor -- start 2022-04-28T14:41:55.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.035+0000 7fc940c97700 1 -- start start 2022-04-28T14:41:55.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.035+0000 7fc940c97700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc93c067010 0x7fc93c117410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:55.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.035+0000 7fc940c97700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc93c0a5450 0x7fc93c14bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:55.046 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.035+0000 7fc940c97700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc93c13be70 0x7fc93c115790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:55.046 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.035+0000 7fc940c97700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c0638d0 con 0x7fc93c067010 2022-04-28T14:41:55.046 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.035+0000 7fc940c97700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c1154d0 con 0x7fc93c0a5450 2022-04-28T14:41:55.046 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.035+0000 7fc940c97700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c114b60 con 0x7fc93c13be70 2022-04-28T14:41:55.046 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.035+0000 7fc93a59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc93c067010 0x7fc93c117410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:55.046 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.035+0000 7fc939d9b700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc93c0a5450 0x7fc93c14bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:55.046 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.035+0000 7fc93a59c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc93c067010 0x7fc93c117410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51220/0 (socket says 172.21.15.22:51220) 2022-04-28T14:41:55.046 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.035+0000 7fc93a59c700 1 -- 172.21.15.22:0/702414300 learned_addr learned my addr 172.21.15.22:0/702414300 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:55.046 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.035+0000 7fc93ad9d700 1 --2- 172.21.15.22:0/702414300 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc93c13be70 0x7fc93c115790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:55.047 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.036+0000 7fc939d9b700 1 -- 172.21.15.22:0/702414300 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc93c13be70 msgr2=0x7fc93c115790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.047 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.036+0000 7fc939d9b700 1 --2- 172.21.15.22:0/702414300 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc93c13be70 0x7fc93c115790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.047 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.036+0000 7fc939d9b700 1 -- 172.21.15.22:0/702414300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc93c067010 msgr2=0x7fc93c117410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.047 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.036+0000 7fc939d9b700 1 --2- 172.21.15.22:0/702414300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc93c067010 0x7fc93c117410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.047 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.036+0000 7fc939d9b700 1 -- 172.21.15.22:0/702414300 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc934009a20 con 0x7fc93c0a5450 2022-04-28T14:41:55.047 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.036+0000 7fc93ad9d700 1 --2- 172.21.15.22:0/702414300 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fc93c13be70 0x7fc93c115790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:55.047 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.036+0000 7fc93a59c700 1 --2- 172.21.15.22:0/702414300 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc93c067010 0x7fc93c117410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:55.047 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.036+0000 7fc939d9b700 1 --2- 172.21.15.22:0/702414300 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc93c0a5450 0x7fc93c14bd00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fc924014000 tx=0x7fc924017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:55.047 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.036+0000 7fc9327fc700 1 -- 172.21.15.22:0/702414300 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92400f7e0 con 0x7fc93c0a5450 2022-04-28T14:41:55.047 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.036+0000 7fc9327fc700 1 -- 172.21.15.22:0/702414300 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92400f940 con 0x7fc93c0a5450 2022-04-28T14:41:55.048 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.036+0000 7fc940c97700 1 -- 172.21.15.22:0/702414300 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9240092a0 con 0x7fc93c0a5450 2022-04-28T14:41:55.048 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.036+0000 7fc9327fc700 1 -- 172.21.15.22:0/702414300 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92401b690 con 0x7fc93c0a5450 2022-04-28T14:41:55.048 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.036+0000 7fc940c97700 1 -- 172.21.15.22:0/702414300 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc93c0a9ba0 con 0x7fc93c0a5450 2022-04-28T14:41:55.048 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.037+0000 7fc940c97700 1 -- 172.21.15.22:0/702414300 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc93c09f510 con 0x7fc93c0a5450 2022-04-28T14:41:55.048 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.037+0000 7fc9327fc700 1 -- 172.21.15.22:0/702414300 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7fc92400f070 con 0x7fc93c0a5450 2022-04-28T14:41:55.048 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.037+0000 7fc9327fc700 1 -- 172.21.15.22:0/702414300 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7fc924056a90 con 0x7fc93c0a5450 2022-04-28T14:41:55.048 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.037+0000 7fc9327fc700 1 -- 172.21.15.22:0/702414300 --> v1:172.21.15.22:6800/94303 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc92004eea0 con 0x7fc92004b190 2022-04-28T14:41:55.048 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.037+0000 7fc9327fc700 1 -- 172.21.15.22:0/702414300 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc924058ea0 con 0x7fc93c0a5450 2022-04-28T14:41:55.049 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.038+0000 7fc9327fc700 1 -- 172.21.15.22:0/702414300 <== osd.0 v1:172.21.15.22:6800/94303 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7fc92004eea0 con 0x7fc92004b190 2022-04-28T14:41:55.057 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.052+0000 7fc940c97700 1 -- 172.21.15.22:0/702414300 --> v1:172.21.15.22:6800/94303 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc93c046540 con 0x7fc92004b190 2022-04-28T14:41:55.057 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.053+0000 7fc9327fc700 1 -- 172.21.15.22:0/702414300 <== osd.0 v1:172.21.15.22:6800/94303 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3581622916) 0x7fc93c046540 con 0x7fc92004b190 2022-04-28T14:41:55.058 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.053+0000 7fc940c97700 1 -- 172.21.15.22:0/702414300 >> v1:172.21.15.22:6800/94303 conn(0x7fc92004b190 legacy=0x7fc92004d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.059 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.053+0000 7fc940c97700 1 -- 172.21.15.22:0/702414300 >> v1:172.21.15.22:6808/92758 conn(0x7fc920041b30 legacy=0x7fc920043ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.059 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.053+0000 7fc940c97700 1 -- 172.21.15.22:0/702414300 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc93c0a5450 msgr2=0x7fc93c14bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.059 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.053+0000 7fc940c97700 1 --2- 172.21.15.22:0/702414300 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fc93c0a5450 0x7fc93c14bd00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fc924014000 tx=0x7fc924017000).stop 2022-04-28T14:41:55.059 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.053+0000 7fc93ad9d700 1 -- 172.21.15.22:0/702414300 reap_dead start 2022-04-28T14:41:55.059 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.053+0000 7fc940c97700 1 -- 172.21.15.22:0/702414300 shutdown_connections 2022-04-28T14:41:55.059 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.053+0000 7fc940c97700 1 -- 172.21.15.22:0/702414300 >> 172.21.15.22:0/702414300 conn(0x7fc93c069860 msgr2=0x7fc93c0acc20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:55.059 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.053+0000 7fc940c97700 1 -- 172.21.15.22:0/702414300 shutdown_connections 2022-04-28T14:41:55.059 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.053+0000 7fc940c97700 1 -- 172.21.15.22:0/702414300 wait complete. 2022-04-28T14:41:55.069 INFO:teuthology.orchestra.run.smithi022.stdout:115964116996 2022-04-28T14:41:55.069 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2022-04-28T14:41:55.194 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.184+0000 7f6992716700 1 Processor -- start 2022-04-28T14:41:55.194 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.184+0000 7f6992716700 1 -- start start 2022-04-28T14:41:55.195 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.184+0000 7f6992716700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f698c0a5450 0x7f698c067010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:55.195 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.184+0000 7f6992716700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f698c135740 0x7f698c13b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:55.195 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.184+0000 7f6992716700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f698c0a5cd0 con 0x7f698c13be70 2022-04-28T14:41:55.195 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.184+0000 7f6992716700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f698c0a5830 con 0x7f698c135740 2022-04-28T14:41:55.195 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.184+0000 7f6992716700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698c13c350 con 0x7f698c0a5450 2022-04-28T14:41:55.195 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.184+0000 7f698bfff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f698c0a5450 0x7f698c067010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:55.195 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.184+0000 7f698b7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f698c135740 0x7f698c13b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:55.195 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.184+0000 7f698b7fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f698c135740 0x7f698c13b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51232/0 (socket says 172.21.15.22:51232) 2022-04-28T14:41:55.195 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.184+0000 7f6990cb3700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f698c13be70 0x7f698c1381e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40630/0 (socket says 172.21.15.22:40630) 2022-04-28T14:41:55.196 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.184+0000 7f698b7fe700 1 -- 172.21.15.22:0/1919950242 learned_addr learned my addr 172.21.15.22:0/1919950242 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:55.196 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.184+0000 7f698bfff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f698c0a5450 0x7f698c067010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48798/0 (socket says 172.21.15.22:48798) 2022-04-28T14:41:55.196 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.185+0000 7f698b7fe700 1 -- 172.21.15.22:0/1919950242 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f698c0a5450 msgr2=0x7f698c067010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:55.196 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.185+0000 7f698b7fe700 1 --2- 172.21.15.22:0/1919950242 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f698c0a5450 0x7f698c067010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.196 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.185+0000 7f698b7fe700 1 -- 172.21.15.22:0/1919950242 >> v1:172.21.15.22:6789/0 conn(0x7f698c13be70 legacy=0x7f698c1381e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.196 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.185+0000 7f698b7fe700 1 -- 172.21.15.22:0/1919950242 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698c13c5f0 con 0x7f698c135740 2022-04-28T14:41:55.196 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.185+0000 7f698affd700 1 -- 172.21.15.22:0/1919950242 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551146197 0 0) 0x7f698c0a5cd0 con 0x7f698c13be70 2022-04-28T14:41:55.196 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.185+0000 7f698bfff700 1 --2- 172.21.15.22:0/1919950242 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f698c0a5450 0x7f698c067010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:55.196 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.185+0000 7f698b7fe700 1 --2- 172.21.15.22:0/1919950242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f698c135740 0x7f698c13b980 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f6980006fd0 tx=0x7f69800090f0).ready entity=mon.0 client_cookie=7facf46969126e34 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:55.196 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.185+0000 7f698affd700 1 -- 172.21.15.22:0/1919950242 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698000b580 con 0x7f698c135740 2022-04-28T14:41:55.197 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.185+0000 7f698affd700 1 -- 172.21.15.22:0/1919950242 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698000b6e0 con 0x7f698c135740 2022-04-28T14:41:55.197 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.185+0000 7f698affd700 1 -- 172.21.15.22:0/1919950242 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698000ba60 con 0x7f698c135740 2022-04-28T14:41:55.197 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.186+0000 7f6992716700 1 -- 172.21.15.22:0/1919950242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f698c135740 msgr2=0x7f698c13b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.197 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.186+0000 7f6992716700 1 --2- 172.21.15.22:0/1919950242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f698c135740 0x7f698c13b980 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f6980006fd0 tx=0x7f69800090f0).stop 2022-04-28T14:41:55.197 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.186+0000 7f6992716700 1 -- 172.21.15.22:0/1919950242 shutdown_connections 2022-04-28T14:41:55.197 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.186+0000 7f6992716700 1 --2- 172.21.15.22:0/1919950242 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f698c0a5450 0x7f698c067010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.197 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.186+0000 7f6992716700 1 --2- 172.21.15.22:0/1919950242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f698c135740 0x7f698c13b980 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.197 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.186+0000 7f6992716700 1 -- 172.21.15.22:0/1919950242 >> 172.21.15.22:0/1919950242 conn(0x7f698c069860 msgr2=0x7f698c069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:55.197 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.186+0000 7f6992716700 1 -- 172.21.15.22:0/1919950242 shutdown_connections 2022-04-28T14:41:55.198 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.186+0000 7f6992716700 1 -- 172.21.15.22:0/1919950242 wait complete. 2022-04-28T14:41:55.198 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.187+0000 7f6992716700 1 Processor -- start 2022-04-28T14:41:55.198 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.187+0000 7f6992716700 1 -- start start 2022-04-28T14:41:55.198 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.187+0000 7f6992716700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f698c0a5450 0x7f698c117330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:55.198 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.187+0000 7f6992716700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f698c135740 0x7f698c115c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:55.198 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.187+0000 7f6992716700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f698c13be70 0x7f698c148450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:55.199 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.187+0000 7f6992716700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c0a9f50 con 0x7f698c0a5450 2022-04-28T14:41:55.199 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.187+0000 7f6992716700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698c114df0 con 0x7f698c13be70 2022-04-28T14:41:55.199 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.187+0000 7f6992716700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f698c134500 con 0x7f698c135740 2022-04-28T14:41:55.199 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.187+0000 7f6990cb3700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f698c13be70 0x7f698c148450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:55.199 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.187+0000 7f698bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f698c0a5450 0x7f698c117330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:55.199 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.187+0000 7f698b7fe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f698c135740 0x7f698c115c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:55.199 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.188+0000 7f698bfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f698c0a5450 0x7f698c117330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51236/0 (socket says 172.21.15.22:51236) 2022-04-28T14:41:55.199 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.188+0000 7f698bfff700 1 -- 172.21.15.22:0/4161879255 learned_addr learned my addr 172.21.15.22:0/4161879255 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:55.199 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.188+0000 7f6990cb3700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f698c13be70 0x7f698c148450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48808/0 (socket says 172.21.15.22:48808) 2022-04-28T14:41:55.199 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.188+0000 7f698bfff700 1 -- 172.21.15.22:0/4161879255 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f698c135740 msgr2=0x7f698c115c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.188+0000 7f698bfff700 1 --2- 172.21.15.22:0/4161879255 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f698c135740 0x7f698c115c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.188+0000 7f698bfff700 1 -- 172.21.15.22:0/4161879255 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f698c13be70 msgr2=0x7f698c148450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.188+0000 7f698bfff700 1 --2- 172.21.15.22:0/4161879255 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f698c13be70 0x7f698c148450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.188+0000 7f698bfff700 1 -- 172.21.15.22:0/4161879255 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c0092a0 con 0x7f698c0a5450 2022-04-28T14:41:55.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.188+0000 7f698b7fe700 1 --2- 172.21.15.22:0/4161879255 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f698c135740 0x7f698c115c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:55.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.188+0000 7f698bfff700 1 --2- 172.21.15.22:0/4161879255 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f698c0a5450 0x7f698c117330 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f697c00ea20 tx=0x7f697c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:55.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.188+0000 7f6973fff700 1 -- 172.21.15.22:0/4161879255 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c00ee60 con 0x7f698c0a5450 2022-04-28T14:41:55.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.188+0000 7f6973fff700 1 -- 172.21.15.22:0/4161879255 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697c00c8e0 con 0x7f698c0a5450 2022-04-28T14:41:55.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.188+0000 7f6992716700 1 -- 172.21.15.22:0/4161879255 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6980009370 con 0x7f698c0a5450 2022-04-28T14:41:55.201 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.188+0000 7f6973fff700 1 -- 172.21.15.22:0/4161879255 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c00cc60 con 0x7f698c0a5450 2022-04-28T14:41:55.201 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.188+0000 7f6992716700 1 -- 172.21.15.22:0/4161879255 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f698c0a98b0 con 0x7f698c0a5450 2022-04-28T14:41:55.201 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.189+0000 7f6992716700 1 -- 172.21.15.22:0/4161879255 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f698c0ac350 con 0x7f698c0a5450 2022-04-28T14:41:55.201 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.189+0000 7f6973fff700 1 -- 172.21.15.22:0/4161879255 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f697c022070 con 0x7f698c0a5450 2022-04-28T14:41:55.201 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.189+0000 7f6973fff700 1 -- 172.21.15.22:0/4161879255 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7f697c0558a0 con 0x7f698c0a5450 2022-04-28T14:41:55.201 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.189+0000 7f6973fff700 1 -- 172.21.15.22:0/4161879255 --> v1:172.21.15.22:6804/94391 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f696c04eea0 con 0x7f696c04b190 2022-04-28T14:41:55.201 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.189+0000 7f6973fff700 1 -- 172.21.15.22:0/4161879255 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f697c05a1c0 con 0x7f698c0a5450 2022-04-28T14:41:55.202 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.190+0000 7f6973fff700 1 -- 172.21.15.22:0/4161879255 <== osd.1 v1:172.21.15.22:6804/94391 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f696c04eea0 con 0x7f696c04b190 2022-04-28T14:41:55.209 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.205+0000 7f6992716700 1 -- 172.21.15.22:0/4161879255 --> v1:172.21.15.22:6804/94391 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f698c09f510 con 0x7f696c04b190 2022-04-28T14:41:55.209 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.205+0000 7f6973fff700 1 -- 172.21.15.22:0/4161879255 <== osd.1 v1:172.21.15.22:6804/94391 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3232526981) 0x7f698c09f510 con 0x7f696c04b190 2022-04-28T14:41:55.211 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.205+0000 7f6992716700 1 -- 172.21.15.22:0/4161879255 >> v1:172.21.15.22:6804/94391 conn(0x7f696c04b190 legacy=0x7f696c04d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.211 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.205+0000 7f6992716700 1 -- 172.21.15.22:0/4161879255 >> v1:172.21.15.22:6808/92758 conn(0x7f696c041b30 legacy=0x7f696c043ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.211 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.205+0000 7f6992716700 1 -- 172.21.15.22:0/4161879255 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f698c0a5450 msgr2=0x7f698c117330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.211 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.205+0000 7f6992716700 1 --2- 172.21.15.22:0/4161879255 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f698c0a5450 0x7f698c117330 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f697c00ea20 tx=0x7f697c009060).stop 2022-04-28T14:41:55.211 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.205+0000 7f6990cb3700 1 -- 172.21.15.22:0/4161879255 reap_dead start 2022-04-28T14:41:55.211 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.205+0000 7f6992716700 1 -- 172.21.15.22:0/4161879255 shutdown_connections 2022-04-28T14:41:55.211 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.205+0000 7f6992716700 1 -- 172.21.15.22:0/4161879255 >> 172.21.15.22:0/4161879255 conn(0x7f698c069860 msgr2=0x7f698c135030 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:55.212 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.205+0000 7f6992716700 1 -- 172.21.15.22:0/4161879255 shutdown_connections 2022-04-28T14:41:55.212 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.205+0000 7f6992716700 1 -- 172.21.15.22:0/4161879255 wait complete. 2022-04-28T14:41:55.221 INFO:teuthology.orchestra.run.smithi022.stdout:120259084292 2022-04-28T14:41:55.222 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2022-04-28T14:41:55.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.336+0000 7f146af22700 1 Processor -- start 2022-04-28T14:41:55.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.336+0000 7f146af22700 1 -- start start 2022-04-28T14:41:55.346 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.336+0000 7f146af22700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f14640a9ee0 0x7f14640a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:55.346 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.336+0000 7f146af22700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f146413e980 0x7f1464140d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:55.346 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.336+0000 7f146af22700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14640a2920 con 0x7f14640a3070 2022-04-28T14:41:55.346 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.336+0000 7f146af22700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f146413a540 con 0x7f146413e980 2022-04-28T14:41:55.346 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.336+0000 7f146af22700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f146413a280 con 0x7f14640a9ee0 2022-04-28T14:41:55.346 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.336+0000 7f1463fff700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f14640a3070 0x7f14641398b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40642/0 (socket says 172.21.15.22:40642) 2022-04-28T14:41:55.346 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.336+0000 7f14694bf700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f146413e980 0x7f1464140d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:55.347 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.336+0000 7f1463fff700 1 -- 172.21.15.22:0/205042962 learned_addr learned my addr 172.21.15.22:0/205042962 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:41:55.347 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.336+0000 7f1468cbe700 1 --2- 172.21.15.22:0/205042962 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f14640a9ee0 0x7f14640a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:55.347 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.337+0000 7f14694bf700 1 -- 172.21.15.22:0/205042962 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f14640a9ee0 msgr2=0x7f14640a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:55.347 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.337+0000 7f14694bf700 1 --2- 172.21.15.22:0/205042962 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f14640a9ee0 0x7f14640a1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.347 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.337+0000 7f14694bf700 1 -- 172.21.15.22:0/205042962 >> v1:172.21.15.22:6789/0 conn(0x7f14640a3070 legacy=0x7f14641398b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.347 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.337+0000 7f14637fe700 1 -- 172.21.15.22:0/205042962 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 890379861 0 0) 0x7f14640a2920 con 0x7f14640a3070 2022-04-28T14:41:55.347 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.337+0000 7f14694bf700 1 -- 172.21.15.22:0/205042962 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1464139fc0 con 0x7f146413e980 2022-04-28T14:41:55.347 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.337+0000 7f14694bf700 1 --2- 172.21.15.22:0/205042962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f146413e980 0x7f1464140d70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f145c009e60 tx=0x7f145c009780).ready entity=mon.0 client_cookie=bd368e2d1c8930ee server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:55.347 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.337+0000 7f14637fe700 1 -- 172.21.15.22:0/205042962 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c00e070 con 0x7f146413e980 2022-04-28T14:41:55.348 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.337+0000 7f14637fe700 1 -- 172.21.15.22:0/205042962 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145c00bb60 con 0x7f146413e980 2022-04-28T14:41:55.348 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.337+0000 7f14637fe700 1 -- 172.21.15.22:0/205042962 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c012410 con 0x7f146413e980 2022-04-28T14:41:55.348 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.337+0000 7f146af22700 1 -- 172.21.15.22:0/205042962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f146413e980 msgr2=0x7f1464140d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.348 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.337+0000 7f146af22700 1 --2- 172.21.15.22:0/205042962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f146413e980 0x7f1464140d70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f145c009e60 tx=0x7f145c009780).stop 2022-04-28T14:41:55.348 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.338+0000 7f146af22700 1 -- 172.21.15.22:0/205042962 shutdown_connections 2022-04-28T14:41:55.348 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.338+0000 7f146af22700 1 --2- 172.21.15.22:0/205042962 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f146413e980 0x7f1464140d70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.348 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.338+0000 7f146af22700 1 --2- 172.21.15.22:0/205042962 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f14640a9ee0 0x7f14640a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.348 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.338+0000 7f146af22700 1 -- 172.21.15.22:0/205042962 >> 172.21.15.22:0/205042962 conn(0x7f1464069860 msgr2=0x7f1464069c70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:55.348 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.338+0000 7f146af22700 1 -- 172.21.15.22:0/205042962 shutdown_connections 2022-04-28T14:41:55.348 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.338+0000 7f146af22700 1 -- 172.21.15.22:0/205042962 wait complete. 2022-04-28T14:41:55.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.339+0000 7f146af22700 1 Processor -- start 2022-04-28T14:41:55.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.339+0000 7f146af22700 1 -- start start 2022-04-28T14:41:55.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.339+0000 7f146af22700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f14640a3070 0x7f14640aae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:55.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.339+0000 7f146af22700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14640a9ee0 0x7f146414b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:55.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.339+0000 7f146af22700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f146413e980 0x7f14640664d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:55.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.339+0000 7f146af22700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1464065c30 con 0x7f14640a9ee0 2022-04-28T14:41:55.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.339+0000 7f146af22700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14640acb10 con 0x7f14640a3070 2022-04-28T14:41:55.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.339+0000 7f146af22700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f146414bbb0 con 0x7f146413e980 2022-04-28T14:41:55.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.339+0000 7f1463fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14640a9ee0 0x7f146414b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:55.349 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.339+0000 7f14694bf700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f146413e980 0x7f14640664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:55.350 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.339+0000 7f1463fff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14640a9ee0 0x7f146414b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51252/0 (socket says 172.21.15.22:51252) 2022-04-28T14:41:55.350 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.340+0000 7f1463fff700 1 -- 172.21.15.22:0/1262306664 learned_addr learned my addr 172.21.15.22:0/1262306664 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:55.350 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.340+0000 7f1468cbe700 1 --2- 172.21.15.22:0/1262306664 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f14640a3070 0x7f14640aae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:55.350 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.340+0000 7f1463fff700 1 -- 172.21.15.22:0/1262306664 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f146413e980 msgr2=0x7f14640664d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.350 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.340+0000 7f1463fff700 1 --2- 172.21.15.22:0/1262306664 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f146413e980 0x7f14640664d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.350 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.340+0000 7f1463fff700 1 -- 172.21.15.22:0/1262306664 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f14640a3070 msgr2=0x7f14640aae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.350 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.340+0000 7f1463fff700 1 --2- 172.21.15.22:0/1262306664 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f14640a3070 0x7f14640aae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.350 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.340+0000 7f1463fff700 1 -- 172.21.15.22:0/1262306664 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145c009a20 con 0x7f14640a9ee0 2022-04-28T14:41:55.350 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.340+0000 7f14694bf700 1 --2- 172.21.15.22:0/1262306664 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f146413e980 0x7f14640664d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:55.351 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.340+0000 7f1468cbe700 1 --2- 172.21.15.22:0/1262306664 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f14640a3070 0x7f14640aae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:55.351 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.340+0000 7f1463fff700 1 --2- 172.21.15.22:0/1262306664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14640a9ee0 0x7f146414b1e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f1450001eb0 tx=0x7f1450007bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:55.351 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.340+0000 7f1460ff9700 1 -- 172.21.15.22:0/1262306664 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145000ce00 con 0x7f14640a9ee0 2022-04-28T14:41:55.351 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.340+0000 7f1460ff9700 1 -- 172.21.15.22:0/1262306664 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14500072e0 con 0x7f14640a9ee0 2022-04-28T14:41:55.351 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.340+0000 7f146af22700 1 -- 172.21.15.22:0/1262306664 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f146414be70 con 0x7f14640a9ee0 2022-04-28T14:41:55.351 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.340+0000 7f1460ff9700 1 -- 172.21.15.22:0/1262306664 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14500057a0 con 0x7f14640a9ee0 2022-04-28T14:41:55.351 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.340+0000 7f146af22700 1 -- 172.21.15.22:0/1262306664 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14640ac410 con 0x7f14640a9ee0 2022-04-28T14:41:55.351 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.341+0000 7f146af22700 1 -- 172.21.15.22:0/1262306664 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f14640ab8a0 con 0x7f14640a9ee0 2022-04-28T14:41:55.351 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.341+0000 7f1460ff9700 1 -- 172.21.15.22:0/1262306664 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f145001a060 con 0x7f14640a9ee0 2022-04-28T14:41:55.352 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.342+0000 7f1460ff9700 1 -- 172.21.15.22:0/1262306664 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7f1450055310 con 0x7f14640a9ee0 2022-04-28T14:41:55.353 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.342+0000 7f1460ff9700 1 -- 172.21.15.22:0/1262306664 --> v1:172.21.15.22:6809/94493 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f144c04ee70 con 0x7f144c04b160 2022-04-28T14:41:55.353 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.342+0000 7f1460ff9700 1 -- 172.21.15.22:0/1262306664 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1450055710 con 0x7f14640a9ee0 2022-04-28T14:41:55.353 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.343+0000 7f1460ff9700 1 -- 172.21.15.22:0/1262306664 <== osd.2 v1:172.21.15.22:6809/94493 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f144c04ee70 con 0x7f144c04b160 2022-04-28T14:41:55.361 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.357+0000 7f146af22700 1 -- 172.21.15.22:0/1262306664 --> v1:172.21.15.22:6809/94493 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f14640ac600 con 0x7f144c04b160 2022-04-28T14:41:55.362 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.357+0000 7f1460ff9700 1 -- 172.21.15.22:0/1262306664 <== osd.2 v1:172.21.15.22:6809/94493 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 277563570) 0x7f14640ac600 con 0x7f144c04b160 2022-04-28T14:41:55.363 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.357+0000 7f146af22700 1 -- 172.21.15.22:0/1262306664 >> v1:172.21.15.22:6809/94493 conn(0x7f144c04b160 legacy=0x7f144c04d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.363 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.357+0000 7f146af22700 1 -- 172.21.15.22:0/1262306664 >> v1:172.21.15.22:6808/92758 conn(0x7f144c041b00 legacy=0x7f144c043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.363 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.357+0000 7f146af22700 1 -- 172.21.15.22:0/1262306664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14640a9ee0 msgr2=0x7f146414b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.363 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.357+0000 7f146af22700 1 --2- 172.21.15.22:0/1262306664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14640a9ee0 0x7f146414b1e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f1450001eb0 tx=0x7f1450007bf0).stop 2022-04-28T14:41:55.363 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.357+0000 7f14694bf700 1 -- 172.21.15.22:0/1262306664 reap_dead start 2022-04-28T14:41:55.363 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.357+0000 7f146af22700 1 -- 172.21.15.22:0/1262306664 shutdown_connections 2022-04-28T14:41:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.358+0000 7f146af22700 1 -- 172.21.15.22:0/1262306664 >> 172.21.15.22:0/1262306664 conn(0x7f1464069860 msgr2=0x7f1464137420 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.358+0000 7f146af22700 1 -- 172.21.15.22:0/1262306664 shutdown_connections 2022-04-28T14:41:55.364 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.358+0000 7f146af22700 1 -- 172.21.15.22:0/1262306664 wait complete. 2022-04-28T14:41:55.373 INFO:teuthology.orchestra.run.smithi022.stdout:124554051588 2022-04-28T14:41:55.374 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2022-04-28T14:41:55.492 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.488+0000 7f565a76e700 1 Processor -- start 2022-04-28T14:41:55.492 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.488+0000 7f565a76e700 1 -- start start 2022-04-28T14:41:55.498 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.488+0000 7f565a76e700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5654063e20 0x7f5654067a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:55.498 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.488+0000 7f565a76e700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f565413ea20 0x7f5654140e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:55.499 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.488+0000 7f565a76e700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5654064200 con 0x7f5654139bc0 2022-04-28T14:41:55.499 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.488+0000 7f565a76e700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5654068040 con 0x7f565413ea20 2022-04-28T14:41:55.499 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.488+0000 7f565a76e700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5654063960 con 0x7f5654063e20 2022-04-28T14:41:55.499 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.488+0000 7f5653fff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5654063e20 0x7f5654067a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:55.499 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.488+0000 7f5653fff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5654063e20 0x7f5654067a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48612/0 (socket says 172.21.15.22:48612) 2022-04-28T14:41:55.499 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.488+0000 7f5658d0b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f565413ea20 0x7f5654140e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:55.500 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.488+0000 7f5653fff700 1 -- 172.21.15.22:0/2739154360 learned_addr learned my addr 172.21.15.22:0/2739154360 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:55.500 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.489+0000 7f5653fff700 1 -- 172.21.15.22:0/2739154360 >> v2:172.21.15.22:3300/0 conn(0x7f565413ea20 msgr2=0x7f5654140e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:55.500 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.489+0000 7f5653fff700 1 --2- 172.21.15.22:0/2739154360 >> v2:172.21.15.22:3300/0 conn(0x7f565413ea20 0x7f5654140e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.500 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.489+0000 7f5653fff700 1 -- 172.21.15.22:0/2739154360 >> v1:172.21.15.22:6789/0 conn(0x7f5654139bc0 legacy=0x7f5654139fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.500 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.489+0000 7f5652ffd700 1 -- 172.21.15.22:0/2739154360 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2208391348 0 0) 0x7f5654064200 con 0x7f5654139bc0 2022-04-28T14:41:55.500 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.489+0000 7f5653fff700 1 -- 172.21.15.22:0/2739154360 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565409daf0 con 0x7f5654063e20 2022-04-28T14:41:55.500 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.489+0000 7f5658d0b700 1 --2- 172.21.15.22:0/2739154360 >> v2:172.21.15.22:3300/0 conn(0x7f565413ea20 0x7f5654140e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:55.500 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.489+0000 7f5653fff700 1 --2- 172.21.15.22:0/2739154360 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5654063e20 0x7f5654067a00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f5644009830 tx=0x7f56440090f0).ready entity=mon.2 client_cookie=80b12fb65ea43c28 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:55.501 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.489+0000 7f5652ffd700 1 -- 172.21.15.22:0/2739154360 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564400b580 con 0x7f5654063e20 2022-04-28T14:41:55.501 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.489+0000 7f5652ffd700 1 -- 172.21.15.22:0/2739154360 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564400b6e0 con 0x7f5654063e20 2022-04-28T14:41:55.501 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.489+0000 7f5652ffd700 1 -- 172.21.15.22:0/2739154360 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564400ba60 con 0x7f5654063e20 2022-04-28T14:41:55.501 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.489+0000 7f565a76e700 1 -- 172.21.15.22:0/2739154360 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5654063e20 msgr2=0x7f5654067a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.501 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.489+0000 7f565a76e700 1 --2- 172.21.15.22:0/2739154360 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5654063e20 0x7f5654067a00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f5644009830 tx=0x7f56440090f0).stop 2022-04-28T14:41:55.501 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.490+0000 7f565a76e700 1 -- 172.21.15.22:0/2739154360 shutdown_connections 2022-04-28T14:41:55.501 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.490+0000 7f565a76e700 1 --2- 172.21.15.22:0/2739154360 >> v2:172.21.15.22:3300/0 conn(0x7f565413ea20 0x7f5654140e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.501 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.490+0000 7f565a76e700 1 --2- 172.21.15.22:0/2739154360 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5654063e20 0x7f5654067a00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.501 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.490+0000 7f565a76e700 1 -- 172.21.15.22:0/2739154360 >> 172.21.15.22:0/2739154360 conn(0x7f56540aaf80 msgr2=0x7f56540ab390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:55.501 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.490+0000 7f565a76e700 1 -- 172.21.15.22:0/2739154360 shutdown_connections 2022-04-28T14:41:55.501 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.490+0000 7f565a76e700 1 -- 172.21.15.22:0/2739154360 wait complete. 2022-04-28T14:41:55.502 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.491+0000 7f565a76e700 1 Processor -- start 2022-04-28T14:41:55.502 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.491+0000 7f565a76e700 1 -- start start 2022-04-28T14:41:55.502 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.491+0000 7f565a76e700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5654063e20 0x7f56540964e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:55.502 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.491+0000 7f565a76e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5654139bc0 0x7f5654099210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:55.502 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.491+0000 7f565a76e700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f565413ea20 0x7f5654099700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:55.502 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.491+0000 7f565a76e700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5654095300 con 0x7f5654139bc0 2022-04-28T14:41:55.502 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.491+0000 7f565a76e700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5654099bf0 con 0x7f565413ea20 2022-04-28T14:41:55.502 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.491+0000 7f565a76e700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5654099e40 con 0x7f5654063e20 2022-04-28T14:41:55.503 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.491+0000 7f56537fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5654139bc0 0x7f5654099210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:55.503 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.491+0000 7f5653fff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5654063e20 0x7f56540964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:55.503 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.491+0000 7f56537fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5654139bc0 0x7f5654099210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51266/0 (socket says 172.21.15.22:51266) 2022-04-28T14:41:55.503 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.491+0000 7f56537fe700 1 -- 172.21.15.22:0/994100393 learned_addr learned my addr 172.21.15.22:0/994100393 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:55.503 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.491+0000 7f5653fff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5654063e20 0x7f56540964e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48616/0 (socket says 172.21.15.22:48616) 2022-04-28T14:41:55.503 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.491+0000 7f5658d0b700 1 --2- 172.21.15.22:0/994100393 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f565413ea20 0x7f5654099700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:55.503 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.492+0000 7f56537fe700 1 -- 172.21.15.22:0/994100393 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5654063e20 msgr2=0x7f56540964e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.503 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.492+0000 7f56537fe700 1 --2- 172.21.15.22:0/994100393 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5654063e20 0x7f56540964e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.503 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.492+0000 7f56537fe700 1 -- 172.21.15.22:0/994100393 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f565413ea20 msgr2=0x7f5654099700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.504 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.492+0000 7f56537fe700 1 --2- 172.21.15.22:0/994100393 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f565413ea20 0x7f5654099700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.504 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.492+0000 7f56537fe700 1 -- 172.21.15.22:0/994100393 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564c009a20 con 0x7f5654139bc0 2022-04-28T14:41:55.504 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.492+0000 7f5653fff700 1 --2- 172.21.15.22:0/994100393 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f5654063e20 0x7f56540964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:55.504 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.492+0000 7f56537fe700 1 --2- 172.21.15.22:0/994100393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5654139bc0 0x7f5654099210 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f564800c4c0 tx=0x7f5648007bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:55.504 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.492+0000 7f563bfff700 1 -- 172.21.15.22:0/994100393 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564800ce80 con 0x7f5654139bc0 2022-04-28T14:41:55.504 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.492+0000 7f563bfff700 1 -- 172.21.15.22:0/994100393 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564800f470 con 0x7f5654139bc0 2022-04-28T14:41:55.504 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.492+0000 7f565a76e700 1 -- 172.21.15.22:0/994100393 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5644009370 con 0x7f5654139bc0 2022-04-28T14:41:55.504 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.492+0000 7f563bfff700 1 -- 172.21.15.22:0/994100393 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564800f830 con 0x7f5654139bc0 2022-04-28T14:41:55.505 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.492+0000 7f565a76e700 1 -- 172.21.15.22:0/994100393 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56540984b0 con 0x7f5654139bc0 2022-04-28T14:41:55.505 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.493+0000 7f565a76e700 1 -- 172.21.15.22:0/994100393 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5654066da0 con 0x7f5654139bc0 2022-04-28T14:41:55.505 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.493+0000 7f563bfff700 1 -- 172.21.15.22:0/994100393 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f5648019030 con 0x7f5654139bc0 2022-04-28T14:41:55.505 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.493+0000 7f563bfff700 1 -- 172.21.15.22:0/994100393 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7f5648054840 con 0x7f5654139bc0 2022-04-28T14:41:55.505 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.493+0000 7f563bfff700 1 -- 172.21.15.22:0/994100393 --> v1:172.21.15.22:6813/94624 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f563404ee70 con 0x7f563404b160 2022-04-28T14:41:55.505 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.493+0000 7f563bfff700 1 -- 172.21.15.22:0/994100393 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5648059220 con 0x7f5654139bc0 2022-04-28T14:41:55.505 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.494+0000 7f563bfff700 1 -- 172.21.15.22:0/994100393 <== osd.3 v1:172.21.15.22:6813/94624 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f563404ee70 con 0x7f563404b160 2022-04-28T14:41:55.513 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.508+0000 7f565a76e700 1 -- 172.21.15.22:0/994100393 --> v1:172.21.15.22:6813/94624 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f56540955e0 con 0x7f563404b160 2022-04-28T14:41:55.513 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.509+0000 7f563bfff700 1 -- 172.21.15.22:0/994100393 <== osd.3 v1:172.21.15.22:6813/94624 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2827348261) 0x7f56540955e0 con 0x7f563404b160 2022-04-28T14:41:55.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.509+0000 7f565a76e700 1 -- 172.21.15.22:0/994100393 >> v1:172.21.15.22:6813/94624 conn(0x7f563404b160 legacy=0x7f563404d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.509+0000 7f565a76e700 1 -- 172.21.15.22:0/994100393 >> v1:172.21.15.22:6808/92758 conn(0x7f5634041b00 legacy=0x7f5634043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.509+0000 7f565a76e700 1 -- 172.21.15.22:0/994100393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5654139bc0 msgr2=0x7f5654099210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.509+0000 7f565a76e700 1 --2- 172.21.15.22:0/994100393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5654139bc0 0x7f5654099210 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f564800c4c0 tx=0x7f5648007bf0).stop 2022-04-28T14:41:55.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.509+0000 7f5658d0b700 1 -- 172.21.15.22:0/994100393 reap_dead start 2022-04-28T14:41:55.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.509+0000 7f565a76e700 1 -- 172.21.15.22:0/994100393 shutdown_connections 2022-04-28T14:41:55.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.509+0000 7f565a76e700 1 -- 172.21.15.22:0/994100393 >> 172.21.15.22:0/994100393 conn(0x7f56540aaf80 msgr2=0x7f5654062680 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:55.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.509+0000 7f565a76e700 1 -- 172.21.15.22:0/994100393 shutdown_connections 2022-04-28T14:41:55.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.509+0000 7f565a76e700 1 -- 172.21.15.22:0/994100393 wait complete. 2022-04-28T14:41:55.525 INFO:teuthology.orchestra.run.smithi022.stdout:128849018884 2022-04-28T14:41:55.526 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-04-28T14:41:55.650 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.640+0000 7efe7a46f700 1 Processor -- start 2022-04-28T14:41:55.651 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.640+0000 7efe7a46f700 1 -- start start 2022-04-28T14:41:55.651 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.641+0000 7efe7a46f700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7efe74068130 0x7efe74066c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:55.651 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.641+0000 7efe7a46f700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7efe74068d00 0x7efe74061f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:55.651 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.641+0000 7efe7a46f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efe74062420 0x7efe740628a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:55.651 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.641+0000 7efe7a46f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe74067330 con 0x7efe74062420 2022-04-28T14:41:55.651 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.641+0000 7efe7a46f700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe740aa710 con 0x7efe74068d00 2022-04-28T14:41:55.651 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.641+0000 7efe7a46f700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe740a5bc0 con 0x7efe74068130 2022-04-28T14:41:55.651 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.641+0000 7efe737fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7efe74068d00 0x7efe74061f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:55.651 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.641+0000 7efe78a0c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efe74062420 0x7efe740628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:55.652 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.641+0000 7efe78a0c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efe74062420 0x7efe740628a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51278/0 (socket says 172.21.15.22:51278) 2022-04-28T14:41:55.652 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.641+0000 7efe737fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7efe74068d00 0x7efe74061f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48842/0 (socket says 172.21.15.22:48842) 2022-04-28T14:41:55.652 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.641+0000 7efe73fff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7efe74068130 0x7efe74066c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:55.652 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.641+0000 7efe78a0c700 1 -- 172.21.15.22:0/3816529050 learned_addr learned my addr 172.21.15.22:0/3816529050 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:55.652 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.641+0000 7efe78a0c700 1 -- 172.21.15.22:0/3816529050 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7efe74068130 msgr2=0x7efe74066c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:55.652 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.641+0000 7efe78a0c700 1 --2- 172.21.15.22:0/3816529050 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7efe74068130 0x7efe74066c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.652 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.641+0000 7efe78a0c700 1 -- 172.21.15.22:0/3816529050 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7efe74068d00 msgr2=0x7efe74061f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:55.652 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.641+0000 7efe78a0c700 1 --2- 172.21.15.22:0/3816529050 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7efe74068d00 0x7efe74061f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.652 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.641+0000 7efe78a0c700 1 -- 172.21.15.22:0/3816529050 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe740aa290 con 0x7efe74062420 2022-04-28T14:41:55.652 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.641+0000 7efe737fe700 1 --2- 172.21.15.22:0/3816529050 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7efe74068d00 0x7efe74061f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:55.653 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.641+0000 7efe73fff700 1 --2- 172.21.15.22:0/3816529050 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7efe74068130 0x7efe74066c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:55.653 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.641+0000 7efe78a0c700 1 --2- 172.21.15.22:0/3816529050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe74062420 0x7efe740628a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7efe6c009f20 tx=0x7efe6c009840).ready entity=mon.0 client_cookie=3e0e588b4777896 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:55.653 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.641+0000 7efe72ffd700 1 -- 172.21.15.22:0/3816529050 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c00e070 con 0x7efe74062420 2022-04-28T14:41:55.653 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.641+0000 7efe72ffd700 1 -- 172.21.15.22:0/3816529050 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c00b970 con 0x7efe74062420 2022-04-28T14:41:55.653 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.641+0000 7efe72ffd700 1 -- 172.21.15.22:0/3816529050 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c00bcf0 con 0x7efe74062420 2022-04-28T14:41:55.653 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.642+0000 7efe7a46f700 1 -- 172.21.15.22:0/3816529050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe74062420 msgr2=0x7efe740628a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.653 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.642+0000 7efe7a46f700 1 --2- 172.21.15.22:0/3816529050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe74062420 0x7efe740628a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7efe6c009f20 tx=0x7efe6c009840).stop 2022-04-28T14:41:55.653 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.642+0000 7efe7a46f700 1 -- 172.21.15.22:0/3816529050 shutdown_connections 2022-04-28T14:41:55.653 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.642+0000 7efe7a46f700 1 --2- 172.21.15.22:0/3816529050 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe74062420 0x7efe740628a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.653 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.642+0000 7efe7a46f700 1 --2- 172.21.15.22:0/3816529050 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7efe74068130 0x7efe74066c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.654 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.642+0000 7efe7a46f700 1 --2- 172.21.15.22:0/3816529050 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7efe74068d00 0x7efe74061f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.654 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.642+0000 7efe7a46f700 1 -- 172.21.15.22:0/3816529050 >> 172.21.15.22:0/3816529050 conn(0x7efe740ae9d0 msgr2=0x7efe740aede0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:55.654 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.642+0000 7efe7a46f700 1 -- 172.21.15.22:0/3816529050 shutdown_connections 2022-04-28T14:41:55.654 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.642+0000 7efe7a46f700 1 -- 172.21.15.22:0/3816529050 wait complete. 2022-04-28T14:41:55.654 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.643+0000 7efe7a46f700 1 Processor -- start 2022-04-28T14:41:55.654 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.643+0000 7efe7a46f700 1 -- start start 2022-04-28T14:41:55.654 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.644+0000 7efe7a46f700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7efe74062420 0x7efe740965f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:55.654 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.644+0000 7efe7a46f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe74068130 0x7efe7413a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:55.654 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.644+0000 7efe7a46f700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7efe74068d00 0x7efe7413ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:55.655 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.644+0000 7efe7a46f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe74095170 con 0x7efe74068130 2022-04-28T14:41:55.655 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.644+0000 7efe7a46f700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe74096f60 con 0x7efe74062420 2022-04-28T14:41:55.655 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.644+0000 7efe7a46f700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe740a8360 con 0x7efe74068d00 2022-04-28T14:41:55.655 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.644+0000 7efe737fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe74068130 0x7efe7413a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:55.655 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.644+0000 7efe78a0c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7efe74068d00 0x7efe7413ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:55.655 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.644+0000 7efe78a0c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7efe74068d00 0x7efe7413ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48636/0 (socket says 172.21.15.22:48636) 2022-04-28T14:41:55.655 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.644+0000 7efe737fe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe74068130 0x7efe7413a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51282/0 (socket says 172.21.15.22:51282) 2022-04-28T14:41:55.655 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.644+0000 7efe737fe700 1 -- 172.21.15.22:0/2582814713 learned_addr learned my addr 172.21.15.22:0/2582814713 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:55.655 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.644+0000 7efe73fff700 1 --2- 172.21.15.22:0/2582814713 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7efe74062420 0x7efe740965f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:55.655 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.644+0000 7efe737fe700 1 -- 172.21.15.22:0/2582814713 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7efe74068d00 msgr2=0x7efe7413ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.656 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.644+0000 7efe737fe700 1 --2- 172.21.15.22:0/2582814713 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7efe74068d00 0x7efe7413ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.656 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.644+0000 7efe737fe700 1 -- 172.21.15.22:0/2582814713 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7efe74062420 msgr2=0x7efe740965f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.656 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.644+0000 7efe737fe700 1 --2- 172.21.15.22:0/2582814713 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7efe74062420 0x7efe740965f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.656 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.644+0000 7efe737fe700 1 -- 172.21.15.22:0/2582814713 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe640092a0 con 0x7efe74068130 2022-04-28T14:41:55.656 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.644+0000 7efe73fff700 1 --2- 172.21.15.22:0/2582814713 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7efe74062420 0x7efe740965f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:55.656 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.644+0000 7efe78a0c700 1 --2- 172.21.15.22:0/2582814713 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7efe74068d00 0x7efe7413ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:55.656 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.644+0000 7efe737fe700 1 --2- 172.21.15.22:0/2582814713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe74068130 0x7efe7413a7f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7efe5c00ea20 tx=0x7efe5c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:55.656 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.644+0000 7efe6bfff700 1 -- 172.21.15.22:0/2582814713 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5c00ee60 con 0x7efe74068130 2022-04-28T14:41:55.656 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.644+0000 7efe6bfff700 1 -- 172.21.15.22:0/2582814713 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe5c00c8e0 con 0x7efe74068130 2022-04-28T14:41:55.656 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.644+0000 7efe7a46f700 1 -- 172.21.15.22:0/2582814713 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5c0092a0 con 0x7efe74068130 2022-04-28T14:41:55.657 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.644+0000 7efe6bfff700 1 -- 172.21.15.22:0/2582814713 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5c00cc60 con 0x7efe74068130 2022-04-28T14:41:55.657 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.645+0000 7efe7a46f700 1 -- 172.21.15.22:0/2582814713 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe6c009ae0 con 0x7efe74068130 2022-04-28T14:41:55.657 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.645+0000 7efe7a46f700 1 -- 172.21.15.22:0/2582814713 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe74065a50 con 0x7efe74068130 2022-04-28T14:41:55.657 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.645+0000 7efe6bfff700 1 -- 172.21.15.22:0/2582814713 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7efe5c022070 con 0x7efe74068130 2022-04-28T14:41:55.657 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.646+0000 7efe6bfff700 1 -- 172.21.15.22:0/2582814713 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7efe5c055890 con 0x7efe74068130 2022-04-28T14:41:55.657 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.649+0000 7efe6bfff700 1 -- 172.21.15.22:0/2582814713 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7efe5c035e70 con 0x7efe74068130 2022-04-28T14:41:55.796 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.791+0000 7efe7a46f700 1 -- 172.21.15.22:0/2582814713 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efe740ac2a0 con 0x7efe74068130 2022-04-28T14:41:55.796 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.791+0000 7efe6bfff700 1 -- 172.21.15.22:0/2582814713 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe5c039660 con 0x7efe74068130 2022-04-28T14:41:55.796 INFO:teuthology.orchestra.run.smithi022.stdout:115964116995 2022-04-28T14:41:55.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.792+0000 7efe7a46f700 1 -- 172.21.15.22:0/2582814713 >> v1:172.21.15.22:6808/92758 conn(0x7efe58041b00 legacy=0x7efe58043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.792+0000 7efe7a46f700 1 -- 172.21.15.22:0/2582814713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe74068130 msgr2=0x7efe7413a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:55.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.792+0000 7efe7a46f700 1 --2- 172.21.15.22:0/2582814713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe74068130 0x7efe7413a7f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7efe5c00ea20 tx=0x7efe5c009060).stop 2022-04-28T14:41:55.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.792+0000 7efe7a46f700 1 -- 172.21.15.22:0/2582814713 shutdown_connections 2022-04-28T14:41:55.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.792+0000 7efe7a46f700 1 --2- 172.21.15.22:0/2582814713 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7efe74068d00 0x7efe7413ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.792+0000 7efe7a46f700 1 --2- 172.21.15.22:0/2582814713 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7efe74062420 0x7efe740965f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.792+0000 7efe7a46f700 1 --2- 172.21.15.22:0/2582814713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efe74068130 0x7efe7413a7f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:55.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.792+0000 7efe7a46f700 1 -- 172.21.15.22:0/2582814713 >> 172.21.15.22:0/2582814713 conn(0x7efe740ae9d0 msgr2=0x7efe740ab860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:55.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.792+0000 7efe7a46f700 1 -- 172.21.15.22:0/2582814713 shutdown_connections 2022-04-28T14:41:55.799 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:55.792+0000 7efe7a46f700 1 -- 172.21.15.22:0/2582814713 wait complete. 2022-04-28T14:41:55.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964116996 got 115964116995 for osd.0 2022-04-28T14:41:56.810 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-04-28T14:41:56.946 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.939+0000 7f4e69a5f700 1 Processor -- start 2022-04-28T14:41:56.946 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.939+0000 7f4e69a5f700 1 -- start start 2022-04-28T14:41:56.946 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.939+0000 7f4e69a5f700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4e64068130 0x7f4e64066c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:56.946 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.939+0000 7f4e69a5f700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4e64062640 0x7f4e64062af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:56.947 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.939+0000 7f4e69a5f700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e64067330 con 0x7f4e64068d00 2022-04-28T14:41:56.947 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.939+0000 7f4e69a5f700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e640aa710 con 0x7f4e64062640 2022-04-28T14:41:56.947 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.939+0000 7f4e69a5f700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e640a5bc0 con 0x7f4e64068130 2022-04-28T14:41:56.947 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.939+0000 7f4e637fe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4e64062640 0x7f4e64062af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:56.947 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.939+0000 7f4e62ffd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4e64068130 0x7f4e64066c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:56.947 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.939+0000 7f4e627fc700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4e64068d00 0x7f4e64061f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40686/0 (socket says 172.21.15.22:40686) 2022-04-28T14:41:56.947 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.940+0000 7f4e627fc700 1 -- 172.21.15.22:0/3723682932 learned_addr learned my addr 172.21.15.22:0/3723682932 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:41:56.948 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.940+0000 7f4e637fe700 1 -- 172.21.15.22:0/3723682932 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4e64068130 msgr2=0x7f4e64066c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:56.948 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.940+0000 7f4e637fe700 1 --2- 172.21.15.22:0/3723682932 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4e64068130 0x7f4e64066c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:56.948 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.940+0000 7f4e637fe700 1 -- 172.21.15.22:0/3723682932 >> v1:172.21.15.22:6789/0 conn(0x7f4e64068d00 legacy=0x7f4e64061f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:56.948 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.940+0000 7f4e637fe700 1 -- 172.21.15.22:0/3723682932 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e640aa290 con 0x7f4e64062640 2022-04-28T14:41:56.948 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.940+0000 7f4e61ffb700 1 -- 172.21.15.22:0/3723682932 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653975612 0 0) 0x7f4e64067330 con 0x7f4e64068d00 2022-04-28T14:41:56.948 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.940+0000 7f4e62ffd700 1 --2- 172.21.15.22:0/3723682932 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4e64068130 0x7f4e64066c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:56.948 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.940+0000 7f4e637fe700 1 --2- 172.21.15.22:0/3723682932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e64062640 0x7f4e64062af0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f4e5c009e60 tx=0x7f4e5c009780).ready entity=mon.0 client_cookie=1e4f56795c2f8c5d server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:56.948 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.940+0000 7f4e61ffb700 1 -- 172.21.15.22:0/3723682932 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c00e070 con 0x7f4e64062640 2022-04-28T14:41:56.948 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.940+0000 7f4e61ffb700 1 -- 172.21.15.22:0/3723682932 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5c00bb60 con 0x7f4e64062640 2022-04-28T14:41:56.948 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.940+0000 7f4e61ffb700 1 -- 172.21.15.22:0/3723682932 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c012410 con 0x7f4e64062640 2022-04-28T14:41:56.949 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.941+0000 7f4e69a5f700 1 -- 172.21.15.22:0/3723682932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e64062640 msgr2=0x7f4e64062af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:56.949 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.941+0000 7f4e69a5f700 1 --2- 172.21.15.22:0/3723682932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e64062640 0x7f4e64062af0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f4e5c009e60 tx=0x7f4e5c009780).stop 2022-04-28T14:41:56.949 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.941+0000 7f4e69a5f700 1 -- 172.21.15.22:0/3723682932 shutdown_connections 2022-04-28T14:41:56.949 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.941+0000 7f4e69a5f700 1 --2- 172.21.15.22:0/3723682932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e64062640 0x7f4e64062af0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:56.949 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.941+0000 7f4e69a5f700 1 --2- 172.21.15.22:0/3723682932 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4e64068130 0x7f4e64066c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:56.949 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.941+0000 7f4e69a5f700 1 -- 172.21.15.22:0/3723682932 >> 172.21.15.22:0/3723682932 conn(0x7f4e640ae9d0 msgr2=0x7f4e640aede0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:56.949 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.941+0000 7f4e69a5f700 1 -- 172.21.15.22:0/3723682932 shutdown_connections 2022-04-28T14:41:56.949 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.941+0000 7f4e69a5f700 1 -- 172.21.15.22:0/3723682932 wait complete. 2022-04-28T14:41:56.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.942+0000 7f4e69a5f700 1 Processor -- start 2022-04-28T14:41:56.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.942+0000 7f4e69a5f700 1 -- start start 2022-04-28T14:41:56.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.942+0000 7f4e69a5f700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4e64062640 0x7f4e6409c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:56.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.942+0000 7f4e69a5f700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e64068130 0x7f4e6409adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:56.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.943+0000 7f4e69a5f700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4e64068d00 0x7f4e64148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:56.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.943+0000 7f4e69a5f700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6409bc10 con 0x7f4e64068130 2022-04-28T14:41:56.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.943+0000 7f4e69a5f700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e641480b0 con 0x7f4e64062640 2022-04-28T14:41:56.952 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.943+0000 7f4e69a5f700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6409b2e0 con 0x7f4e64068d00 2022-04-28T14:41:56.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.943+0000 7f4e62ffd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4e64062640 0x7f4e6409c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:56.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.943+0000 7f4e627fc700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e64068130 0x7f4e6409adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:56.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.943+0000 7f4e62ffd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4e64062640 0x7f4e6409c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48862/0 (socket says 172.21.15.22:48862) 2022-04-28T14:41:56.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.943+0000 7f4e62ffd700 1 -- 172.21.15.22:0/2688490981 learned_addr learned my addr 172.21.15.22:0/2688490981 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:56.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.943+0000 7f4e637fe700 1 --2- 172.21.15.22:0/2688490981 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4e64068d00 0x7f4e64148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:56.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.943+0000 7f4e62ffd700 1 -- 172.21.15.22:0/2688490981 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4e64068d00 msgr2=0x7f4e64148370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:56.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.943+0000 7f4e62ffd700 1 --2- 172.21.15.22:0/2688490981 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4e64068d00 0x7f4e64148370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:56.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.943+0000 7f4e62ffd700 1 -- 172.21.15.22:0/2688490981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e64068130 msgr2=0x7f4e6409adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:56.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.943+0000 7f4e62ffd700 1 --2- 172.21.15.22:0/2688490981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e64068130 0x7f4e6409adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:56.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.943+0000 7f4e62ffd700 1 -- 172.21.15.22:0/2688490981 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e580092a0 con 0x7f4e64062640 2022-04-28T14:41:56.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.943+0000 7f4e627fc700 1 --2- 172.21.15.22:0/2688490981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e64068130 0x7f4e6409adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:56.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.943+0000 7f4e62ffd700 1 --2- 172.21.15.22:0/2688490981 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4e64062640 0x7f4e6409c4f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f4e5800ea20 tx=0x7f4e58009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:56.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.943+0000 7f4e4affd700 1 -- 172.21.15.22:0/2688490981 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5800ee60 con 0x7f4e64062640 2022-04-28T14:41:56.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.943+0000 7f4e4affd700 1 -- 172.21.15.22:0/2688490981 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5800c850 con 0x7f4e64062640 2022-04-28T14:41:56.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.943+0000 7f4e69a5f700 1 -- 172.21.15.22:0/2688490981 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e5c009a20 con 0x7f4e64062640 2022-04-28T14:41:56.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.943+0000 7f4e4affd700 1 -- 172.21.15.22:0/2688490981 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5800cbd0 con 0x7f4e64062640 2022-04-28T14:41:56.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.943+0000 7f4e69a5f700 1 -- 172.21.15.22:0/2688490981 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e64098f30 con 0x7f4e64062640 2022-04-28T14:41:56.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.944+0000 7f4e69a5f700 1 -- 172.21.15.22:0/2688490981 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e6409c170 con 0x7f4e64062640 2022-04-28T14:41:56.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.944+0000 7f4e4affd700 1 -- 172.21.15.22:0/2688490981 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f4e58022070 con 0x7f4e64062640 2022-04-28T14:41:56.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.945+0000 7f4e4affd700 1 -- 172.21.15.22:0/2688490981 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7f4e58055840 con 0x7f4e64062640 2022-04-28T14:41:56.955 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:56.948+0000 7f4e4affd700 1 -- 172.21.15.22:0/2688490981 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f4e58035e20 con 0x7f4e64062640 2022-04-28T14:41:57.094 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.089+0000 7f4e69a5f700 1 -- 172.21.15.22:0/2688490981 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4e6409c340 con 0x7f4e64062640 2022-04-28T14:41:57.094 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.090+0000 7f4e4affd700 1 -- 172.21.15.22:0/2688490981 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e58039610 con 0x7f4e64062640 2022-04-28T14:41:57.095 INFO:teuthology.orchestra.run.smithi022.stdout:115964116996 2022-04-28T14:41:57.096 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.091+0000 7f4e69a5f700 1 -- 172.21.15.22:0/2688490981 >> v1:172.21.15.22:6808/92758 conn(0x7f4e44041b00 legacy=0x7f4e44043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:57.097 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.091+0000 7f4e69a5f700 1 -- 172.21.15.22:0/2688490981 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4e64062640 msgr2=0x7f4e6409c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:57.097 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.091+0000 7f4e69a5f700 1 --2- 172.21.15.22:0/2688490981 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4e64062640 0x7f4e6409c4f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f4e5800ea20 tx=0x7f4e58009060).stop 2022-04-28T14:41:57.097 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.091+0000 7f4e69a5f700 1 -- 172.21.15.22:0/2688490981 shutdown_connections 2022-04-28T14:41:57.097 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.091+0000 7f4e69a5f700 1 --2- 172.21.15.22:0/2688490981 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f4e64068d00 0x7f4e64148370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:57.097 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.091+0000 7f4e69a5f700 1 --2- 172.21.15.22:0/2688490981 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f4e64062640 0x7f4e6409c4f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:57.097 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.091+0000 7f4e69a5f700 1 --2- 172.21.15.22:0/2688490981 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4e64068130 0x7f4e6409adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:57.097 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.091+0000 7f4e69a5f700 1 -- 172.21.15.22:0/2688490981 >> 172.21.15.22:0/2688490981 conn(0x7f4e640ae9d0 msgr2=0x7f4e640abc40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:57.098 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.091+0000 7f4e69a5f700 1 -- 172.21.15.22:0/2688490981 shutdown_connections 2022-04-28T14:41:57.098 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.091+0000 7f4e69a5f700 1 -- 172.21.15.22:0/2688490981 wait complete. 2022-04-28T14:41:57.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964116996 got 115964116996 for osd.0 2022-04-28T14:41:57.108 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2022-04-28T14:41:57.229 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.222+0000 7ff8deba4700 1 Processor -- start 2022-04-28T14:41:57.229 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.222+0000 7ff8deba4700 1 -- start start 2022-04-28T14:41:57.229 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.222+0000 7ff8deba4700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff8d80ab4e0 0x7ff8d809ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:57.229 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.222+0000 7ff8deba4700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff8d80699b0 0x7ff8d809e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:57.229 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.222+0000 7ff8deba4700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d80ab8c0 con 0x7ff8d809e990 2022-04-28T14:41:57.229 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.222+0000 7ff8deba4700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d809d260 con 0x7ff8d80ab4e0 2022-04-28T14:41:57.229 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.222+0000 7ff8deba4700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d809d520 con 0x7ff8d80699b0 2022-04-28T14:41:57.229 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.222+0000 7ff8d7fff700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff8d80699b0 0x7ff8d809e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:57.230 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.222+0000 7ff8dc940700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff8d80ab4e0 0x7ff8d809ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:57.230 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.222+0000 7ff8dd141700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff8d809e990 0x7ff8d8142240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40700/0 (socket says 172.21.15.22:40700) 2022-04-28T14:41:57.230 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.223+0000 7ff8dd141700 1 -- 172.21.15.22:0/1228531645 learned_addr learned my addr 172.21.15.22:0/1228531645 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:41:57.230 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.223+0000 7ff8d7fff700 1 -- 172.21.15.22:0/1228531645 >> v2:172.21.15.22:3300/0 conn(0x7ff8d80ab4e0 msgr2=0x7ff8d809ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:57.230 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.223+0000 7ff8d7fff700 1 --2- 172.21.15.22:0/1228531645 >> v2:172.21.15.22:3300/0 conn(0x7ff8d80ab4e0 0x7ff8d809ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:57.230 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.223+0000 7ff8d7fff700 1 -- 172.21.15.22:0/1228531645 >> v1:172.21.15.22:6789/0 conn(0x7ff8d809e990 legacy=0x7ff8d8142240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:57.230 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.223+0000 7ff8d7fff700 1 -- 172.21.15.22:0/1228531645 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d809fd80 con 0x7ff8d80699b0 2022-04-28T14:41:57.230 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.223+0000 7ff8d77fe700 1 -- 172.21.15.22:0/1228531645 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988835489 0 0) 0x7ff8d80ab8c0 con 0x7ff8d809e990 2022-04-28T14:41:57.230 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.223+0000 7ff8dc940700 1 --2- 172.21.15.22:0/1228531645 >> v2:172.21.15.22:3300/0 conn(0x7ff8d80ab4e0 0x7ff8d809ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:57.231 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.223+0000 7ff8d7fff700 1 --2- 172.21.15.22:0/1228531645 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff8d80699b0 0x7ff8d809e4a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7ff8c4009760 tx=0x7ff8c4009060).ready entity=mon.1 client_cookie=df4ed5aee425c722 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:57.231 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.223+0000 7ff8d77fe700 1 -- 172.21.15.22:0/1228531645 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c400f510 con 0x7ff8d80699b0 2022-04-28T14:41:57.231 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.223+0000 7ff8d77fe700 1 -- 172.21.15.22:0/1228531645 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c400f670 con 0x7ff8d80699b0 2022-04-28T14:41:57.231 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.223+0000 7ff8d77fe700 1 -- 172.21.15.22:0/1228531645 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c400f9f0 con 0x7ff8d80699b0 2022-04-28T14:41:57.231 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.224+0000 7ff8deba4700 1 -- 172.21.15.22:0/1228531645 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff8d80699b0 msgr2=0x7ff8d809e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:57.231 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.224+0000 7ff8deba4700 1 --2- 172.21.15.22:0/1228531645 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff8d80699b0 0x7ff8d809e4a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7ff8c4009760 tx=0x7ff8c4009060).stop 2022-04-28T14:41:57.231 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.224+0000 7ff8deba4700 1 -- 172.21.15.22:0/1228531645 shutdown_connections 2022-04-28T14:41:57.231 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.224+0000 7ff8deba4700 1 --2- 172.21.15.22:0/1228531645 >> v2:172.21.15.22:3300/0 conn(0x7ff8d80ab4e0 0x7ff8d809ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:57.232 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.224+0000 7ff8deba4700 1 --2- 172.21.15.22:0/1228531645 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff8d80699b0 0x7ff8d809e4a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:57.232 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.224+0000 7ff8deba4700 1 -- 172.21.15.22:0/1228531645 >> 172.21.15.22:0/1228531645 conn(0x7ff8d8066780 msgr2=0x7ff8d80aa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:57.232 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.224+0000 7ff8deba4700 1 -- 172.21.15.22:0/1228531645 shutdown_connections 2022-04-28T14:41:57.232 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.224+0000 7ff8deba4700 1 -- 172.21.15.22:0/1228531645 wait complete. 2022-04-28T14:41:57.234 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.225+0000 7ff8deba4700 1 Processor -- start 2022-04-28T14:41:57.234 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.225+0000 7ff8deba4700 1 -- start start 2022-04-28T14:41:57.234 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.225+0000 7ff8deba4700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff8d80699b0 0x7ff8d8097ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:57.235 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.225+0000 7ff8deba4700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff8d809e990 0x7ff8d8096800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:57.235 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.225+0000 7ff8deba4700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8d80ab4e0 0x7ff8d814b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:57.235 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.225+0000 7ff8deba4700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d8098470 con 0x7ff8d80ab4e0 2022-04-28T14:41:57.235 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.225+0000 7ff8deba4700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d80971d0 con 0x7ff8d80699b0 2022-04-28T14:41:57.235 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.225+0000 7ff8deba4700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d809c600 con 0x7ff8d809e990 2022-04-28T14:41:57.235 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.225+0000 7ff8dc940700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff8d80699b0 0x7ff8d8097ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:57.235 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.225+0000 7ff8dc940700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff8d80699b0 0x7ff8d8097ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48874/0 (socket says 172.21.15.22:48874) 2022-04-28T14:41:57.235 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.225+0000 7ff8dd141700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8d80ab4e0 0x7ff8d814b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:57.235 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.225+0000 7ff8dc940700 1 -- 172.21.15.22:0/3833629099 learned_addr learned my addr 172.21.15.22:0/3833629099 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:57.236 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.225+0000 7ff8d7fff700 1 --2- 172.21.15.22:0/3833629099 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff8d809e990 0x7ff8d8096800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:57.236 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.226+0000 7ff8dd141700 1 -- 172.21.15.22:0/3833629099 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff8d809e990 msgr2=0x7ff8d8096800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:57.236 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.226+0000 7ff8dd141700 1 --2- 172.21.15.22:0/3833629099 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff8d809e990 0x7ff8d8096800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:57.236 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.226+0000 7ff8dd141700 1 -- 172.21.15.22:0/3833629099 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff8d80699b0 msgr2=0x7ff8d8097ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:57.236 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.226+0000 7ff8dd141700 1 --2- 172.21.15.22:0/3833629099 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff8d80699b0 0x7ff8d8097ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:57.236 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.226+0000 7ff8dd141700 1 -- 172.21.15.22:0/3833629099 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8cc0092a0 con 0x7ff8d80ab4e0 2022-04-28T14:41:57.236 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.226+0000 7ff8dc940700 1 --2- 172.21.15.22:0/3833629099 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff8d80699b0 0x7ff8d8097ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:57.236 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.226+0000 7ff8dd141700 1 --2- 172.21.15.22:0/3833629099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8d80ab4e0 0x7ff8d814b650 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7ff8d0002230 tx=0x7ff8d0007eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:57.236 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.226+0000 7ff8d4ff9700 1 -- 172.21.15.22:0/3833629099 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0005d30 con 0x7ff8d80ab4e0 2022-04-28T14:41:57.236 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.226+0000 7ff8d4ff9700 1 -- 172.21.15.22:0/3833629099 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d0005e90 con 0x7ff8d80ab4e0 2022-04-28T14:41:57.237 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.226+0000 7ff8d4ff9700 1 -- 172.21.15.22:0/3833629099 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0007360 con 0x7ff8d80ab4e0 2022-04-28T14:41:57.237 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.226+0000 7ff8deba4700 1 -- 172.21.15.22:0/3833629099 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c40092a0 con 0x7ff8d80ab4e0 2022-04-28T14:41:57.237 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.226+0000 7ff8deba4700 1 -- 172.21.15.22:0/3833629099 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d8095a70 con 0x7ff8d80ab4e0 2022-04-28T14:41:57.237 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.227+0000 7ff8deba4700 1 -- 172.21.15.22:0/3833629099 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d8062f40 con 0x7ff8d80ab4e0 2022-04-28T14:41:57.237 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.227+0000 7ff8d4ff9700 1 -- 172.21.15.22:0/3833629099 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7ff8d0010030 con 0x7ff8d80ab4e0 2022-04-28T14:41:57.237 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.227+0000 7ff8d4ff9700 1 -- 172.21.15.22:0/3833629099 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7ff8d00551e0 con 0x7ff8d80ab4e0 2022-04-28T14:41:57.237 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.231+0000 7ff8d4ff9700 1 -- 172.21.15.22:0/3833629099 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7ff8d00357c0 con 0x7ff8d80ab4e0 2022-04-28T14:41:57.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.371+0000 7ff8deba4700 1 -- 172.21.15.22:0/3833629099 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff8d809c7c0 con 0x7ff8d80ab4e0 2022-04-28T14:41:57.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.371+0000 7ff8d4ff9700 1 -- 172.21.15.22:0/3833629099 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff8d0038fb0 con 0x7ff8d80ab4e0 2022-04-28T14:41:57.376 INFO:teuthology.orchestra.run.smithi022.stdout:120259084291 2022-04-28T14:41:57.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.372+0000 7ff8deba4700 1 -- 172.21.15.22:0/3833629099 >> v1:172.21.15.22:6808/92758 conn(0x7ff8c0041b30 legacy=0x7ff8c0043ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:57.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.372+0000 7ff8deba4700 1 -- 172.21.15.22:0/3833629099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8d80ab4e0 msgr2=0x7ff8d814b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:57.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.372+0000 7ff8deba4700 1 --2- 172.21.15.22:0/3833629099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8d80ab4e0 0x7ff8d814b650 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7ff8d0002230 tx=0x7ff8d0007eb0).stop 2022-04-28T14:41:57.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.372+0000 7ff8deba4700 1 -- 172.21.15.22:0/3833629099 shutdown_connections 2022-04-28T14:41:57.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.372+0000 7ff8deba4700 1 --2- 172.21.15.22:0/3833629099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8d80ab4e0 0x7ff8d814b650 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:57.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.372+0000 7ff8deba4700 1 --2- 172.21.15.22:0/3833629099 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff8d80699b0 0x7ff8d8097ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:57.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.372+0000 7ff8deba4700 1 --2- 172.21.15.22:0/3833629099 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff8d809e990 0x7ff8d8096800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:57.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.372+0000 7ff8deba4700 1 -- 172.21.15.22:0/3833629099 >> 172.21.15.22:0/3833629099 conn(0x7ff8d8066780 msgr2=0x7ff8d8062680 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:57.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.373+0000 7ff8deba4700 1 -- 172.21.15.22:0/3833629099 shutdown_connections 2022-04-28T14:41:57.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:57.373+0000 7ff8deba4700 1 -- 172.21.15.22:0/3833629099 wait complete. 2022-04-28T14:41:57.389 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084291 for osd.1 2022-04-28T14:41:58.389 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2022-04-28T14:41:58.528 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.517+0000 7f1695d50700 1 Processor -- start 2022-04-28T14:41:58.528 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.517+0000 7f1695d50700 1 -- start start 2022-04-28T14:41:58.528 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.518+0000 7f1695d50700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1690099600 0x7f169009cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:58.528 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.518+0000 7f1695d50700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f169009b4d0 0x7f1690142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:58.529 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.518+0000 7f1695d50700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16900639d0 con 0x7f1690063e20 2022-04-28T14:41:58.529 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.518+0000 7f1695d50700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1690099d00 con 0x7f1690099600 2022-04-28T14:41:58.529 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.518+0000 7f1695d50700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1690064200 con 0x7f169009b4d0 2022-04-28T14:41:58.529 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.518+0000 7f168ffff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f169009b4d0 0x7f1690142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:58.529 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.518+0000 7f168f7fe700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f1690063e20 0x7f1690098180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40716/0 (socket says 172.21.15.22:40716) 2022-04-28T14:41:58.530 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.518+0000 7f168effd700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1690099600 0x7f169009cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:58.530 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.518+0000 7f168f7fe700 1 -- 172.21.15.22:0/99658898 learned_addr learned my addr 172.21.15.22:0/99658898 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:41:58.530 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.518+0000 7f168e7fc700 1 -- 172.21.15.22:0/99658898 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 995093401 0 0) 0x7f16900639d0 con 0x7f1690063e20 2022-04-28T14:41:58.530 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.518+0000 7f168ffff700 1 -- 172.21.15.22:0/99658898 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1690099600 msgr2=0x7f169009cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:58.530 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.518+0000 7f168ffff700 1 --2- 172.21.15.22:0/99658898 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1690099600 0x7f169009cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:58.531 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.518+0000 7f168ffff700 1 -- 172.21.15.22:0/99658898 >> v1:172.21.15.22:6789/0 conn(0x7f1690063e20 legacy=0x7f1690098180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:58.531 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.518+0000 7f168ffff700 1 -- 172.21.15.22:0/99658898 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169009bc70 con 0x7f169009b4d0 2022-04-28T14:41:58.531 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.518+0000 7f168ffff700 1 --2- 172.21.15.22:0/99658898 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f169009b4d0 0x7f1690142ba0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f1688009e90 tx=0x7f1688009780).ready entity=mon.2 client_cookie=11057041340408e6 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:58.531 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.518+0000 7f168e7fc700 1 -- 172.21.15.22:0/99658898 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168800e070 con 0x7f169009b4d0 2022-04-28T14:41:58.531 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.518+0000 7f168e7fc700 1 -- 172.21.15.22:0/99658898 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168800bbf0 con 0x7f169009b4d0 2022-04-28T14:41:58.531 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.518+0000 7f168e7fc700 1 -- 172.21.15.22:0/99658898 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1688012410 con 0x7f169009b4d0 2022-04-28T14:41:58.532 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.519+0000 7f1695d50700 1 -- 172.21.15.22:0/99658898 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f169009b4d0 msgr2=0x7f1690142ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:58.532 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.519+0000 7f1695d50700 1 --2- 172.21.15.22:0/99658898 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f169009b4d0 0x7f1690142ba0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f1688009e90 tx=0x7f1688009780).stop 2022-04-28T14:41:58.532 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.519+0000 7f1695d50700 1 -- 172.21.15.22:0/99658898 shutdown_connections 2022-04-28T14:41:58.532 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.519+0000 7f1695d50700 1 --2- 172.21.15.22:0/99658898 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f169009b4d0 0x7f1690142ba0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:58.532 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.519+0000 7f1695d50700 1 --2- 172.21.15.22:0/99658898 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1690099600 0x7f169009cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:58.533 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.519+0000 7f1695d50700 1 -- 172.21.15.22:0/99658898 >> 172.21.15.22:0/99658898 conn(0x7f16900aaf80 msgr2=0x7f16900ab390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:58.533 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.519+0000 7f1695d50700 1 -- 172.21.15.22:0/99658898 shutdown_connections 2022-04-28T14:41:58.533 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.519+0000 7f1695d50700 1 -- 172.21.15.22:0/99658898 wait complete. 2022-04-28T14:41:58.533 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.520+0000 7f1695d50700 1 Processor -- start 2022-04-28T14:41:58.533 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.520+0000 7f1695d50700 1 -- start start 2022-04-28T14:41:58.534 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.521+0000 7f1695d50700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1690063e20 0x7f1690148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:58.534 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.521+0000 7f1695d50700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1690099600 0x7f16900a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:58.534 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.521+0000 7f1695d50700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f169009b4d0 0x7f169014bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:58.534 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.521+0000 7f1695d50700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1690069b20 con 0x7f1690099600 2022-04-28T14:41:58.534 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.521+0000 7f1695d50700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16900a1540 con 0x7f1690063e20 2022-04-28T14:41:58.534 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.521+0000 7f1695d50700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16900a12d0 con 0x7f169009b4d0 2022-04-28T14:41:58.535 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.521+0000 7f168f7fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1690063e20 0x7f1690148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:58.535 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.521+0000 7f168effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1690099600 0x7f16900a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:58.535 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.521+0000 7f168f7fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1690063e20 0x7f1690148bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48894/0 (socket says 172.21.15.22:48894) 2022-04-28T14:41:58.535 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.521+0000 7f168effd700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1690099600 0x7f16900a1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51328/0 (socket says 172.21.15.22:51328) 2022-04-28T14:41:58.535 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.521+0000 7f168f7fe700 1 -- 172.21.15.22:0/2575391288 learned_addr learned my addr 172.21.15.22:0/2575391288 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:58.536 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.521+0000 7f168ffff700 1 --2- 172.21.15.22:0/2575391288 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f169009b4d0 0x7f169014bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:58.536 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.521+0000 7f168effd700 1 -- 172.21.15.22:0/2575391288 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f169009b4d0 msgr2=0x7f169014bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:58.536 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.521+0000 7f168effd700 1 --2- 172.21.15.22:0/2575391288 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f169009b4d0 0x7f169014bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:58.536 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.521+0000 7f168effd700 1 -- 172.21.15.22:0/2575391288 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1690063e20 msgr2=0x7f1690148bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:58.536 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.521+0000 7f168effd700 1 --2- 172.21.15.22:0/2575391288 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1690063e20 0x7f1690148bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:58.536 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.521+0000 7f168effd700 1 -- 172.21.15.22:0/2575391288 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1688009a20 con 0x7f1690099600 2022-04-28T14:41:58.537 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.521+0000 7f168f7fe700 1 --2- 172.21.15.22:0/2575391288 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1690063e20 0x7f1690148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:58.537 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.521+0000 7f168effd700 1 --2- 172.21.15.22:0/2575391288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1690099600 0x7f16900a1a40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f1690066490 tx=0x7f1684009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:58.537 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.521+0000 7f16777fe700 1 -- 172.21.15.22:0/2575391288 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1684009450 con 0x7f1690099600 2022-04-28T14:41:58.537 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.522+0000 7f16777fe700 1 -- 172.21.15.22:0/2575391288 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1684012600 con 0x7f1690099600 2022-04-28T14:41:58.537 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.522+0000 7f1695d50700 1 -- 172.21.15.22:0/2575391288 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16901486e0 con 0x7f1690099600 2022-04-28T14:41:58.538 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.522+0000 7f16777fe700 1 -- 172.21.15.22:0/2575391288 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1684012980 con 0x7f1690099600 2022-04-28T14:41:58.538 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.522+0000 7f1695d50700 1 -- 172.21.15.22:0/2575391288 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169014ba20 con 0x7f1690099600 2022-04-28T14:41:58.538 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.522+0000 7f1695d50700 1 -- 172.21.15.22:0/2575391288 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f169009cf70 con 0x7f1690099600 2022-04-28T14:41:58.538 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.522+0000 7f16777fe700 1 -- 172.21.15.22:0/2575391288 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f1684022070 con 0x7f1690099600 2022-04-28T14:41:58.538 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.523+0000 7f16777fe700 1 -- 172.21.15.22:0/2575391288 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7f16840555b0 con 0x7f1690099600 2022-04-28T14:41:58.539 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.526+0000 7f16777fe700 1 -- 172.21.15.22:0/2575391288 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f1684035c10 con 0x7f1690099600 2022-04-28T14:41:58.671 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.666+0000 7f1695d50700 1 -- 172.21.15.22:0/2575391288 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1690066da0 con 0x7f1690099600 2022-04-28T14:41:58.671 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.666+0000 7f16777fe700 1 -- 172.21.15.22:0/2575391288 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1684039400 con 0x7f1690099600 2022-04-28T14:41:58.671 INFO:teuthology.orchestra.run.smithi022.stdout:120259084293 2022-04-28T14:41:58.673 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.667+0000 7f1695d50700 1 -- 172.21.15.22:0/2575391288 >> v1:172.21.15.22:6808/92758 conn(0x7f1670041b00 legacy=0x7f1670043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:58.673 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.667+0000 7f1695d50700 1 -- 172.21.15.22:0/2575391288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1690099600 msgr2=0x7f16900a1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:58.673 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.667+0000 7f1695d50700 1 --2- 172.21.15.22:0/2575391288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1690099600 0x7f16900a1a40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f1690066490 tx=0x7f1684009060).stop 2022-04-28T14:41:58.673 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.667+0000 7f1695d50700 1 -- 172.21.15.22:0/2575391288 shutdown_connections 2022-04-28T14:41:58.674 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.667+0000 7f1695d50700 1 --2- 172.21.15.22:0/2575391288 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f169009b4d0 0x7f169014bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:58.674 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.667+0000 7f1695d50700 1 --2- 172.21.15.22:0/2575391288 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1690063e20 0x7f1690148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:58.674 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.667+0000 7f1695d50700 1 --2- 172.21.15.22:0/2575391288 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1690099600 0x7f16900a1a40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:58.674 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.667+0000 7f1695d50700 1 -- 172.21.15.22:0/2575391288 >> 172.21.15.22:0/2575391288 conn(0x7f16900aaf80 msgr2=0x7f1690097f50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:58.674 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.667+0000 7f1695d50700 1 -- 172.21.15.22:0/2575391288 shutdown_connections 2022-04-28T14:41:58.674 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.667+0000 7f1695d50700 1 -- 172.21.15.22:0/2575391288 wait complete. 2022-04-28T14:41:58.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084293 for osd.1 2022-04-28T14:41:58.684 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2022-04-28T14:41:58.807 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.798+0000 7fb3e419d700 1 Processor -- start 2022-04-28T14:41:58.807 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.798+0000 7fb3e419d700 1 -- start start 2022-04-28T14:41:58.808 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.798+0000 7fb3e419d700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb3dc068130 0x7fb3dc066c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:58.808 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.798+0000 7fb3e419d700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb3dc068d00 0x7fb3dc061f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:58.808 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.798+0000 7fb3e419d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb3dc062420 0x7fb3dc0628a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:58.808 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.798+0000 7fb3e419d700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3dc067330 con 0x7fb3dc062420 2022-04-28T14:41:58.808 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.798+0000 7fb3e419d700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc0aa710 con 0x7fb3dc068130 2022-04-28T14:41:58.808 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.798+0000 7fb3e419d700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc0a5bc0 con 0x7fb3dc068d00 2022-04-28T14:41:58.808 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.799+0000 7fb3e273a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb3dc062420 0x7fb3dc0628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:58.808 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.799+0000 7fb3e1738700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb3dc068d00 0x7fb3dc061f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:58.808 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.799+0000 7fb3e1f39700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb3dc068130 0x7fb3dc066c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:58.809 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.799+0000 7fb3e273a700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb3dc062420 0x7fb3dc0628a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51338/0 (socket says 172.21.15.22:51338) 2022-04-28T14:41:58.809 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.799+0000 7fb3e1738700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb3dc068d00 0x7fb3dc061f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48686/0 (socket says 172.21.15.22:48686) 2022-04-28T14:41:58.809 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.799+0000 7fb3e273a700 1 -- 172.21.15.22:0/1769171355 learned_addr learned my addr 172.21.15.22:0/1769171355 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:58.809 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.799+0000 7fb3e1f39700 1 -- 172.21.15.22:0/1769171355 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb3dc068d00 msgr2=0x7fb3dc061f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:58.809 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.799+0000 7fb3e1f39700 1 --2- 172.21.15.22:0/1769171355 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb3dc068d00 0x7fb3dc061f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:58.809 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.799+0000 7fb3e1f39700 1 -- 172.21.15.22:0/1769171355 >> v2:172.21.15.22:3300/0 conn(0x7fb3dc062420 msgr2=0x7fb3dc0628a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:58.809 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.799+0000 7fb3e1f39700 1 --2- 172.21.15.22:0/1769171355 >> v2:172.21.15.22:3300/0 conn(0x7fb3dc062420 0x7fb3dc0628a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:58.809 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.799+0000 7fb3e1f39700 1 -- 172.21.15.22:0/1769171355 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc0aa290 con 0x7fb3dc068130 2022-04-28T14:41:58.809 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.799+0000 7fb3e273a700 1 --2- 172.21.15.22:0/1769171355 >> v2:172.21.15.22:3300/0 conn(0x7fb3dc062420 0x7fb3dc0628a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:58.810 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.799+0000 7fb3e1f39700 1 --2- 172.21.15.22:0/1769171355 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb3dc068130 0x7fb3dc066c70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb3cc009760 tx=0x7fb3cc009060).ready entity=mon.1 client_cookie=b5311d0b0211cd3a server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:58.810 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.799+0000 7fb3e0f37700 1 -- 172.21.15.22:0/1769171355 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc00d4a0 con 0x7fb3dc068130 2022-04-28T14:41:58.810 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.799+0000 7fb3e0f37700 1 -- 172.21.15.22:0/1769171355 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc00d600 con 0x7fb3dc068130 2022-04-28T14:41:58.810 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.799+0000 7fb3e0f37700 1 -- 172.21.15.22:0/1769171355 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc00d980 con 0x7fb3dc068130 2022-04-28T14:41:58.810 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.800+0000 7fb3e419d700 1 -- 172.21.15.22:0/1769171355 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb3dc068130 msgr2=0x7fb3dc066c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:58.810 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.800+0000 7fb3e419d700 1 --2- 172.21.15.22:0/1769171355 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb3dc068130 0x7fb3dc066c70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fb3cc009760 tx=0x7fb3cc009060).stop 2022-04-28T14:41:58.810 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.800+0000 7fb3e419d700 1 -- 172.21.15.22:0/1769171355 shutdown_connections 2022-04-28T14:41:58.810 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.800+0000 7fb3e419d700 1 --2- 172.21.15.22:0/1769171355 >> v2:172.21.15.22:3300/0 conn(0x7fb3dc062420 0x7fb3dc0628a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:58.810 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.800+0000 7fb3e419d700 1 --2- 172.21.15.22:0/1769171355 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb3dc068130 0x7fb3dc066c70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:58.810 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.800+0000 7fb3e419d700 1 --2- 172.21.15.22:0/1769171355 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb3dc068d00 0x7fb3dc061f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:58.811 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.800+0000 7fb3e419d700 1 -- 172.21.15.22:0/1769171355 >> 172.21.15.22:0/1769171355 conn(0x7fb3dc0ae9d0 msgr2=0x7fb3dc0aede0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:58.811 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.800+0000 7fb3e419d700 1 -- 172.21.15.22:0/1769171355 shutdown_connections 2022-04-28T14:41:58.811 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.800+0000 7fb3e419d700 1 -- 172.21.15.22:0/1769171355 wait complete. 2022-04-28T14:41:58.811 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.801+0000 7fb3e419d700 1 Processor -- start 2022-04-28T14:41:58.811 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.801+0000 7fb3e419d700 1 -- start start 2022-04-28T14:41:58.811 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.801+0000 7fb3e419d700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb3dc062420 0x7fb3dc095170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:58.811 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.801+0000 7fb3e419d700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb3dc068130 0x7fb3dc0961b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:58.811 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.801+0000 7fb3e419d700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb3dc068d00 0x7fb3dc0a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:58.811 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.801+0000 7fb3e419d700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc13b8c0 con 0x7fb3dc062420 2022-04-28T14:41:58.812 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.801+0000 7fb3e419d700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc097a40 con 0x7fb3dc068130 2022-04-28T14:41:58.812 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.801+0000 7fb3e419d700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc096b10 con 0x7fb3dc068d00 2022-04-28T14:41:58.812 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.801+0000 7fb3e1738700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb3dc068130 0x7fb3dc0961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:58.812 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.801+0000 7fb3e1f39700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb3dc062420 0x7fb3dc095170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:58.812 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.801+0000 7fb3e273a700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb3dc068d00 0x7fb3dc0a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:58.812 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.801+0000 7fb3e1738700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb3dc068130 0x7fb3dc0961b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48910/0 (socket says 172.21.15.22:48910) 2022-04-28T14:41:58.812 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.801+0000 7fb3e1738700 1 -- 172.21.15.22:0/2007836863 learned_addr learned my addr 172.21.15.22:0/2007836863 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:58.812 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.802+0000 7fb3e1738700 1 -- 172.21.15.22:0/2007836863 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb3dc068d00 msgr2=0x7fb3dc0a6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:58.812 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.802+0000 7fb3e1738700 1 --2- 172.21.15.22:0/2007836863 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb3dc068d00 0x7fb3dc0a6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:58.812 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.802+0000 7fb3e1738700 1 -- 172.21.15.22:0/2007836863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb3dc062420 msgr2=0x7fb3dc095170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:58.813 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.802+0000 7fb3e1738700 1 --2- 172.21.15.22:0/2007836863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb3dc062420 0x7fb3dc095170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:58.813 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.802+0000 7fb3e1738700 1 -- 172.21.15.22:0/2007836863 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d4009ae0 con 0x7fb3dc068130 2022-04-28T14:41:58.813 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.802+0000 7fb3e273a700 1 --2- 172.21.15.22:0/2007836863 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb3dc068d00 0x7fb3dc0a6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:58.813 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.802+0000 7fb3e1738700 1 --2- 172.21.15.22:0/2007836863 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb3dc068130 0x7fb3dc0961b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fb3d800e950 tx=0x7fb3d8009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:58.813 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.802+0000 7fb3c9ffb700 1 -- 172.21.15.22:0/2007836863 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8012600 con 0x7fb3dc068130 2022-04-28T14:41:58.813 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.802+0000 7fb3c9ffb700 1 -- 172.21.15.22:0/2007836863 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d8012760 con 0x7fb3dc068130 2022-04-28T14:41:58.813 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.802+0000 7fb3e419d700 1 -- 172.21.15.22:0/2007836863 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3cc0092a0 con 0x7fb3dc068130 2022-04-28T14:41:58.813 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.802+0000 7fb3c9ffb700 1 -- 172.21.15.22:0/2007836863 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8012ae0 con 0x7fb3dc068130 2022-04-28T14:41:58.813 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.802+0000 7fb3e419d700 1 -- 172.21.15.22:0/2007836863 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3dc0967b0 con 0x7fb3dc068130 2022-04-28T14:41:58.814 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.803+0000 7fb3e419d700 1 -- 172.21.15.22:0/2007836863 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3dc094e80 con 0x7fb3dc068130 2022-04-28T14:41:58.814 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.803+0000 7fb3c9ffb700 1 -- 172.21.15.22:0/2007836863 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7fb3d8022070 con 0x7fb3dc068130 2022-04-28T14:41:58.814 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.803+0000 7fb3c9ffb700 1 -- 172.21.15.22:0/2007836863 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7fb3d8055910 con 0x7fb3dc068130 2022-04-28T14:41:58.815 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.807+0000 7fb3c9ffb700 1 -- 172.21.15.22:0/2007836863 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7fb3d8035ef0 con 0x7fb3dc068130 2022-04-28T14:41:58.951 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.946+0000 7fb3e419d700 1 -- 172.21.15.22:0/2007836863 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb3dc046540 con 0x7fb3dc068130 2022-04-28T14:41:58.951 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.946+0000 7fb3c9ffb700 1 -- 172.21.15.22:0/2007836863 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb3d8016030 con 0x7fb3dc068130 2022-04-28T14:41:58.951 INFO:teuthology.orchestra.run.smithi022.stdout:124554051588 2022-04-28T14:41:58.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.948+0000 7fb3e419d700 1 -- 172.21.15.22:0/2007836863 >> v1:172.21.15.22:6808/92758 conn(0x7fb3bc041b30 legacy=0x7fb3bc043ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:58.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.948+0000 7fb3e419d700 1 -- 172.21.15.22:0/2007836863 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb3dc068130 msgr2=0x7fb3dc0961b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:58.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.948+0000 7fb3e419d700 1 --2- 172.21.15.22:0/2007836863 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb3dc068130 0x7fb3dc0961b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fb3d800e950 tx=0x7fb3d8009060).stop 2022-04-28T14:41:58.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.948+0000 7fb3e419d700 1 -- 172.21.15.22:0/2007836863 shutdown_connections 2022-04-28T14:41:58.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.948+0000 7fb3e419d700 1 --2- 172.21.15.22:0/2007836863 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fb3dc068d00 0x7fb3dc0a6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:58.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.948+0000 7fb3e419d700 1 --2- 172.21.15.22:0/2007836863 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb3dc062420 0x7fb3dc095170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:58.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.948+0000 7fb3e419d700 1 --2- 172.21.15.22:0/2007836863 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fb3dc068130 0x7fb3dc0961b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:58.953 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.948+0000 7fb3e419d700 1 -- 172.21.15.22:0/2007836863 >> 172.21.15.22:0/2007836863 conn(0x7fb3dc0ae9d0 msgr2=0x7fb3dc0ab860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:58.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.948+0000 7fb3e419d700 1 -- 172.21.15.22:0/2007836863 shutdown_connections 2022-04-28T14:41:58.954 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:58.948+0000 7fb3e419d700 1 -- 172.21.15.22:0/2007836863 wait complete. 2022-04-28T14:41:58.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051588 for osd.2 2022-04-28T14:41:58.965 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2022-04-28T14:41:59.084 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.079+0000 7f8c03dd7700 1 Processor -- start 2022-04-28T14:41:59.084 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.079+0000 7f8c03dd7700 1 -- start start 2022-04-28T14:41:59.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.080+0000 7f8c03dd7700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8bfc13b850 0x7f8bfc138920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:59.089 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.080+0000 7f8c03dd7700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8bfc0681c0 0x7f8bfc138e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:59.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.080+0000 7f8c03dd7700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bfc0a7930 con 0x7f8bfc064530 2022-04-28T14:41:59.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.080+0000 7f8c03dd7700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bfc064910 con 0x7f8bfc13b850 2022-04-28T14:41:59.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.080+0000 7f8c03dd7700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc138410 con 0x7f8bfc0681c0 2022-04-28T14:41:59.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.080+0000 7f8c01372700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8bfc13b850 0x7f8bfc138920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:59.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.080+0000 7f8c02374700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8bfc0681c0 0x7f8bfc138e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:59.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.080+0000 7f8c01b73700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f8bfc064530 0x7f8bfc13bf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40744/0 (socket says 172.21.15.22:40744) 2022-04-28T14:41:59.090 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.080+0000 7f8c01b73700 1 -- 172.21.15.22:0/1184745049 learned_addr learned my addr 172.21.15.22:0/1184745049 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:41:59.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.080+0000 7f8c02374700 1 -- 172.21.15.22:0/1184745049 >> v2:172.21.15.22:3300/0 conn(0x7f8bfc13b850 msgr2=0x7f8bfc138920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:59.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.080+0000 7f8c02374700 1 --2- 172.21.15.22:0/1184745049 >> v2:172.21.15.22:3300/0 conn(0x7f8bfc13b850 0x7f8bfc138920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:59.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.080+0000 7f8c02374700 1 -- 172.21.15.22:0/1184745049 >> v1:172.21.15.22:6789/0 conn(0x7f8bfc064530 legacy=0x7f8bfc13bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:59.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.080+0000 7f8c00b71700 1 -- 172.21.15.22:0/1184745049 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1587571839 0 0) 0x7f8bfc0a7930 con 0x7f8bfc064530 2022-04-28T14:41:59.091 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.080+0000 7f8c02374700 1 -- 172.21.15.22:0/1184745049 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc138670 con 0x7f8bfc0681c0 2022-04-28T14:41:59.092 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.080+0000 7f8c01372700 1 --2- 172.21.15.22:0/1184745049 >> v2:172.21.15.22:3300/0 conn(0x7f8bfc13b850 0x7f8bfc138920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:59.092 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.081+0000 7f8c02374700 1 --2- 172.21.15.22:0/1184745049 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8bfc0681c0 0x7f8bfc138e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f8bf4009e60 tx=0x7f8bf4009780).ready entity=mon.1 client_cookie=3469e0c654a145f1 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:59.092 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.081+0000 7f8c00b71700 1 -- 172.21.15.22:0/1184745049 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf400e070 con 0x7f8bfc0681c0 2022-04-28T14:41:59.092 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.081+0000 7f8c00b71700 1 -- 172.21.15.22:0/1184745049 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf400bb60 con 0x7f8bfc0681c0 2022-04-28T14:41:59.092 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.081+0000 7f8c00b71700 1 -- 172.21.15.22:0/1184745049 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4012410 con 0x7f8bfc0681c0 2022-04-28T14:41:59.092 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.081+0000 7f8c03dd7700 1 -- 172.21.15.22:0/1184745049 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8bfc0681c0 msgr2=0x7f8bfc138e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:59.092 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.081+0000 7f8c03dd7700 1 --2- 172.21.15.22:0/1184745049 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8bfc0681c0 0x7f8bfc138e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f8bf4009e60 tx=0x7f8bf4009780).stop 2022-04-28T14:41:59.093 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.081+0000 7f8c03dd7700 1 -- 172.21.15.22:0/1184745049 shutdown_connections 2022-04-28T14:41:59.093 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.081+0000 7f8c03dd7700 1 --2- 172.21.15.22:0/1184745049 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8bfc0681c0 0x7f8bfc138e10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:59.093 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.081+0000 7f8c03dd7700 1 --2- 172.21.15.22:0/1184745049 >> v2:172.21.15.22:3300/0 conn(0x7f8bfc13b850 0x7f8bfc138920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:59.093 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.081+0000 7f8c03dd7700 1 -- 172.21.15.22:0/1184745049 >> 172.21.15.22:0/1184745049 conn(0x7f8bfc067070 msgr2=0x7f8bfc063c60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:59.094 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.081+0000 7f8c03dd7700 1 -- 172.21.15.22:0/1184745049 shutdown_connections 2022-04-28T14:41:59.094 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.081+0000 7f8c03dd7700 1 -- 172.21.15.22:0/1184745049 wait complete. 2022-04-28T14:41:59.094 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.082+0000 7f8c03dd7700 1 Processor -- start 2022-04-28T14:41:59.094 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.082+0000 7f8c03dd7700 1 -- start start 2022-04-28T14:41:59.094 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.083+0000 7f8c03dd7700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8bfc064530 0x7f8bfc0a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:59.095 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.083+0000 7f8c03dd7700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bfc0681c0 0x7f8bfc09f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:59.095 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.083+0000 7f8c03dd7700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8bfc13b850 0x7f8bfc14b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:59.095 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.083+0000 7f8c03dd7700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc0a05c0 con 0x7f8bfc0681c0 2022-04-28T14:41:59.095 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.083+0000 7f8c03dd7700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc0a2e10 con 0x7f8bfc064530 2022-04-28T14:41:59.096 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.083+0000 7f8c03dd7700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc0a1f00 con 0x7f8bfc13b850 2022-04-28T14:41:59.096 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.083+0000 7f8c01372700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bfc0681c0 0x7f8bfc09f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:59.096 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.083+0000 7f8c02374700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8bfc13b850 0x7f8bfc14b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:59.096 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.083+0000 7f8c01372700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bfc0681c0 0x7f8bfc09f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51356/0 (socket says 172.21.15.22:51356) 2022-04-28T14:41:59.096 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.083+0000 7f8c02374700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8bfc13b850 0x7f8bfc14b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48710/0 (socket says 172.21.15.22:48710) 2022-04-28T14:41:59.096 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.083+0000 7f8c01372700 1 -- 172.21.15.22:0/288913005 learned_addr learned my addr 172.21.15.22:0/288913005 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:59.096 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.083+0000 7f8c01b73700 1 --2- 172.21.15.22:0/288913005 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8bfc064530 0x7f8bfc0a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:59.096 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.083+0000 7f8c01372700 1 -- 172.21.15.22:0/288913005 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8bfc13b850 msgr2=0x7f8bfc14b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:59.097 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.083+0000 7f8c01372700 1 --2- 172.21.15.22:0/288913005 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8bfc13b850 0x7f8bfc14b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:59.097 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.083+0000 7f8c01372700 1 -- 172.21.15.22:0/288913005 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8bfc064530 msgr2=0x7f8bfc0a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:59.097 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.083+0000 7f8c01372700 1 --2- 172.21.15.22:0/288913005 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8bfc064530 0x7f8bfc0a1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:59.097 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.083+0000 7f8c01372700 1 -- 172.21.15.22:0/288913005 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf00092a0 con 0x7f8bfc0681c0 2022-04-28T14:41:59.097 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.083+0000 7f8c02374700 1 --2- 172.21.15.22:0/288913005 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8bfc13b850 0x7f8bfc14b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:59.098 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.083+0000 7f8c01b73700 1 --2- 172.21.15.22:0/288913005 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8bfc064530 0x7f8bfc0a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:59.098 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.083+0000 7f8c01372700 1 --2- 172.21.15.22:0/288913005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bfc0681c0 0x7f8bfc09f510 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f8bf000e930 tx=0x7f8bf0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:59.098 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.084+0000 7f8bedffb700 1 -- 172.21.15.22:0/288913005 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0012600 con 0x7f8bfc0681c0 2022-04-28T14:41:59.098 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.084+0000 7f8bedffb700 1 -- 172.21.15.22:0/288913005 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf0012760 con 0x7f8bfc0681c0 2022-04-28T14:41:59.098 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.084+0000 7f8bedffb700 1 -- 172.21.15.22:0/288913005 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0012ae0 con 0x7f8bfc0681c0 2022-04-28T14:41:59.098 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.084+0000 7f8c03dd7700 1 -- 172.21.15.22:0/288913005 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf4009a20 con 0x7f8bfc0681c0 2022-04-28T14:41:59.098 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.084+0000 7f8c03dd7700 1 -- 172.21.15.22:0/288913005 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bfc0a4de0 con 0x7f8bfc0681c0 2022-04-28T14:41:59.098 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.085+0000 7f8bedffb700 1 -- 172.21.15.22:0/288913005 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f8bf0022070 con 0x7f8bfc0681c0 2022-04-28T14:41:59.099 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.085+0000 7f8c03dd7700 1 -- 172.21.15.22:0/288913005 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bfc0a0710 con 0x7f8bfc0681c0 2022-04-28T14:41:59.099 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.085+0000 7f8bedffb700 1 -- 172.21.15.22:0/288913005 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7f8bf0055700 con 0x7f8bfc0681c0 2022-04-28T14:41:59.099 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.088+0000 7f8bedffb700 1 -- 172.21.15.22:0/288913005 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f8bfc0a0710 con 0x7f8bfc0681c0 2022-04-28T14:41:59.234 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.229+0000 7f8c03dd7700 1 -- 172.21.15.22:0/288913005 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8bfc0a0710 con 0x7f8bfc0681c0 2022-04-28T14:41:59.234 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.229+0000 7f8bedffb700 1 -- 172.21.15.22:0/288913005 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8bfc0a0710 con 0x7f8bfc0681c0 2022-04-28T14:41:59.234 INFO:teuthology.orchestra.run.smithi022.stdout:128849018884 2022-04-28T14:41:59.235 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.230+0000 7f8c03dd7700 1 -- 172.21.15.22:0/288913005 >> v1:172.21.15.22:6808/92758 conn(0x7f8bdc041b30 legacy=0x7f8bdc043ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:59.235 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.230+0000 7f8c03dd7700 1 -- 172.21.15.22:0/288913005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bfc0681c0 msgr2=0x7f8bfc09f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:59.236 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.230+0000 7f8c03dd7700 1 --2- 172.21.15.22:0/288913005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bfc0681c0 0x7f8bfc09f510 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f8bf000e930 tx=0x7f8bf0009060).stop 2022-04-28T14:41:59.236 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.231+0000 7f8c03dd7700 1 -- 172.21.15.22:0/288913005 shutdown_connections 2022-04-28T14:41:59.236 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.231+0000 7f8c03dd7700 1 --2- 172.21.15.22:0/288913005 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f8bfc13b850 0x7f8bfc14b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:59.236 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.231+0000 7f8c03dd7700 1 --2- 172.21.15.22:0/288913005 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f8bfc064530 0x7f8bfc0a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:59.236 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.231+0000 7f8c03dd7700 1 --2- 172.21.15.22:0/288913005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8bfc0681c0 0x7f8bfc09f510 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:59.236 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.231+0000 7f8c03dd7700 1 -- 172.21.15.22:0/288913005 >> 172.21.15.22:0/288913005 conn(0x7f8bfc067070 msgr2=0x7f8bfc138890 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:59.236 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.231+0000 7f8c03dd7700 1 -- 172.21.15.22:0/288913005 shutdown_connections 2022-04-28T14:41:59.236 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.231+0000 7f8c03dd7700 1 -- 172.21.15.22:0/288913005 wait complete. 2022-04-28T14:41:59.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018884 for osd.3 2022-04-28T14:41:59.247 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2022-04-28T14:41:59.247 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-04-28T14:41:59.365 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.360+0000 7ff2f1b71700 1 Processor -- start 2022-04-28T14:41:59.365 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.360+0000 7ff2f1b71700 1 -- start start 2022-04-28T14:41:59.373 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.361+0000 7ff2f1b71700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff2ec063e20 0x7ff2ec09cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:59.373 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.361+0000 7ff2f1b71700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff2ec099600 0x7ff2ec09b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:59.373 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.361+0000 7ff2f1b71700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff2ec098180 0x7ff2ec098630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:59.373 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.361+0000 7ff2f1b71700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2ec0639d0 con 0x7ff2ec098180 2022-04-28T14:41:59.373 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.361+0000 7ff2f1b71700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec099d00 con 0x7ff2ec063e20 2022-04-28T14:41:59.373 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.361+0000 7ff2f1b71700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec064200 con 0x7ff2ec099600 2022-04-28T14:41:59.373 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.361+0000 7ff2eb7fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff2ec063e20 0x7ff2ec09cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:59.373 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.361+0000 7ff2eaffd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff2ec099600 0x7ff2ec09b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:59.373 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.361+0000 7ff2ebfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff2ec098180 0x7ff2ec098630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:59.374 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.361+0000 7ff2eaffd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff2ec099600 0x7ff2ec09b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48716/0 (socket says 172.21.15.22:48716) 2022-04-28T14:41:59.374 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.361+0000 7ff2ebfff700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff2ec098180 0x7ff2ec098630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51366/0 (socket says 172.21.15.22:51366) 2022-04-28T14:41:59.374 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.361+0000 7ff2eb7fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff2ec063e20 0x7ff2ec09cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48930/0 (socket says 172.21.15.22:48930) 2022-04-28T14:41:59.374 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.361+0000 7ff2eaffd700 1 -- 172.21.15.22:0/3802510449 learned_addr learned my addr 172.21.15.22:0/3802510449 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:59.374 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.361+0000 7ff2eaffd700 1 -- 172.21.15.22:0/3802510449 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff2ec063e20 msgr2=0x7ff2ec09cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:59.374 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.361+0000 7ff2eaffd700 1 --2- 172.21.15.22:0/3802510449 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff2ec063e20 0x7ff2ec09cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:59.374 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.361+0000 7ff2eaffd700 1 -- 172.21.15.22:0/3802510449 >> v2:172.21.15.22:3300/0 conn(0x7ff2ec098180 msgr2=0x7ff2ec098630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:59.374 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.361+0000 7ff2eaffd700 1 --2- 172.21.15.22:0/3802510449 >> v2:172.21.15.22:3300/0 conn(0x7ff2ec098180 0x7ff2ec098630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:59.374 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.361+0000 7ff2eaffd700 1 -- 172.21.15.22:0/3802510449 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec09b9c0 con 0x7ff2ec099600 2022-04-28T14:41:59.375 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.362+0000 7ff2eb7fe700 1 --2- 172.21.15.22:0/3802510449 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff2ec063e20 0x7ff2ec09cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:59.375 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.362+0000 7ff2ebfff700 1 --2- 172.21.15.22:0/3802510449 >> v2:172.21.15.22:3300/0 conn(0x7ff2ec098180 0x7ff2ec098630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:59.375 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.362+0000 7ff2eaffd700 1 --2- 172.21.15.22:0/3802510449 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff2ec099600 0x7ff2ec09b4d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7ff2d4006fd0 tx=0x7ff2d40090f0).ready entity=mon.2 client_cookie=d62b9c4f399b49a8 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:59.375 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.362+0000 7ff2ea7fc700 1 -- 172.21.15.22:0/3802510449 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d400b530 con 0x7ff2ec099600 2022-04-28T14:41:59.375 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.362+0000 7ff2ea7fc700 1 -- 172.21.15.22:0/3802510449 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d400b690 con 0x7ff2ec099600 2022-04-28T14:41:59.375 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.362+0000 7ff2ea7fc700 1 -- 172.21.15.22:0/3802510449 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d400ba10 con 0x7ff2ec099600 2022-04-28T14:41:59.375 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.362+0000 7ff2f1b71700 1 -- 172.21.15.22:0/3802510449 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff2ec099600 msgr2=0x7ff2ec09b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:59.375 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.362+0000 7ff2f1b71700 1 --2- 172.21.15.22:0/3802510449 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff2ec099600 0x7ff2ec09b4d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7ff2d4006fd0 tx=0x7ff2d40090f0).stop 2022-04-28T14:41:59.375 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.362+0000 7ff2f1b71700 1 -- 172.21.15.22:0/3802510449 shutdown_connections 2022-04-28T14:41:59.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.362+0000 7ff2f1b71700 1 --2- 172.21.15.22:0/3802510449 >> v2:172.21.15.22:3300/0 conn(0x7ff2ec098180 0x7ff2ec098630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:59.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.362+0000 7ff2f1b71700 1 --2- 172.21.15.22:0/3802510449 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff2ec063e20 0x7ff2ec09cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:59.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.362+0000 7ff2f1b71700 1 --2- 172.21.15.22:0/3802510449 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff2ec099600 0x7ff2ec09b4d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:59.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.362+0000 7ff2f1b71700 1 -- 172.21.15.22:0/3802510449 >> 172.21.15.22:0/3802510449 conn(0x7ff2ec0aaf80 msgr2=0x7ff2ec0ab390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:59.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.362+0000 7ff2f1b71700 1 -- 172.21.15.22:0/3802510449 shutdown_connections 2022-04-28T14:41:59.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.362+0000 7ff2f1b71700 1 -- 172.21.15.22:0/3802510449 wait complete. 2022-04-28T14:41:59.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.363+0000 7ff2f1b71700 1 Processor -- start 2022-04-28T14:41:59.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.364+0000 7ff2f1b71700 1 -- start start 2022-04-28T14:41:59.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.364+0000 7ff2f1b71700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff2ec063e20 0x7ff2ec0a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:59.376 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.364+0000 7ff2f1b71700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff2ec098180 0x7ff2ec148150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:59.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.364+0000 7ff2f1b71700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ec099600 0x7ff2ec0a1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:59.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.364+0000 7ff2f1b71700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec0a0420 con 0x7ff2ec099600 2022-04-28T14:41:59.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.364+0000 7ff2f1b71700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec09f3a0 con 0x7ff2ec063e20 2022-04-28T14:41:59.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.364+0000 7ff2f1b71700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec148770 con 0x7ff2ec098180 2022-04-28T14:41:59.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.364+0000 7ff2eb7fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff2ec063e20 0x7ff2ec0a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:59.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.364+0000 7ff2ebfff700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ec099600 0x7ff2ec0a1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:59.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.364+0000 7ff2eaffd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff2ec098180 0x7ff2ec148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:59.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.364+0000 7ff2eb7fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff2ec063e20 0x7ff2ec0a08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48936/0 (socket says 172.21.15.22:48936) 2022-04-28T14:41:59.377 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.364+0000 7ff2eb7fe700 1 -- 172.21.15.22:0/4175146676 learned_addr learned my addr 172.21.15.22:0/4175146676 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:59.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.364+0000 7ff2ebfff700 1 -- 172.21.15.22:0/4175146676 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff2ec098180 msgr2=0x7ff2ec148150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:59.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.364+0000 7ff2ebfff700 1 --2- 172.21.15.22:0/4175146676 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff2ec098180 0x7ff2ec148150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:59.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.364+0000 7ff2ebfff700 1 -- 172.21.15.22:0/4175146676 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff2ec063e20 msgr2=0x7ff2ec0a08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:59.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.364+0000 7ff2ebfff700 1 --2- 172.21.15.22:0/4175146676 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff2ec063e20 0x7ff2ec0a08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:59.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.364+0000 7ff2ebfff700 1 -- 172.21.15.22:0/4175146676 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc0092a0 con 0x7ff2ec099600 2022-04-28T14:41:59.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.364+0000 7ff2eb7fe700 1 --2- 172.21.15.22:0/4175146676 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff2ec063e20 0x7ff2ec0a08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:59.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.365+0000 7ff2ebfff700 1 --2- 172.21.15.22:0/4175146676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ec099600 0x7ff2ec0a1950 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7ff2e4009f10 tx=0x7ff2e400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:59.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.365+0000 7ff2e37fe700 1 -- 172.21.15.22:0/4175146676 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e400cb70 con 0x7ff2ec099600 2022-04-28T14:41:59.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.365+0000 7ff2e37fe700 1 -- 172.21.15.22:0/4175146676 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e400f040 con 0x7ff2ec099600 2022-04-28T14:41:59.378 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.365+0000 7ff2f1b71700 1 -- 172.21.15.22:0/4175146676 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e4009a20 con 0x7ff2ec099600 2022-04-28T14:41:59.379 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.365+0000 7ff2e37fe700 1 -- 172.21.15.22:0/4175146676 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4013400 con 0x7ff2ec099600 2022-04-28T14:41:59.379 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.365+0000 7ff2f1b71700 1 -- 172.21.15.22:0/4175146676 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d4009370 con 0x7ff2ec099600 2022-04-28T14:41:59.379 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.366+0000 7ff2e37fe700 1 -- 172.21.15.22:0/4175146676 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7ff2e40137f0 con 0x7ff2ec099600 2022-04-28T14:41:59.379 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.366+0000 7ff2f1b71700 1 -- 172.21.15.22:0/4175146676 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2ec0a0590 con 0x7ff2ec099600 2022-04-28T14:41:59.379 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.366+0000 7ff2e37fe700 1 -- 172.21.15.22:0/4175146676 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7ff2e4055e40 con 0x7ff2ec099600 2022-04-28T14:41:59.379 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.369+0000 7ff2e37fe700 1 -- 172.21.15.22:0/4175146676 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7ff2e4036420 con 0x7ff2ec099600 2022-04-28T14:41:59.509 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.505+0000 7ff2f1b71700 1 -- 172.21.15.22:0/4175146676 --> v1:172.21.15.22:6808/92758 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff2ec066da0 con 0x7ff2d0041b00 2022-04-28T14:41:59.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.513+0000 7ff2e37fe700 1 -- 172.21.15.22:0/4175146676 <== mgr.14100 v1:172.21.15.22:6808/92758 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+321090 (unknown 2965378022 0 1198718481) 0x7ff2ec066da0 con 0x7ff2d0041b00 2022-04-28T14:41:59.522 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:41:59.525 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.516+0000 7ff2f1b71700 1 -- 172.21.15.22:0/4175146676 >> v1:172.21.15.22:6808/92758 conn(0x7ff2d0041b00 legacy=0x7ff2d0043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:59.525 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.516+0000 7ff2f1b71700 1 -- 172.21.15.22:0/4175146676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ec099600 msgr2=0x7ff2ec0a1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:59.525 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.516+0000 7ff2f1b71700 1 --2- 172.21.15.22:0/4175146676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ec099600 0x7ff2ec0a1950 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7ff2e4009f10 tx=0x7ff2e400b040).stop 2022-04-28T14:41:59.525 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.516+0000 7ff2f1b71700 1 -- 172.21.15.22:0/4175146676 shutdown_connections 2022-04-28T14:41:59.525 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.516+0000 7ff2f1b71700 1 --2- 172.21.15.22:0/4175146676 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff2ec099600 0x7ff2ec0a1950 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:59.526 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.516+0000 7ff2f1b71700 1 --2- 172.21.15.22:0/4175146676 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff2ec063e20 0x7ff2ec0a08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:59.526 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.516+0000 7ff2f1b71700 1 --2- 172.21.15.22:0/4175146676 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff2ec098180 0x7ff2ec148150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:59.526 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.516+0000 7ff2f1b71700 1 -- 172.21.15.22:0/4175146676 >> 172.21.15.22:0/4175146676 conn(0x7ff2ec0aaf80 msgr2=0x7ff2ec13c040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:59.526 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.516+0000 7ff2f1b71700 1 -- 172.21.15.22:0/4175146676 shutdown_connections 2022-04-28T14:41:59.526 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.516+0000 7ff2f1b71700 1 -- 172.21.15.22:0/4175146676 wait complete. 2022-04-28T14:41:59.526 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2022-04-28T14:41:59.533 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2022-04-28T14:41:59.148425+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8616,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":19,"num_read_kb":20,"num_write":116,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":106,"ondisk_log_size":106,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":22936,"kb_used_data":1400,"kb_used_omap":37,"kb_used_meta":21466,"kb_avail":377464424,"statfs":{"total":386547056640,"available":386523570176,"internally_reserved":0,"allocated":1433600,"data_stored":596184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37944,"internal_metadata":21982152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":272,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.196974"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959499+0000","last_change":"2022-04-28T14:41:44.934416+0000","last_active":"2022-04-28T14:41:52.959499+0000","last_peered":"2022-04-28T14:41:52.959499+0000","last_clean":"2022-04-28T14:41:52.959499+0000","last_became_active":"2022-04-28T14:41:44.934108+0000","last_became_peered":"2022-04-28T14:41:44.934108+0000","last_unstale":"2022-04-28T14:41:52.959499+0000","last_undegraded":"2022-04-28T14:41:52.959499+0000","last_fullsized":"2022-04-28T14:41:52.959499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"17'9","reported_seq":53,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959671+0000","last_change":"2022-04-28T14:41:45.931291+0000","last_active":"2022-04-28T14:41:52.959671+0000","last_peered":"2022-04-28T14:41:52.959671+0000","last_clean":"2022-04-28T14:41:52.959671+0000","last_became_active":"2022-04-28T14:41:45.930533+0000","last_became_peered":"2022-04-28T14:41:45.930533+0000","last_unstale":"2022-04-28T14:41:52.959671+0000","last_undegraded":"2022-04-28T14:41:52.959671+0000","last_fullsized":"2022-04-28T14:41:52.959671+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2190,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.962956+0000","last_change":"2022-04-28T14:41:45.927790+0000","last_active":"2022-04-28T14:41:52.962956+0000","last_peered":"2022-04-28T14:41:52.962956+0000","last_clean":"2022-04-28T14:41:52.962956+0000","last_became_active":"2022-04-28T14:41:45.926775+0000","last_became_peered":"2022-04-28T14:41:45.926775+0000","last_unstale":"2022-04-28T14:41:52.962956+0000","last_undegraded":"2022-04-28T14:41:52.962956+0000","last_fullsized":"2022-04-28T14:41:52.962956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960102+0000","last_change":"2022-04-28T14:41:45.919663+0000","last_active":"2022-04-28T14:41:52.960102+0000","last_peered":"2022-04-28T14:41:52.960102+0000","last_clean":"2022-04-28T14:41:52.960102+0000","last_became_active":"2022-04-28T14:41:45.919261+0000","last_became_peered":"2022-04-28T14:41:45.919261+0000","last_unstale":"2022-04-28T14:41:52.960102+0000","last_undegraded":"2022-04-28T14:41:52.960102+0000","last_fullsized":"2022-04-28T14:41:52.960102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959756+0000","last_change":"2022-04-28T14:41:45.927911+0000","last_active":"2022-04-28T14:41:52.959756+0000","last_peered":"2022-04-28T14:41:52.959756+0000","last_clean":"2022-04-28T14:41:52.959756+0000","last_became_active":"2022-04-28T14:41:45.927631+0000","last_became_peered":"2022-04-28T14:41:45.927631+0000","last_unstale":"2022-04-28T14:41:52.959756+0000","last_undegraded":"2022-04-28T14:41:52.959756+0000","last_fullsized":"2022-04-28T14:41:52.959756+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960428+0000","last_change":"2022-04-28T14:41:45.919167+0000","last_active":"2022-04-28T14:41:52.960428+0000","last_peered":"2022-04-28T14:41:52.960428+0000","last_clean":"2022-04-28T14:41:52.960428+0000","last_became_active":"2022-04-28T14:41:45.918846+0000","last_became_peered":"2022-04-28T14:41:45.918846+0000","last_unstale":"2022-04-28T14:41:52.960428+0000","last_undegraded":"2022-04-28T14:41:52.960428+0000","last_fullsized":"2022-04-28T14:41:52.960428+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.958967+0000","last_change":"2022-04-28T14:41:45.926475+0000","last_active":"2022-04-28T14:41:52.958967+0000","last_peered":"2022-04-28T14:41:52.958967+0000","last_clean":"2022-04-28T14:41:52.958967+0000","last_became_active":"2022-04-28T14:41:45.926034+0000","last_became_peered":"2022-04-28T14:41:45.926034+0000","last_unstale":"2022-04-28T14:41:52.958967+0000","last_undegraded":"2022-04-28T14:41:52.958967+0000","last_fullsized":"2022-04-28T14:41:52.958967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959786+0000","last_change":"2022-04-28T14:41:45.939303+0000","last_active":"2022-04-28T14:41:52.959786+0000","last_peered":"2022-04-28T14:41:52.959786+0000","last_clean":"2022-04-28T14:41:52.959786+0000","last_became_active":"2022-04-28T14:41:45.938732+0000","last_became_peered":"2022-04-28T14:41:45.938732+0000","last_unstale":"2022-04-28T14:41:52.959786+0000","last_undegraded":"2022-04-28T14:41:52.959786+0000","last_fullsized":"2022-04-28T14:41:52.959786+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.893351+0000","last_change":"2022-04-28T14:41:45.923129+0000","last_active":"2022-04-28T14:41:53.893351+0000","last_peered":"2022-04-28T14:41:53.893351+0000","last_clean":"2022-04-28T14:41:53.893351+0000","last_became_active":"2022-04-28T14:41:45.922124+0000","last_became_peered":"2022-04-28T14:41:45.922124+0000","last_unstale":"2022-04-28T14:41:53.893351+0000","last_undegraded":"2022-04-28T14:41:53.893351+0000","last_fullsized":"2022-04-28T14:41:53.893351+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"17'7","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961948+0000","last_change":"2022-04-28T14:41:44.933426+0000","last_active":"2022-04-28T14:41:52.961948+0000","last_peered":"2022-04-28T14:41:52.961948+0000","last_clean":"2022-04-28T14:41:52.961948+0000","last_became_active":"2022-04-28T14:41:44.930226+0000","last_became_peered":"2022-04-28T14:41:44.930226+0000","last_unstale":"2022-04-28T14:41:52.961948+0000","last_undegraded":"2022-04-28T14:41:52.961948+0000","last_fullsized":"2022-04-28T14:41:52.961948+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964982+0000","last_change":"2022-04-28T14:41:45.927393+0000","last_active":"2022-04-28T14:41:52.964982+0000","last_peered":"2022-04-28T14:41:52.964982+0000","last_clean":"2022-04-28T14:41:52.964982+0000","last_became_active":"2022-04-28T14:41:45.927113+0000","last_became_peered":"2022-04-28T14:41:45.927113+0000","last_unstale":"2022-04-28T14:41:52.964982+0000","last_undegraded":"2022-04-28T14:41:52.964982+0000","last_fullsized":"2022-04-28T14:41:52.964982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964390+0000","last_change":"2022-04-28T14:41:43.934513+0000","last_active":"2022-04-28T14:41:52.964390+0000","last_peered":"2022-04-28T14:41:52.964390+0000","last_clean":"2022-04-28T14:41:52.964390+0000","last_became_active":"2022-04-28T14:41:43.933829+0000","last_became_peered":"2022-04-28T14:41:43.933829+0000","last_unstale":"2022-04-28T14:41:52.964390+0000","last_undegraded":"2022-04-28T14:41:52.964390+0000","last_fullsized":"2022-04-28T14:41:52.964390+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960332+0000","last_change":"2022-04-28T14:41:45.929077+0000","last_active":"2022-04-28T14:41:52.960332+0000","last_peered":"2022-04-28T14:41:52.960332+0000","last_clean":"2022-04-28T14:41:52.960332+0000","last_became_active":"2022-04-28T14:41:45.928564+0000","last_became_peered":"2022-04-28T14:41:45.928564+0000","last_unstale":"2022-04-28T14:41:52.960332+0000","last_undegraded":"2022-04-28T14:41:52.960332+0000","last_fullsized":"2022-04-28T14:41:52.960332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"16'4","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961213+0000","last_change":"2022-04-28T14:41:45.935835+0000","last_active":"2022-04-28T14:41:52.961213+0000","last_peered":"2022-04-28T14:41:52.961213+0000","last_clean":"2022-04-28T14:41:52.961213+0000","last_became_active":"2022-04-28T14:41:45.935207+0000","last_became_peered":"2022-04-28T14:41:45.935207+0000","last_unstale":"2022-04-28T14:41:52.961213+0000","last_undegraded":"2022-04-28T14:41:52.961213+0000","last_fullsized":"2022-04-28T14:41:52.961213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964524+0000","last_change":"2022-04-28T14:41:45.921280+0000","last_active":"2022-04-28T14:41:52.964524+0000","last_peered":"2022-04-28T14:41:52.964524+0000","last_clean":"2022-04-28T14:41:52.964524+0000","last_became_active":"2022-04-28T14:41:45.920652+0000","last_became_peered":"2022-04-28T14:41:45.920652+0000","last_unstale":"2022-04-28T14:41:52.964524+0000","last_undegraded":"2022-04-28T14:41:52.964524+0000","last_fullsized":"2022-04-28T14:41:52.964524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"36'5","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.892966+0000","last_change":"2022-04-28T14:41:45.914460+0000","last_active":"2022-04-28T14:41:53.892966+0000","last_peered":"2022-04-28T14:41:53.892966+0000","last_clean":"2022-04-28T14:41:53.892966+0000","last_became_active":"2022-04-28T14:41:45.914150+0000","last_became_peered":"2022-04-28T14:41:45.914150+0000","last_unstale":"2022-04-28T14:41:53.892966+0000","last_undegraded":"2022-04-28T14:41:53.892966+0000","last_fullsized":"2022-04-28T14:41:53.892966+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.963025+0000","last_change":"2022-04-28T14:41:45.927213+0000","last_active":"2022-04-28T14:41:52.963025+0000","last_peered":"2022-04-28T14:41:52.963025+0000","last_clean":"2022-04-28T14:41:52.963025+0000","last_became_active":"2022-04-28T14:41:45.926934+0000","last_became_peered":"2022-04-28T14:41:45.926934+0000","last_unstale":"2022-04-28T14:41:52.963025+0000","last_undegraded":"2022-04-28T14:41:52.963025+0000","last_fullsized":"2022-04-28T14:41:52.963025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'3","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.963214+0000","last_change":"2022-04-28T14:41:45.928157+0000","last_active":"2022-04-28T14:41:52.963214+0000","last_peered":"2022-04-28T14:41:52.963214+0000","last_clean":"2022-04-28T14:41:52.963214+0000","last_became_active":"2022-04-28T14:41:45.927485+0000","last_became_peered":"2022-04-28T14:41:45.927485+0000","last_unstale":"2022-04-28T14:41:52.963214+0000","last_undegraded":"2022-04-28T14:41:52.963214+0000","last_fullsized":"2022-04-28T14:41:52.963214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960158+0000","last_change":"2022-04-28T14:41:45.931460+0000","last_active":"2022-04-28T14:41:52.960158+0000","last_peered":"2022-04-28T14:41:52.960158+0000","last_clean":"2022-04-28T14:41:52.960158+0000","last_became_active":"2022-04-28T14:41:45.930955+0000","last_became_peered":"2022-04-28T14:41:45.930955+0000","last_unstale":"2022-04-28T14:41:52.960158+0000","last_undegraded":"2022-04-28T14:41:52.960158+0000","last_fullsized":"2022-04-28T14:41:52.960158+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"16'3","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960438+0000","last_change":"2022-04-28T14:41:45.924773+0000","last_active":"2022-04-28T14:41:52.960438+0000","last_peered":"2022-04-28T14:41:52.960438+0000","last_clean":"2022-04-28T14:41:52.960438+0000","last_became_active":"2022-04-28T14:41:45.924504+0000","last_became_peered":"2022-04-28T14:41:45.924504+0000","last_unstale":"2022-04-28T14:41:52.960438+0000","last_undegraded":"2022-04-28T14:41:52.960438+0000","last_fullsized":"2022-04-28T14:41:52.960438+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.958963+0000","last_change":"2022-04-28T14:41:43.929322+0000","last_active":"2022-04-28T14:41:52.958963+0000","last_peered":"2022-04-28T14:41:52.958963+0000","last_clean":"2022-04-28T14:41:52.958963+0000","last_became_active":"2022-04-28T14:41:43.929096+0000","last_became_peered":"2022-04-28T14:41:43.929096+0000","last_unstale":"2022-04-28T14:41:52.958963+0000","last_undegraded":"2022-04-28T14:41:52.958963+0000","last_fullsized":"2022-04-28T14:41:52.958963+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.963166+0000","last_change":"2022-04-28T14:41:45.920916+0000","last_active":"2022-04-28T14:41:52.963166+0000","last_peered":"2022-04-28T14:41:52.963166+0000","last_clean":"2022-04-28T14:41:52.963166+0000","last_became_active":"2022-04-28T14:41:45.920621+0000","last_became_peered":"2022-04-28T14:41:45.920621+0000","last_unstale":"2022-04-28T14:41:52.963166+0000","last_undegraded":"2022-04-28T14:41:52.963166+0000","last_fullsized":"2022-04-28T14:41:52.963166+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959433+0000","last_change":"2022-04-28T14:41:45.925058+0000","last_active":"2022-04-28T14:41:52.959433+0000","last_peered":"2022-04-28T14:41:52.959433+0000","last_clean":"2022-04-28T14:41:52.959433+0000","last_became_active":"2022-04-28T14:41:45.924431+0000","last_became_peered":"2022-04-28T14:41:45.924431+0000","last_unstale":"2022-04-28T14:41:52.959433+0000","last_undegraded":"2022-04-28T14:41:52.959433+0000","last_fullsized":"2022-04-28T14:41:52.959433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.892330+0000","last_change":"2022-04-28T14:41:44.931965+0000","last_active":"2022-04-28T14:41:53.892330+0000","last_peered":"2022-04-28T14:41:53.892330+0000","last_clean":"2022-04-28T14:41:53.892330+0000","last_became_active":"2022-04-28T14:41:44.931368+0000","last_became_peered":"2022-04-28T14:41:44.931368+0000","last_unstale":"2022-04-28T14:41:53.892330+0000","last_undegraded":"2022-04-28T14:41:53.892330+0000","last_fullsized":"2022-04-28T14:41:53.892330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.893268+0000","last_change":"2022-04-28T14:41:44.948003+0000","last_active":"2022-04-28T14:41:53.893268+0000","last_peered":"2022-04-28T14:41:53.893268+0000","last_clean":"2022-04-28T14:41:53.893268+0000","last_became_active":"2022-04-28T14:41:44.939336+0000","last_became_peered":"2022-04-28T14:41:44.939336+0000","last_unstale":"2022-04-28T14:41:53.893268+0000","last_undegraded":"2022-04-28T14:41:53.893268+0000","last_fullsized":"2022-04-28T14:41:53.893268+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964488+0000","last_change":"2022-04-28T14:41:43.935719+0000","last_active":"2022-04-28T14:41:52.964488+0000","last_peered":"2022-04-28T14:41:52.964488+0000","last_clean":"2022-04-28T14:41:52.964488+0000","last_became_active":"2022-04-28T14:41:43.934180+0000","last_became_peered":"2022-04-28T14:41:43.934180+0000","last_unstale":"2022-04-28T14:41:52.964488+0000","last_undegraded":"2022-04-28T14:41:52.964488+0000","last_fullsized":"2022-04-28T14:41:52.964488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964798+0000","last_change":"2022-04-28T14:41:43.935879+0000","last_active":"2022-04-28T14:41:52.964798+0000","last_peered":"2022-04-28T14:41:52.964798+0000","last_clean":"2022-04-28T14:41:52.964798+0000","last_became_active":"2022-04-28T14:41:43.934746+0000","last_became_peered":"2022-04-28T14:41:43.934746+0000","last_unstale":"2022-04-28T14:41:52.964798+0000","last_undegraded":"2022-04-28T14:41:52.964798+0000","last_fullsized":"2022-04-28T14:41:52.964798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.893457+0000","last_change":"2022-04-28T14:41:45.923492+0000","last_active":"2022-04-28T14:41:53.893457+0000","last_peered":"2022-04-28T14:41:53.893457+0000","last_clean":"2022-04-28T14:41:53.893457+0000","last_became_active":"2022-04-28T14:41:45.922641+0000","last_became_peered":"2022-04-28T14:41:45.922641+0000","last_unstale":"2022-04-28T14:41:53.893457+0000","last_undegraded":"2022-04-28T14:41:53.893457+0000","last_fullsized":"2022-04-28T14:41:53.893457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.963408+0000","last_change":"2022-04-28T14:41:45.924090+0000","last_active":"2022-04-28T14:41:52.963408+0000","last_peered":"2022-04-28T14:41:52.963408+0000","last_clean":"2022-04-28T14:41:52.963408+0000","last_became_active":"2022-04-28T14:41:45.923798+0000","last_became_peered":"2022-04-28T14:41:45.923798+0000","last_unstale":"2022-04-28T14:41:52.963408+0000","last_undegraded":"2022-04-28T14:41:52.963408+0000","last_fullsized":"2022-04-28T14:41:52.963408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961392+0000","last_change":"2022-04-28T14:41:45.935788+0000","last_active":"2022-04-28T14:41:52.961392+0000","last_peered":"2022-04-28T14:41:52.961392+0000","last_clean":"2022-04-28T14:41:52.961392+0000","last_became_active":"2022-04-28T14:41:45.935188+0000","last_became_peered":"2022-04-28T14:41:45.935188+0000","last_unstale":"2022-04-28T14:41:52.961392+0000","last_undegraded":"2022-04-28T14:41:52.961392+0000","last_fullsized":"2022-04-28T14:41:52.961392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960380+0000","last_change":"2022-04-28T14:41:45.926324+0000","last_active":"2022-04-28T14:41:52.960380+0000","last_peered":"2022-04-28T14:41:52.960380+0000","last_clean":"2022-04-28T14:41:52.960380+0000","last_became_active":"2022-04-28T14:41:45.925869+0000","last_became_peered":"2022-04-28T14:41:45.925869+0000","last_unstale":"2022-04-28T14:41:52.960380+0000","last_undegraded":"2022-04-28T14:41:52.960380+0000","last_fullsized":"2022-04-28T14:41:52.960380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.893234+0000","last_change":"2022-04-28T14:41:44.947883+0000","last_active":"2022-04-28T14:41:53.893234+0000","last_peered":"2022-04-28T14:41:53.893234+0000","last_clean":"2022-04-28T14:41:53.893234+0000","last_became_active":"2022-04-28T14:41:44.939732+0000","last_became_peered":"2022-04-28T14:41:44.939732+0000","last_unstale":"2022-04-28T14:41:53.893234+0000","last_undegraded":"2022-04-28T14:41:53.893234+0000","last_fullsized":"2022-04-28T14:41:53.893234+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960653+0000","last_change":"2022-04-28T14:41:45.937304+0000","last_active":"2022-04-28T14:41:52.960653+0000","last_peered":"2022-04-28T14:41:52.960653+0000","last_clean":"2022-04-28T14:41:52.960653+0000","last_became_active":"2022-04-28T14:41:45.937008+0000","last_became_peered":"2022-04-28T14:41:45.937008+0000","last_unstale":"2022-04-28T14:41:52.960653+0000","last_undegraded":"2022-04-28T14:41:52.960653+0000","last_fullsized":"2022-04-28T14:41:52.960653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960239+0000","last_change":"2022-04-28T14:41:45.929284+0000","last_active":"2022-04-28T14:41:52.960239+0000","last_peered":"2022-04-28T14:41:52.960239+0000","last_clean":"2022-04-28T14:41:52.960239+0000","last_became_active":"2022-04-28T14:41:45.928853+0000","last_became_peered":"2022-04-28T14:41:45.928853+0000","last_unstale":"2022-04-28T14:41:52.960239+0000","last_undegraded":"2022-04-28T14:41:52.960239+0000","last_fullsized":"2022-04-28T14:41:52.960239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959811+0000","last_change":"2022-04-28T14:41:45.931460+0000","last_active":"2022-04-28T14:41:52.959811+0000","last_peered":"2022-04-28T14:41:52.959811+0000","last_clean":"2022-04-28T14:41:52.959811+0000","last_became_active":"2022-04-28T14:41:45.930906+0000","last_became_peered":"2022-04-28T14:41:45.930906+0000","last_unstale":"2022-04-28T14:41:52.959811+0000","last_undegraded":"2022-04-28T14:41:52.959811+0000","last_fullsized":"2022-04-28T14:41:52.959811+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959583+0000","last_change":"2022-04-28T14:41:45.936694+0000","last_active":"2022-04-28T14:41:52.959583+0000","last_peered":"2022-04-28T14:41:52.959583+0000","last_clean":"2022-04-28T14:41:52.959583+0000","last_became_active":"2022-04-28T14:41:45.936358+0000","last_became_peered":"2022-04-28T14:41:45.936358+0000","last_unstale":"2022-04-28T14:41:52.959583+0000","last_undegraded":"2022-04-28T14:41:52.959583+0000","last_fullsized":"2022-04-28T14:41:52.959583+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959193+0000","last_change":"2022-04-28T14:41:45.939118+0000","last_active":"2022-04-28T14:41:52.959193+0000","last_peered":"2022-04-28T14:41:52.959193+0000","last_clean":"2022-04-28T14:41:52.959193+0000","last_became_active":"2022-04-28T14:41:45.938026+0000","last_became_peered":"2022-04-28T14:41:45.938026+0000","last_unstale":"2022-04-28T14:41:52.959193+0000","last_undegraded":"2022-04-28T14:41:52.959193+0000","last_fullsized":"2022-04-28T14:41:52.959193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"16'3","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959193+0000","last_change":"2022-04-28T14:41:43.935902+0000","last_active":"2022-04-28T14:41:52.959193+0000","last_peered":"2022-04-28T14:41:52.959193+0000","last_clean":"2022-04-28T14:41:52.959193+0000","last_became_active":"2022-04-28T14:41:43.935543+0000","last_became_peered":"2022-04-28T14:41:43.935543+0000","last_unstale":"2022-04-28T14:41:52.959193+0000","last_undegraded":"2022-04-28T14:41:52.959193+0000","last_fullsized":"2022-04-28T14:41:52.959193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960317+0000","last_change":"2022-04-28T14:41:45.925021+0000","last_active":"2022-04-28T14:41:52.960317+0000","last_peered":"2022-04-28T14:41:52.960317+0000","last_clean":"2022-04-28T14:41:52.960317+0000","last_became_active":"2022-04-28T14:41:45.924776+0000","last_became_peered":"2022-04-28T14:41:45.924776+0000","last_unstale":"2022-04-28T14:41:52.960317+0000","last_undegraded":"2022-04-28T14:41:52.960317+0000","last_fullsized":"2022-04-28T14:41:52.960317+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.962692+0000","last_change":"2022-04-28T14:41:44.937267+0000","last_active":"2022-04-28T14:41:52.962692+0000","last_peered":"2022-04-28T14:41:52.962692+0000","last_clean":"2022-04-28T14:41:52.962692+0000","last_became_active":"2022-04-28T14:41:44.936726+0000","last_became_peered":"2022-04-28T14:41:44.936726+0000","last_unstale":"2022-04-28T14:41:52.962692+0000","last_undegraded":"2022-04-28T14:41:52.962692+0000","last_fullsized":"2022-04-28T14:41:52.962692+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"20'1","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959633+0000","last_change":"2022-04-28T14:41:45.939493+0000","last_active":"2022-04-28T14:41:52.959633+0000","last_peered":"2022-04-28T14:41:52.959633+0000","last_clean":"2022-04-28T14:41:52.959633+0000","last_became_active":"2022-04-28T14:41:45.938801+0000","last_became_peered":"2022-04-28T14:41:45.938801+0000","last_unstale":"2022-04-28T14:41:52.959633+0000","last_undegraded":"2022-04-28T14:41:52.959633+0000","last_fullsized":"2022-04-28T14:41:52.959633+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:41:26.135911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:41:26.135911+0000","last_clean_scrub_stamp":"2022-04-28T14:41:26.135911+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960549+0000","last_change":"2022-04-28T14:41:45.926215+0000","last_active":"2022-04-28T14:41:52.960549+0000","last_peered":"2022-04-28T14:41:52.960549+0000","last_clean":"2022-04-28T14:41:52.960549+0000","last_became_active":"2022-04-28T14:41:45.925932+0000","last_became_peered":"2022-04-28T14:41:45.925932+0000","last_unstale":"2022-04-28T14:41:52.960549+0000","last_undegraded":"2022-04-28T14:41:52.960549+0000","last_fullsized":"2022-04-28T14:41:52.960549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.893221+0000","last_change":"2022-04-28T14:41:45.920379+0000","last_active":"2022-04-28T14:41:53.893221+0000","last_peered":"2022-04-28T14:41:53.893221+0000","last_clean":"2022-04-28T14:41:53.893221+0000","last_became_active":"2022-04-28T14:41:45.919929+0000","last_became_peered":"2022-04-28T14:41:45.919929+0000","last_unstale":"2022-04-28T14:41:53.893221+0000","last_undegraded":"2022-04-28T14:41:53.893221+0000","last_fullsized":"2022-04-28T14:41:53.893221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961560+0000","last_change":"2022-04-28T14:41:43.929313+0000","last_active":"2022-04-28T14:41:52.961560+0000","last_peered":"2022-04-28T14:41:52.961560+0000","last_clean":"2022-04-28T14:41:52.961560+0000","last_became_active":"2022-04-28T14:41:43.928992+0000","last_became_peered":"2022-04-28T14:41:43.928992+0000","last_unstale":"2022-04-28T14:41:52.961560+0000","last_undegraded":"2022-04-28T14:41:52.961560+0000","last_fullsized":"2022-04-28T14:41:52.961560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964561+0000","last_change":"2022-04-28T14:41:43.934741+0000","last_active":"2022-04-28T14:41:52.964561+0000","last_peered":"2022-04-28T14:41:52.964561+0000","last_clean":"2022-04-28T14:41:52.964561+0000","last_became_active":"2022-04-28T14:41:43.934176+0000","last_became_peered":"2022-04-28T14:41:43.934176+0000","last_unstale":"2022-04-28T14:41:52.964561+0000","last_undegraded":"2022-04-28T14:41:52.964561+0000","last_fullsized":"2022-04-28T14:41:52.964561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959848+0000","last_change":"2022-04-28T14:41:45.921659+0000","last_active":"2022-04-28T14:41:52.959848+0000","last_peered":"2022-04-28T14:41:52.959848+0000","last_clean":"2022-04-28T14:41:52.959848+0000","last_became_active":"2022-04-28T14:41:45.921070+0000","last_became_peered":"2022-04-28T14:41:45.921070+0000","last_unstale":"2022-04-28T14:41:52.959848+0000","last_undegraded":"2022-04-28T14:41:52.959848+0000","last_fullsized":"2022-04-28T14:41:52.959848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959979+0000","last_change":"2022-04-28T14:41:45.920804+0000","last_active":"2022-04-28T14:41:52.959979+0000","last_peered":"2022-04-28T14:41:52.959979+0000","last_clean":"2022-04-28T14:41:52.959979+0000","last_became_active":"2022-04-28T14:41:45.920305+0000","last_became_peered":"2022-04-28T14:41:45.920305+0000","last_unstale":"2022-04-28T14:41:52.959979+0000","last_undegraded":"2022-04-28T14:41:52.959979+0000","last_fullsized":"2022-04-28T14:41:52.959979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.958864+0000","last_change":"2022-04-28T14:41:44.931126+0000","last_active":"2022-04-28T14:41:52.958864+0000","last_peered":"2022-04-28T14:41:52.958864+0000","last_clean":"2022-04-28T14:41:52.958864+0000","last_became_active":"2022-04-28T14:41:44.930679+0000","last_became_peered":"2022-04-28T14:41:44.930679+0000","last_unstale":"2022-04-28T14:41:52.958864+0000","last_undegraded":"2022-04-28T14:41:52.958864+0000","last_fullsized":"2022-04-28T14:41:52.958864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'1","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959026+0000","last_change":"2022-04-28T14:41:45.939154+0000","last_active":"2022-04-28T14:41:52.959026+0000","last_peered":"2022-04-28T14:41:52.959026+0000","last_clean":"2022-04-28T14:41:52.959026+0000","last_became_active":"2022-04-28T14:41:45.938396+0000","last_became_peered":"2022-04-28T14:41:45.938396+0000","last_unstale":"2022-04-28T14:41:52.959026+0000","last_undegraded":"2022-04-28T14:41:52.959026+0000","last_fullsized":"2022-04-28T14:41:52.959026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.963101+0000","last_change":"2022-04-28T14:41:44.938186+0000","last_active":"2022-04-28T14:41:52.963101+0000","last_peered":"2022-04-28T14:41:52.963101+0000","last_clean":"2022-04-28T14:41:52.963101+0000","last_became_active":"2022-04-28T14:41:44.937871+0000","last_became_peered":"2022-04-28T14:41:44.937871+0000","last_unstale":"2022-04-28T14:41:52.963101+0000","last_undegraded":"2022-04-28T14:41:52.963101+0000","last_fullsized":"2022-04-28T14:41:52.963101+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.962767+0000","last_change":"2022-04-28T14:41:43.929510+0000","last_active":"2022-04-28T14:41:52.962767+0000","last_peered":"2022-04-28T14:41:52.962767+0000","last_clean":"2022-04-28T14:41:52.962767+0000","last_became_active":"2022-04-28T14:41:43.929204+0000","last_became_peered":"2022-04-28T14:41:43.929204+0000","last_unstale":"2022-04-28T14:41:52.962767+0000","last_undegraded":"2022-04-28T14:41:52.962767+0000","last_fullsized":"2022-04-28T14:41:52.962767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"16'1","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.892400+0000","last_change":"2022-04-28T14:41:45.924049+0000","last_active":"2022-04-28T14:41:53.892400+0000","last_peered":"2022-04-28T14:41:53.892400+0000","last_clean":"2022-04-28T14:41:53.892400+0000","last_became_active":"2022-04-28T14:41:45.920694+0000","last_became_peered":"2022-04-28T14:41:45.920694+0000","last_unstale":"2022-04-28T14:41:53.892400+0000","last_undegraded":"2022-04-28T14:41:53.892400+0000","last_fullsized":"2022-04-28T14:41:53.892400+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959189+0000","last_change":"2022-04-28T14:41:44.930830+0000","last_active":"2022-04-28T14:41:52.959189+0000","last_peered":"2022-04-28T14:41:52.959189+0000","last_clean":"2022-04-28T14:41:52.959189+0000","last_became_active":"2022-04-28T14:41:44.930545+0000","last_became_peered":"2022-04-28T14:41:44.930545+0000","last_unstale":"2022-04-28T14:41:52.959189+0000","last_undegraded":"2022-04-28T14:41:52.959189+0000","last_fullsized":"2022-04-28T14:41:52.959189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.958351+0000","last_change":"2022-04-28T14:41:43.929762+0000","last_active":"2022-04-28T14:41:52.958351+0000","last_peered":"2022-04-28T14:41:52.958351+0000","last_clean":"2022-04-28T14:41:52.958351+0000","last_became_active":"2022-04-28T14:41:43.929422+0000","last_became_peered":"2022-04-28T14:41:43.929422+0000","last_unstale":"2022-04-28T14:41:52.958351+0000","last_undegraded":"2022-04-28T14:41:52.958351+0000","last_fullsized":"2022-04-28T14:41:52.958351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'3","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959556+0000","last_change":"2022-04-28T14:41:45.929159+0000","last_active":"2022-04-28T14:41:52.959556+0000","last_peered":"2022-04-28T14:41:52.959556+0000","last_clean":"2022-04-28T14:41:52.959556+0000","last_became_active":"2022-04-28T14:41:45.928488+0000","last_became_peered":"2022-04-28T14:41:45.928488+0000","last_unstale":"2022-04-28T14:41:52.959556+0000","last_undegraded":"2022-04-28T14:41:52.959556+0000","last_fullsized":"2022-04-28T14:41:52.959556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959475+0000","last_change":"2022-04-28T14:41:45.913037+0000","last_active":"2022-04-28T14:41:52.959475+0000","last_peered":"2022-04-28T14:41:52.959475+0000","last_clean":"2022-04-28T14:41:52.959475+0000","last_became_active":"2022-04-28T14:41:45.912757+0000","last_became_peered":"2022-04-28T14:41:45.912757+0000","last_unstale":"2022-04-28T14:41:52.959475+0000","last_undegraded":"2022-04-28T14:41:52.959475+0000","last_fullsized":"2022-04-28T14:41:52.959475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959013+0000","last_change":"2022-04-28T14:41:45.919657+0000","last_active":"2022-04-28T14:41:52.959013+0000","last_peered":"2022-04-28T14:41:52.959013+0000","last_clean":"2022-04-28T14:41:52.959013+0000","last_became_active":"2022-04-28T14:41:45.919190+0000","last_became_peered":"2022-04-28T14:41:45.919190+0000","last_unstale":"2022-04-28T14:41:52.959013+0000","last_undegraded":"2022-04-28T14:41:52.959013+0000","last_fullsized":"2022-04-28T14:41:52.959013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960751+0000","last_change":"2022-04-28T14:41:45.937351+0000","last_active":"2022-04-28T14:41:52.960751+0000","last_peered":"2022-04-28T14:41:52.960751+0000","last_clean":"2022-04-28T14:41:52.960751+0000","last_became_active":"2022-04-28T14:41:45.937056+0000","last_became_peered":"2022-04-28T14:41:45.937056+0000","last_unstale":"2022-04-28T14:41:52.960751+0000","last_undegraded":"2022-04-28T14:41:52.960751+0000","last_fullsized":"2022-04-28T14:41:52.960751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.963130+0000","last_change":"2022-04-28T14:41:44.937509+0000","last_active":"2022-04-28T14:41:52.963130+0000","last_peered":"2022-04-28T14:41:52.963130+0000","last_clean":"2022-04-28T14:41:52.963130+0000","last_became_active":"2022-04-28T14:41:44.937184+0000","last_became_peered":"2022-04-28T14:41:44.937184+0000","last_unstale":"2022-04-28T14:41:52.963130+0000","last_undegraded":"2022-04-28T14:41:52.963130+0000","last_fullsized":"2022-04-28T14:41:52.963130+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959927+0000","last_change":"2022-04-28T14:41:45.918958+0000","last_active":"2022-04-28T14:41:52.959927+0000","last_peered":"2022-04-28T14:41:52.959927+0000","last_clean":"2022-04-28T14:41:52.959927+0000","last_became_active":"2022-04-28T14:41:45.918666+0000","last_became_peered":"2022-04-28T14:41:45.918666+0000","last_unstale":"2022-04-28T14:41:52.959927+0000","last_undegraded":"2022-04-28T14:41:52.959927+0000","last_fullsized":"2022-04-28T14:41:52.959927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959984+0000","last_change":"2022-04-28T14:41:45.923175+0000","last_active":"2022-04-28T14:41:52.959984+0000","last_peered":"2022-04-28T14:41:52.959984+0000","last_clean":"2022-04-28T14:41:52.959984+0000","last_became_active":"2022-04-28T14:41:45.922408+0000","last_became_peered":"2022-04-28T14:41:45.922408+0000","last_unstale":"2022-04-28T14:41:52.959984+0000","last_undegraded":"2022-04-28T14:41:52.959984+0000","last_fullsized":"2022-04-28T14:41:52.959984+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961161+0000","last_change":"2022-04-28T14:41:44.934084+0000","last_active":"2022-04-28T14:41:52.961161+0000","last_peered":"2022-04-28T14:41:52.961161+0000","last_clean":"2022-04-28T14:41:52.961161+0000","last_became_active":"2022-04-28T14:41:44.930208+0000","last_became_peered":"2022-04-28T14:41:44.930208+0000","last_unstale":"2022-04-28T14:41:52.961161+0000","last_undegraded":"2022-04-28T14:41:52.961161+0000","last_fullsized":"2022-04-28T14:41:52.961161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961716+0000","last_change":"2022-04-28T14:41:45.926604+0000","last_active":"2022-04-28T14:41:52.961716+0000","last_peered":"2022-04-28T14:41:52.961716+0000","last_clean":"2022-04-28T14:41:52.961716+0000","last_became_active":"2022-04-28T14:41:45.926289+0000","last_became_peered":"2022-04-28T14:41:45.926289+0000","last_unstale":"2022-04-28T14:41:52.961716+0000","last_undegraded":"2022-04-28T14:41:52.961716+0000","last_fullsized":"2022-04-28T14:41:52.961716+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960663+0000","last_change":"2022-04-28T14:41:43.936705+0000","last_active":"2022-04-28T14:41:52.960663+0000","last_peered":"2022-04-28T14:41:52.960663+0000","last_clean":"2022-04-28T14:41:52.960663+0000","last_became_active":"2022-04-28T14:41:43.936257+0000","last_became_peered":"2022-04-28T14:41:43.936257+0000","last_unstale":"2022-04-28T14:41:52.960663+0000","last_undegraded":"2022-04-28T14:41:52.960663+0000","last_fullsized":"2022-04-28T14:41:52.960663+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.893162+0000","last_change":"2022-04-28T14:41:45.920198+0000","last_active":"2022-04-28T14:41:53.893162+0000","last_peered":"2022-04-28T14:41:53.893162+0000","last_clean":"2022-04-28T14:41:53.893162+0000","last_became_active":"2022-04-28T14:41:45.919589+0000","last_became_peered":"2022-04-28T14:41:45.919589+0000","last_unstale":"2022-04-28T14:41:53.893162+0000","last_undegraded":"2022-04-28T14:41:53.893162+0000","last_fullsized":"2022-04-28T14:41:53.893162+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960952+0000","last_change":"2022-04-28T14:41:45.929830+0000","last_active":"2022-04-28T14:41:52.960952+0000","last_peered":"2022-04-28T14:41:52.960952+0000","last_clean":"2022-04-28T14:41:52.960952+0000","last_became_active":"2022-04-28T14:41:45.929543+0000","last_became_peered":"2022-04-28T14:41:45.929543+0000","last_unstale":"2022-04-28T14:41:52.960952+0000","last_undegraded":"2022-04-28T14:41:52.960952+0000","last_fullsized":"2022-04-28T14:41:52.960952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.963402+0000","last_change":"2022-04-28T14:41:43.935382+0000","last_active":"2022-04-28T14:41:52.963402+0000","last_peered":"2022-04-28T14:41:52.963402+0000","last_clean":"2022-04-28T14:41:52.963402+0000","last_became_active":"2022-04-28T14:41:43.934889+0000","last_became_peered":"2022-04-28T14:41:43.934889+0000","last_unstale":"2022-04-28T14:41:52.963402+0000","last_undegraded":"2022-04-28T14:41:52.963402+0000","last_fullsized":"2022-04-28T14:41:52.963402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961420+0000","last_change":"2022-04-28T14:41:43.936831+0000","last_active":"2022-04-28T14:41:52.961420+0000","last_peered":"2022-04-28T14:41:52.961420+0000","last_clean":"2022-04-28T14:41:52.961420+0000","last_became_active":"2022-04-28T14:41:43.936375+0000","last_became_peered":"2022-04-28T14:41:43.936375+0000","last_unstale":"2022-04-28T14:41:52.961420+0000","last_undegraded":"2022-04-28T14:41:52.961420+0000","last_fullsized":"2022-04-28T14:41:52.961420+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964276+0000","last_change":"2022-04-28T14:41:43.933641+0000","last_active":"2022-04-28T14:41:52.964276+0000","last_peered":"2022-04-28T14:41:52.964276+0000","last_clean":"2022-04-28T14:41:52.964276+0000","last_became_active":"2022-04-28T14:41:43.933285+0000","last_became_peered":"2022-04-28T14:41:43.933285+0000","last_unstale":"2022-04-28T14:41:52.964276+0000","last_undegraded":"2022-04-28T14:41:52.964276+0000","last_fullsized":"2022-04-28T14:41:52.964276+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964880+0000","last_change":"2022-04-28T14:41:43.935902+0000","last_active":"2022-04-28T14:41:52.964880+0000","last_peered":"2022-04-28T14:41:52.964880+0000","last_clean":"2022-04-28T14:41:52.964880+0000","last_became_active":"2022-04-28T14:41:43.935588+0000","last_became_peered":"2022-04-28T14:41:43.935588+0000","last_unstale":"2022-04-28T14:41:52.964880+0000","last_undegraded":"2022-04-28T14:41:52.964880+0000","last_fullsized":"2022-04-28T14:41:52.964880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"34'2","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961498+0000","last_change":"2022-04-28T14:41:45.928326+0000","last_active":"2022-04-28T14:41:52.961498+0000","last_peered":"2022-04-28T14:41:52.961498+0000","last_clean":"2022-04-28T14:41:52.961498+0000","last_became_active":"2022-04-28T14:41:45.928009+0000","last_became_peered":"2022-04-28T14:41:45.928009+0000","last_unstale":"2022-04-28T14:41:52.961498+0000","last_undegraded":"2022-04-28T14:41:52.961498+0000","last_fullsized":"2022-04-28T14:41:52.961498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961725+0000","last_change":"2022-04-28T14:41:45.932474+0000","last_active":"2022-04-28T14:41:52.961725+0000","last_peered":"2022-04-28T14:41:52.961725+0000","last_clean":"2022-04-28T14:41:52.961725+0000","last_became_active":"2022-04-28T14:41:45.931952+0000","last_became_peered":"2022-04-28T14:41:45.931952+0000","last_unstale":"2022-04-28T14:41:52.961725+0000","last_undegraded":"2022-04-28T14:41:52.961725+0000","last_fullsized":"2022-04-28T14:41:52.961725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"34'2","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964711+0000","last_change":"2022-04-28T14:41:45.922641+0000","last_active":"2022-04-28T14:41:52.964711+0000","last_peered":"2022-04-28T14:41:52.964711+0000","last_clean":"2022-04-28T14:41:52.964711+0000","last_became_active":"2022-04-28T14:41:45.921979+0000","last_became_peered":"2022-04-28T14:41:45.921979+0000","last_unstale":"2022-04-28T14:41:52.964711+0000","last_undegraded":"2022-04-28T14:41:52.964711+0000","last_fullsized":"2022-04-28T14:41:52.964711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.892696+0000","last_change":"2022-04-28T14:41:44.930876+0000","last_active":"2022-04-28T14:41:53.892696+0000","last_peered":"2022-04-28T14:41:53.892696+0000","last_clean":"2022-04-28T14:41:53.892696+0000","last_became_active":"2022-04-28T14:41:44.930402+0000","last_became_peered":"2022-04-28T14:41:44.930402+0000","last_unstale":"2022-04-28T14:41:53.892696+0000","last_undegraded":"2022-04-28T14:41:53.892696+0000","last_fullsized":"2022-04-28T14:41:53.892696+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959330+0000","last_change":"2022-04-28T14:41:45.938922+0000","last_active":"2022-04-28T14:41:52.959330+0000","last_peered":"2022-04-28T14:41:52.959330+0000","last_clean":"2022-04-28T14:41:52.959330+0000","last_became_active":"2022-04-28T14:41:45.938004+0000","last_became_peered":"2022-04-28T14:41:45.938004+0000","last_unstale":"2022-04-28T14:41:52.959330+0000","last_undegraded":"2022-04-28T14:41:52.959330+0000","last_fullsized":"2022-04-28T14:41:52.959330+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.892393+0000","last_change":"2022-04-28T14:41:44.945035+0000","last_active":"2022-04-28T14:41:53.892393+0000","last_peered":"2022-04-28T14:41:53.892393+0000","last_clean":"2022-04-28T14:41:53.892393+0000","last_became_active":"2022-04-28T14:41:44.938814+0000","last_became_peered":"2022-04-28T14:41:44.938814+0000","last_unstale":"2022-04-28T14:41:53.892393+0000","last_undegraded":"2022-04-28T14:41:53.892393+0000","last_fullsized":"2022-04-28T14:41:53.892393+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.892743+0000","last_change":"2022-04-28T14:41:44.946296+0000","last_active":"2022-04-28T14:41:53.892743+0000","last_peered":"2022-04-28T14:41:53.892743+0000","last_clean":"2022-04-28T14:41:53.892743+0000","last_became_active":"2022-04-28T14:41:44.945985+0000","last_became_peered":"2022-04-28T14:41:44.945985+0000","last_unstale":"2022-04-28T14:41:53.892743+0000","last_undegraded":"2022-04-28T14:41:53.892743+0000","last_fullsized":"2022-04-28T14:41:53.892743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.963487+0000","last_change":"2022-04-28T14:41:45.927954+0000","last_active":"2022-04-28T14:41:52.963487+0000","last_peered":"2022-04-28T14:41:52.963487+0000","last_clean":"2022-04-28T14:41:52.963487+0000","last_became_active":"2022-04-28T14:41:45.927121+0000","last_became_peered":"2022-04-28T14:41:45.927121+0000","last_unstale":"2022-04-28T14:41:52.963487+0000","last_undegraded":"2022-04-28T14:41:52.963487+0000","last_fullsized":"2022-04-28T14:41:52.963487+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960250+0000","last_change":"2022-04-28T14:41:45.928068+0000","last_active":"2022-04-28T14:41:52.960250+0000","last_peered":"2022-04-28T14:41:52.960250+0000","last_clean":"2022-04-28T14:41:52.960250+0000","last_became_active":"2022-04-28T14:41:45.927687+0000","last_became_peered":"2022-04-28T14:41:45.927687+0000","last_unstale":"2022-04-28T14:41:52.960250+0000","last_undegraded":"2022-04-28T14:41:52.960250+0000","last_fullsized":"2022-04-28T14:41:52.960250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960552+0000","last_change":"2022-04-28T14:41:45.929786+0000","last_active":"2022-04-28T14:41:52.960552+0000","last_peered":"2022-04-28T14:41:52.960552+0000","last_clean":"2022-04-28T14:41:52.960552+0000","last_became_active":"2022-04-28T14:41:45.929519+0000","last_became_peered":"2022-04-28T14:41:45.929519+0000","last_unstale":"2022-04-28T14:41:52.960552+0000","last_undegraded":"2022-04-28T14:41:52.960552+0000","last_fullsized":"2022-04-28T14:41:52.960552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960111+0000","last_change":"2022-04-28T14:41:45.936838+0000","last_active":"2022-04-28T14:41:52.960111+0000","last_peered":"2022-04-28T14:41:52.960111+0000","last_clean":"2022-04-28T14:41:52.960111+0000","last_became_active":"2022-04-28T14:41:45.936515+0000","last_became_peered":"2022-04-28T14:41:45.936515+0000","last_unstale":"2022-04-28T14:41:52.960111+0000","last_undegraded":"2022-04-28T14:41:52.960111+0000","last_fullsized":"2022-04-28T14:41:52.960111+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961516+0000","last_change":"2022-04-28T14:41:45.935972+0000","last_active":"2022-04-28T14:41:52.961516+0000","last_peered":"2022-04-28T14:41:52.961516+0000","last_clean":"2022-04-28T14:41:52.961516+0000","last_became_active":"2022-04-28T14:41:45.935521+0000","last_became_peered":"2022-04-28T14:41:45.935521+0000","last_unstale":"2022-04-28T14:41:52.961516+0000","last_undegraded":"2022-04-28T14:41:52.961516+0000","last_fullsized":"2022-04-28T14:41:52.961516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961594+0000","last_change":"2022-04-28T14:41:43.936857+0000","last_active":"2022-04-28T14:41:52.961594+0000","last_peered":"2022-04-28T14:41:52.961594+0000","last_clean":"2022-04-28T14:41:52.961594+0000","last_became_active":"2022-04-28T14:41:43.936580+0000","last_became_peered":"2022-04-28T14:41:43.936580+0000","last_unstale":"2022-04-28T14:41:52.961594+0000","last_undegraded":"2022-04-28T14:41:52.961594+0000","last_fullsized":"2022-04-28T14:41:52.961594+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960074+0000","last_change":"2022-04-28T14:41:45.921839+0000","last_active":"2022-04-28T14:41:52.960074+0000","last_peered":"2022-04-28T14:41:52.960074+0000","last_clean":"2022-04-28T14:41:52.960074+0000","last_became_active":"2022-04-28T14:41:45.921397+0000","last_became_peered":"2022-04-28T14:41:45.921397+0000","last_unstale":"2022-04-28T14:41:52.960074+0000","last_undegraded":"2022-04-28T14:41:52.960074+0000","last_fullsized":"2022-04-28T14:41:52.960074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"16'1","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.893295+0000","last_change":"2022-04-28T14:41:44.939386+0000","last_active":"2022-04-28T14:41:53.893295+0000","last_peered":"2022-04-28T14:41:53.893295+0000","last_clean":"2022-04-28T14:41:53.893295+0000","last_became_active":"2022-04-28T14:41:44.938959+0000","last_became_peered":"2022-04-28T14:41:44.938959+0000","last_unstale":"2022-04-28T14:41:53.893295+0000","last_undegraded":"2022-04-28T14:41:53.893295+0000","last_fullsized":"2022-04-28T14:41:53.893295+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960435+0000","last_change":"2022-04-28T14:41:45.935801+0000","last_active":"2022-04-28T14:41:52.960435+0000","last_peered":"2022-04-28T14:41:52.960435+0000","last_clean":"2022-04-28T14:41:52.960435+0000","last_became_active":"2022-04-28T14:41:45.935389+0000","last_became_peered":"2022-04-28T14:41:45.935389+0000","last_unstale":"2022-04-28T14:41:52.960435+0000","last_undegraded":"2022-04-28T14:41:52.960435+0000","last_fullsized":"2022-04-28T14:41:52.960435+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"17'3","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964884+0000","last_change":"2022-04-28T14:41:45.925593+0000","last_active":"2022-04-28T14:41:52.964884+0000","last_peered":"2022-04-28T14:41:52.964884+0000","last_clean":"2022-04-28T14:41:52.964884+0000","last_became_active":"2022-04-28T14:41:45.925071+0000","last_became_peered":"2022-04-28T14:41:45.925071+0000","last_unstale":"2022-04-28T14:41:52.964884+0000","last_undegraded":"2022-04-28T14:41:52.964884+0000","last_fullsized":"2022-04-28T14:41:52.964884+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.893392+0000","last_change":"2022-04-28T14:41:45.923312+0000","last_active":"2022-04-28T14:41:53.893392+0000","last_peered":"2022-04-28T14:41:53.893392+0000","last_clean":"2022-04-28T14:41:53.893392+0000","last_became_active":"2022-04-28T14:41:45.922271+0000","last_became_peered":"2022-04-28T14:41:45.922271+0000","last_unstale":"2022-04-28T14:41:53.893392+0000","last_undegraded":"2022-04-28T14:41:53.893392+0000","last_fullsized":"2022-04-28T14:41:53.893392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"16'2","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960963+0000","last_change":"2022-04-28T14:41:45.938022+0000","last_active":"2022-04-28T14:41:52.960963+0000","last_peered":"2022-04-28T14:41:52.960963+0000","last_clean":"2022-04-28T14:41:52.960963+0000","last_became_active":"2022-04-28T14:41:45.937746+0000","last_became_peered":"2022-04-28T14:41:45.937746+0000","last_unstale":"2022-04-28T14:41:52.960963+0000","last_undegraded":"2022-04-28T14:41:52.960963+0000","last_fullsized":"2022-04-28T14:41:52.960963+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959329+0000","last_change":"2022-04-28T14:41:45.924919+0000","last_active":"2022-04-28T14:41:52.959329+0000","last_peered":"2022-04-28T14:41:52.959329+0000","last_clean":"2022-04-28T14:41:52.959329+0000","last_became_active":"2022-04-28T14:41:45.924096+0000","last_became_peered":"2022-04-28T14:41:45.924096+0000","last_unstale":"2022-04-28T14:41:52.959329+0000","last_undegraded":"2022-04-28T14:41:52.959329+0000","last_fullsized":"2022-04-28T14:41:52.959329+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"16'2","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959556+0000","last_change":"2022-04-28T14:41:45.939314+0000","last_active":"2022-04-28T14:41:52.959556+0000","last_peered":"2022-04-28T14:41:52.959556+0000","last_clean":"2022-04-28T14:41:52.959556+0000","last_became_active":"2022-04-28T14:41:45.938409+0000","last_became_peered":"2022-04-28T14:41:45.938409+0000","last_unstale":"2022-04-28T14:41:52.959556+0000","last_undegraded":"2022-04-28T14:41:52.959556+0000","last_fullsized":"2022-04-28T14:41:52.959556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959876+0000","last_change":"2022-04-28T14:41:45.925058+0000","last_active":"2022-04-28T14:41:52.959876+0000","last_peered":"2022-04-28T14:41:52.959876+0000","last_clean":"2022-04-28T14:41:52.959876+0000","last_became_active":"2022-04-28T14:41:45.924600+0000","last_became_peered":"2022-04-28T14:41:45.924600+0000","last_unstale":"2022-04-28T14:41:52.959876+0000","last_undegraded":"2022-04-28T14:41:52.959876+0000","last_fullsized":"2022-04-28T14:41:52.959876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959066+0000","last_change":"2022-04-28T14:41:45.926318+0000","last_active":"2022-04-28T14:41:52.959066+0000","last_peered":"2022-04-28T14:41:52.959066+0000","last_clean":"2022-04-28T14:41:52.959066+0000","last_became_active":"2022-04-28T14:41:45.925741+0000","last_became_peered":"2022-04-28T14:41:45.925741+0000","last_unstale":"2022-04-28T14:41:52.959066+0000","last_undegraded":"2022-04-28T14:41:52.959066+0000","last_fullsized":"2022-04-28T14:41:52.959066+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.963319+0000","last_change":"2022-04-28T14:41:44.935067+0000","last_active":"2022-04-28T14:41:52.963319+0000","last_peered":"2022-04-28T14:41:52.963319+0000","last_clean":"2022-04-28T14:41:52.963319+0000","last_became_active":"2022-04-28T14:41:44.934787+0000","last_became_peered":"2022-04-28T14:41:44.934787+0000","last_unstale":"2022-04-28T14:41:52.963319+0000","last_undegraded":"2022-04-28T14:41:52.963319+0000","last_fullsized":"2022-04-28T14:41:52.963319+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"17'4","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.958956+0000","last_change":"2022-04-28T14:41:43.937297+0000","last_active":"2022-04-28T14:41:52.958956+0000","last_peered":"2022-04-28T14:41:52.958956+0000","last_clean":"2022-04-28T14:41:52.958956+0000","last_became_active":"2022-04-28T14:41:43.937003+0000","last_became_peered":"2022-04-28T14:41:43.937003+0000","last_unstale":"2022-04-28T14:41:52.958956+0000","last_undegraded":"2022-04-28T14:41:52.958956+0000","last_fullsized":"2022-04-28T14:41:52.958956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959402+0000","last_change":"2022-04-28T14:41:43.937199+0000","last_active":"2022-04-28T14:41:52.959402+0000","last_peered":"2022-04-28T14:41:52.959402+0000","last_clean":"2022-04-28T14:41:52.959402+0000","last_became_active":"2022-04-28T14:41:43.936795+0000","last_became_peered":"2022-04-28T14:41:43.936795+0000","last_unstale":"2022-04-28T14:41:52.959402+0000","last_undegraded":"2022-04-28T14:41:52.959402+0000","last_fullsized":"2022-04-28T14:41:52.959402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"34'4","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.893006+0000","last_change":"2022-04-28T14:41:45.919269+0000","last_active":"2022-04-28T14:41:53.893006+0000","last_peered":"2022-04-28T14:41:53.893006+0000","last_clean":"2022-04-28T14:41:53.893006+0000","last_became_active":"2022-04-28T14:41:45.918916+0000","last_became_peered":"2022-04-28T14:41:45.918916+0000","last_unstale":"2022-04-28T14:41:53.893006+0000","last_undegraded":"2022-04-28T14:41:53.893006+0000","last_fullsized":"2022-04-28T14:41:53.893006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960526+0000","last_change":"2022-04-28T14:41:45.926152+0000","last_active":"2022-04-28T14:41:52.960526+0000","last_peered":"2022-04-28T14:41:52.960526+0000","last_clean":"2022-04-28T14:41:52.960526+0000","last_became_active":"2022-04-28T14:41:45.925302+0000","last_became_peered":"2022-04-28T14:41:45.925302+0000","last_unstale":"2022-04-28T14:41:52.960526+0000","last_undegraded":"2022-04-28T14:41:52.960526+0000","last_fullsized":"2022-04-28T14:41:52.960526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.892930+0000","last_change":"2022-04-28T14:41:44.940023+0000","last_active":"2022-04-28T14:41:53.892930+0000","last_peered":"2022-04-28T14:41:53.892930+0000","last_clean":"2022-04-28T14:41:53.892930+0000","last_became_active":"2022-04-28T14:41:44.939344+0000","last_became_peered":"2022-04-28T14:41:44.939344+0000","last_unstale":"2022-04-28T14:41:53.892930+0000","last_undegraded":"2022-04-28T14:41:53.892930+0000","last_fullsized":"2022-04-28T14:41:53.892930+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.963520+0000","last_change":"2022-04-28T14:41:43.935203+0000","last_active":"2022-04-28T14:41:52.963520+0000","last_peered":"2022-04-28T14:41:52.963520+0000","last_clean":"2022-04-28T14:41:52.963520+0000","last_became_active":"2022-04-28T14:41:43.934876+0000","last_became_peered":"2022-04-28T14:41:43.934876+0000","last_unstale":"2022-04-28T14:41:52.963520+0000","last_undegraded":"2022-04-28T14:41:52.963520+0000","last_fullsized":"2022-04-28T14:41:52.963520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960842+0000","last_change":"2022-04-28T14:41:45.927690+0000","last_active":"2022-04-28T14:41:52.960842+0000","last_peered":"2022-04-28T14:41:52.960842+0000","last_clean":"2022-04-28T14:41:52.960842+0000","last_became_active":"2022-04-28T14:41:45.925615+0000","last_became_peered":"2022-04-28T14:41:45.925615+0000","last_unstale":"2022-04-28T14:41:52.960842+0000","last_undegraded":"2022-04-28T14:41:52.960842+0000","last_fullsized":"2022-04-28T14:41:52.960842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960850+0000","last_change":"2022-04-28T14:41:45.929916+0000","last_active":"2022-04-28T14:41:52.960850+0000","last_peered":"2022-04-28T14:41:52.960850+0000","last_clean":"2022-04-28T14:41:52.960850+0000","last_became_active":"2022-04-28T14:41:45.929638+0000","last_became_peered":"2022-04-28T14:41:45.929638+0000","last_unstale":"2022-04-28T14:41:52.960850+0000","last_undegraded":"2022-04-28T14:41:52.960850+0000","last_fullsized":"2022-04-28T14:41:52.960850+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961689+0000","last_change":"2022-04-28T14:41:45.927448+0000","last_active":"2022-04-28T14:41:52.961689+0000","last_peered":"2022-04-28T14:41:52.961689+0000","last_clean":"2022-04-28T14:41:52.961689+0000","last_became_active":"2022-04-28T14:41:45.926975+0000","last_became_peered":"2022-04-28T14:41:45.926975+0000","last_unstale":"2022-04-28T14:41:52.961689+0000","last_undegraded":"2022-04-28T14:41:52.961689+0000","last_fullsized":"2022-04-28T14:41:52.961689+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.893247+0000","last_change":"2022-04-28T14:41:45.922943+0000","last_active":"2022-04-28T14:41:53.893247+0000","last_peered":"2022-04-28T14:41:53.893247+0000","last_clean":"2022-04-28T14:41:53.893247+0000","last_became_active":"2022-04-28T14:41:45.921915+0000","last_became_peered":"2022-04-28T14:41:45.921915+0000","last_unstale":"2022-04-28T14:41:53.893247+0000","last_undegraded":"2022-04-28T14:41:53.893247+0000","last_fullsized":"2022-04-28T14:41:53.893247+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959782+0000","last_change":"2022-04-28T14:41:45.920514+0000","last_active":"2022-04-28T14:41:52.959782+0000","last_peered":"2022-04-28T14:41:52.959782+0000","last_clean":"2022-04-28T14:41:52.959782+0000","last_became_active":"2022-04-28T14:41:45.919565+0000","last_became_peered":"2022-04-28T14:41:45.919565+0000","last_unstale":"2022-04-28T14:41:52.959782+0000","last_undegraded":"2022-04-28T14:41:52.959782+0000","last_fullsized":"2022-04-28T14:41:52.959782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.958851+0000","last_change":"2022-04-28T14:41:43.929389+0000","last_active":"2022-04-28T14:41:52.958851+0000","last_peered":"2022-04-28T14:41:52.958851+0000","last_clean":"2022-04-28T14:41:52.958851+0000","last_became_active":"2022-04-28T14:41:43.929060+0000","last_became_peered":"2022-04-28T14:41:43.929060+0000","last_unstale":"2022-04-28T14:41:52.958851+0000","last_undegraded":"2022-04-28T14:41:52.958851+0000","last_fullsized":"2022-04-28T14:41:52.958851+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"16'6","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.962553+0000","last_change":"2022-04-28T14:41:43.935035+0000","last_active":"2022-04-28T14:41:52.962553+0000","last_peered":"2022-04-28T14:41:52.962553+0000","last_clean":"2022-04-28T14:41:52.962553+0000","last_became_active":"2022-04-28T14:41:43.933871+0000","last_became_peered":"2022-04-28T14:41:43.933871+0000","last_unstale":"2022-04-28T14:41:52.962553+0000","last_undegraded":"2022-04-28T14:41:52.962553+0000","last_fullsized":"2022-04-28T14:41:52.962553+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959444+0000","last_change":"2022-04-28T14:41:45.924876+0000","last_active":"2022-04-28T14:41:52.959444+0000","last_peered":"2022-04-28T14:41:52.959444+0000","last_clean":"2022-04-28T14:41:52.959444+0000","last_became_active":"2022-04-28T14:41:45.924268+0000","last_became_peered":"2022-04-28T14:41:45.924268+0000","last_unstale":"2022-04-28T14:41:52.959444+0000","last_undegraded":"2022-04-28T14:41:52.959444+0000","last_fullsized":"2022-04-28T14:41:52.959444+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.962735+0000","last_change":"2022-04-28T14:41:43.934742+0000","last_active":"2022-04-28T14:41:52.962735+0000","last_peered":"2022-04-28T14:41:52.962735+0000","last_clean":"2022-04-28T14:41:52.962735+0000","last_became_active":"2022-04-28T14:41:43.934398+0000","last_became_peered":"2022-04-28T14:41:43.934398+0000","last_unstale":"2022-04-28T14:41:52.962735+0000","last_undegraded":"2022-04-28T14:41:52.962735+0000","last_fullsized":"2022-04-28T14:41:52.962735+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959604+0000","last_change":"2022-04-28T14:41:45.931265+0000","last_active":"2022-04-28T14:41:52.959604+0000","last_peered":"2022-04-28T14:41:52.959604+0000","last_clean":"2022-04-28T14:41:52.959604+0000","last_became_active":"2022-04-28T14:41:45.930183+0000","last_became_peered":"2022-04-28T14:41:45.930183+0000","last_unstale":"2022-04-28T14:41:52.959604+0000","last_undegraded":"2022-04-28T14:41:52.959604+0000","last_fullsized":"2022-04-28T14:41:52.959604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.892665+0000","last_change":"2022-04-28T14:41:45.916403+0000","last_active":"2022-04-28T14:41:53.892665+0000","last_peered":"2022-04-28T14:41:53.892665+0000","last_clean":"2022-04-28T14:41:53.892665+0000","last_became_active":"2022-04-28T14:41:45.915819+0000","last_became_peered":"2022-04-28T14:41:45.915819+0000","last_unstale":"2022-04-28T14:41:53.892665+0000","last_undegraded":"2022-04-28T14:41:53.892665+0000","last_fullsized":"2022-04-28T14:41:53.892665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.963184+0000","last_change":"2022-04-28T14:41:43.934880+0000","last_active":"2022-04-28T14:41:52.963184+0000","last_peered":"2022-04-28T14:41:52.963184+0000","last_clean":"2022-04-28T14:41:52.963184+0000","last_became_active":"2022-04-28T14:41:43.934485+0000","last_became_peered":"2022-04-28T14:41:43.934485+0000","last_unstale":"2022-04-28T14:41:52.963184+0000","last_undegraded":"2022-04-28T14:41:52.963184+0000","last_fullsized":"2022-04-28T14:41:52.963184+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960739+0000","last_change":"2022-04-28T14:41:44.930995+0000","last_active":"2022-04-28T14:41:52.960739+0000","last_peered":"2022-04-28T14:41:52.960739+0000","last_clean":"2022-04-28T14:41:52.960739+0000","last_became_active":"2022-04-28T14:41:44.930298+0000","last_became_peered":"2022-04-28T14:41:44.930298+0000","last_unstale":"2022-04-28T14:41:52.960739+0000","last_undegraded":"2022-04-28T14:41:52.960739+0000","last_fullsized":"2022-04-28T14:41:52.960739+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964519+0000","last_change":"2022-04-28T14:41:45.921459+0000","last_active":"2022-04-28T14:41:52.964519+0000","last_peered":"2022-04-28T14:41:52.964519+0000","last_clean":"2022-04-28T14:41:52.964519+0000","last_became_active":"2022-04-28T14:41:45.920994+0000","last_became_peered":"2022-04-28T14:41:45.920994+0000","last_unstale":"2022-04-28T14:41:52.964519+0000","last_undegraded":"2022-04-28T14:41:52.964519+0000","last_fullsized":"2022-04-28T14:41:52.964519+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"35'14","reported_seq":60,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960203+0000","last_change":"2022-04-28T14:41:45.930704+0000","last_active":"2022-04-28T14:41:52.960203+0000","last_peered":"2022-04-28T14:41:52.960203+0000","last_clean":"2022-04-28T14:41:52.960203+0000","last_became_active":"2022-04-28T14:41:45.930289+0000","last_became_peered":"2022-04-28T14:41:45.930289+0000","last_unstale":"2022-04-28T14:41:52.960203+0000","last_undegraded":"2022-04-28T14:41:52.960203+0000","last_fullsized":"2022-04-28T14:41:52.960203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4286,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":14,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.963292+0000","last_change":"2022-04-28T14:41:43.935169+0000","last_active":"2022-04-28T14:41:52.963292+0000","last_peered":"2022-04-28T14:41:52.963292+0000","last_clean":"2022-04-28T14:41:52.963292+0000","last_became_active":"2022-04-28T14:41:43.934249+0000","last_became_peered":"2022-04-28T14:41:43.934249+0000","last_unstale":"2022-04-28T14:41:52.963292+0000","last_undegraded":"2022-04-28T14:41:52.963292+0000","last_fullsized":"2022-04-28T14:41:52.963292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961610+0000","last_change":"2022-04-28T14:41:45.936019+0000","last_active":"2022-04-28T14:41:52.961610+0000","last_peered":"2022-04-28T14:41:52.961610+0000","last_clean":"2022-04-28T14:41:52.961610+0000","last_became_active":"2022-04-28T14:41:45.935557+0000","last_became_peered":"2022-04-28T14:41:45.935557+0000","last_unstale":"2022-04-28T14:41:52.961610+0000","last_undegraded":"2022-04-28T14:41:52.961610+0000","last_fullsized":"2022-04-28T14:41:52.961610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961894+0000","last_change":"2022-04-28T14:41:45.926070+0000","last_active":"2022-04-28T14:41:52.961894+0000","last_peered":"2022-04-28T14:41:52.961894+0000","last_clean":"2022-04-28T14:41:52.961894+0000","last_became_active":"2022-04-28T14:41:45.925745+0000","last_became_peered":"2022-04-28T14:41:45.925745+0000","last_unstale":"2022-04-28T14:41:52.961894+0000","last_undegraded":"2022-04-28T14:41:52.961894+0000","last_fullsized":"2022-04-28T14:41:52.961894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"16'2","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961822+0000","last_change":"2022-04-28T14:41:45.927276+0000","last_active":"2022-04-28T14:41:52.961822+0000","last_peered":"2022-04-28T14:41:52.961822+0000","last_clean":"2022-04-28T14:41:52.961822+0000","last_became_active":"2022-04-28T14:41:45.926618+0000","last_became_peered":"2022-04-28T14:41:45.926618+0000","last_unstale":"2022-04-28T14:41:52.961822+0000","last_undegraded":"2022-04-28T14:41:52.961822+0000","last_fullsized":"2022-04-28T14:41:52.961822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964770+0000","last_change":"2022-04-28T14:41:44.937836+0000","last_active":"2022-04-28T14:41:52.964770+0000","last_peered":"2022-04-28T14:41:52.964770+0000","last_clean":"2022-04-28T14:41:52.964770+0000","last_became_active":"2022-04-28T14:41:44.937280+0000","last_became_peered":"2022-04-28T14:41:44.937280+0000","last_unstale":"2022-04-28T14:41:52.964770+0000","last_undegraded":"2022-04-28T14:41:52.964770+0000","last_fullsized":"2022-04-28T14:41:52.964770+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964559+0000","last_change":"2022-04-28T14:41:44.933921+0000","last_active":"2022-04-28T14:41:52.964559+0000","last_peered":"2022-04-28T14:41:52.964559+0000","last_clean":"2022-04-28T14:41:52.964559+0000","last_became_active":"2022-04-28T14:41:44.933639+0000","last_became_peered":"2022-04-28T14:41:44.933639+0000","last_unstale":"2022-04-28T14:41:52.964559+0000","last_undegraded":"2022-04-28T14:41:52.964559+0000","last_fullsized":"2022-04-28T14:41:52.964559+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.962635+0000","last_change":"2022-04-28T14:41:43.935976+0000","last_active":"2022-04-28T14:41:52.962635+0000","last_peered":"2022-04-28T14:41:52.962635+0000","last_clean":"2022-04-28T14:41:52.962635+0000","last_became_active":"2022-04-28T14:41:43.934329+0000","last_became_peered":"2022-04-28T14:41:43.934329+0000","last_unstale":"2022-04-28T14:41:52.962635+0000","last_undegraded":"2022-04-28T14:41:52.962635+0000","last_fullsized":"2022-04-28T14:41:52.962635+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"16'1","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.962790+0000","last_change":"2022-04-28T14:41:43.935266+0000","last_active":"2022-04-28T14:41:52.962790+0000","last_peered":"2022-04-28T14:41:52.962790+0000","last_clean":"2022-04-28T14:41:52.962790+0000","last_became_active":"2022-04-28T14:41:43.934676+0000","last_became_peered":"2022-04-28T14:41:43.934676+0000","last_unstale":"2022-04-28T14:41:52.962790+0000","last_undegraded":"2022-04-28T14:41:52.962790+0000","last_fullsized":"2022-04-28T14:41:52.962790+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959688+0000","last_change":"2022-04-28T14:41:45.927634+0000","last_active":"2022-04-28T14:41:52.959688+0000","last_peered":"2022-04-28T14:41:52.959688+0000","last_clean":"2022-04-28T14:41:52.959688+0000","last_became_active":"2022-04-28T14:41:45.927293+0000","last_became_peered":"2022-04-28T14:41:45.927293+0000","last_unstale":"2022-04-28T14:41:52.959688+0000","last_undegraded":"2022-04-28T14:41:52.959688+0000","last_fullsized":"2022-04-28T14:41:52.959688+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959291+0000","last_change":"2022-04-28T14:41:44.932968+0000","last_active":"2022-04-28T14:41:52.959291+0000","last_peered":"2022-04-28T14:41:52.959291+0000","last_clean":"2022-04-28T14:41:52.959291+0000","last_became_active":"2022-04-28T14:41:44.932674+0000","last_became_peered":"2022-04-28T14:41:44.932674+0000","last_unstale":"2022-04-28T14:41:52.959291+0000","last_undegraded":"2022-04-28T14:41:52.959291+0000","last_fullsized":"2022-04-28T14:41:52.959291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.962945+0000","last_change":"2022-04-28T14:41:44.934580+0000","last_active":"2022-04-28T14:41:52.962945+0000","last_peered":"2022-04-28T14:41:52.962945+0000","last_clean":"2022-04-28T14:41:52.962945+0000","last_became_active":"2022-04-28T14:41:44.934290+0000","last_became_peered":"2022-04-28T14:41:44.934290+0000","last_unstale":"2022-04-28T14:41:52.962945+0000","last_undegraded":"2022-04-28T14:41:52.962945+0000","last_fullsized":"2022-04-28T14:41:52.962945+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"34'2","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.892529+0000","last_change":"2022-04-28T14:41:45.916208+0000","last_active":"2022-04-28T14:41:53.892529+0000","last_peered":"2022-04-28T14:41:53.892529+0000","last_clean":"2022-04-28T14:41:53.892529+0000","last_became_active":"2022-04-28T14:41:45.915499+0000","last_became_peered":"2022-04-28T14:41:45.915499+0000","last_unstale":"2022-04-28T14:41:53.892529+0000","last_undegraded":"2022-04-28T14:41:53.892529+0000","last_fullsized":"2022-04-28T14:41:53.892529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.892697+0000","last_change":"2022-04-28T14:41:44.946355+0000","last_active":"2022-04-28T14:41:53.892697+0000","last_peered":"2022-04-28T14:41:53.892697+0000","last_clean":"2022-04-28T14:41:53.892697+0000","last_became_active":"2022-04-28T14:41:44.946061+0000","last_became_peered":"2022-04-28T14:41:44.946061+0000","last_unstale":"2022-04-28T14:41:53.892697+0000","last_undegraded":"2022-04-28T14:41:53.892697+0000","last_fullsized":"2022-04-28T14:41:53.892697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"34'2","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.963416+0000","last_change":"2022-04-28T14:41:43.929902+0000","last_active":"2022-04-28T14:41:52.963416+0000","last_peered":"2022-04-28T14:41:52.963416+0000","last_clean":"2022-04-28T14:41:52.963416+0000","last_became_active":"2022-04-28T14:41:43.929564+0000","last_became_peered":"2022-04-28T14:41:43.929564+0000","last_unstale":"2022-04-28T14:41:52.963416+0000","last_undegraded":"2022-04-28T14:41:52.963416+0000","last_fullsized":"2022-04-28T14:41:52.963416+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964269+0000","last_change":"2022-04-28T14:41:44.930278+0000","last_active":"2022-04-28T14:41:52.964269+0000","last_peered":"2022-04-28T14:41:52.964269+0000","last_clean":"2022-04-28T14:41:52.964269+0000","last_became_active":"2022-04-28T14:41:44.929926+0000","last_became_peered":"2022-04-28T14:41:44.929926+0000","last_unstale":"2022-04-28T14:41:52.964269+0000","last_undegraded":"2022-04-28T14:41:52.964269+0000","last_fullsized":"2022-04-28T14:41:52.964269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.963180+0000","last_change":"2022-04-28T14:41:43.934602+0000","last_active":"2022-04-28T14:41:52.963180+0000","last_peered":"2022-04-28T14:41:52.963180+0000","last_clean":"2022-04-28T14:41:52.963180+0000","last_became_active":"2022-04-28T14:41:43.933840+0000","last_became_peered":"2022-04-28T14:41:43.933840+0000","last_unstale":"2022-04-28T14:41:52.963180+0000","last_undegraded":"2022-04-28T14:41:52.963180+0000","last_fullsized":"2022-04-28T14:41:52.963180+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.893100+0000","last_change":"2022-04-28T14:41:45.918878+0000","last_active":"2022-04-28T14:41:53.893100+0000","last_peered":"2022-04-28T14:41:53.893100+0000","last_clean":"2022-04-28T14:41:53.893100+0000","last_became_active":"2022-04-28T14:41:45.918588+0000","last_became_peered":"2022-04-28T14:41:45.918588+0000","last_unstale":"2022-04-28T14:41:53.893100+0000","last_undegraded":"2022-04-28T14:41:53.893100+0000","last_fullsized":"2022-04-28T14:41:53.893100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961340+0000","last_change":"2022-04-28T14:41:43.936054+0000","last_active":"2022-04-28T14:41:52.961340+0000","last_peered":"2022-04-28T14:41:52.961340+0000","last_clean":"2022-04-28T14:41:52.961340+0000","last_became_active":"2022-04-28T14:41:43.935725+0000","last_became_peered":"2022-04-28T14:41:43.935725+0000","last_unstale":"2022-04-28T14:41:52.961340+0000","last_undegraded":"2022-04-28T14:41:52.961340+0000","last_fullsized":"2022-04-28T14:41:52.961340+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964688+0000","last_change":"2022-04-28T14:41:45.922826+0000","last_active":"2022-04-28T14:41:52.964688+0000","last_peered":"2022-04-28T14:41:52.964688+0000","last_clean":"2022-04-28T14:41:52.964688+0000","last_became_active":"2022-04-28T14:41:45.922332+0000","last_became_peered":"2022-04-28T14:41:45.922332+0000","last_unstale":"2022-04-28T14:41:52.964688+0000","last_undegraded":"2022-04-28T14:41:52.964688+0000","last_fullsized":"2022-04-28T14:41:52.964688+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964527+0000","last_change":"2022-04-28T14:41:45.927039+0000","last_active":"2022-04-28T14:41:52.964527+0000","last_peered":"2022-04-28T14:41:52.964527+0000","last_clean":"2022-04-28T14:41:52.964527+0000","last_became_active":"2022-04-28T14:41:45.926737+0000","last_became_peered":"2022-04-28T14:41:45.926737+0000","last_unstale":"2022-04-28T14:41:52.964527+0000","last_undegraded":"2022-04-28T14:41:52.964527+0000","last_fullsized":"2022-04-28T14:41:52.964527+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961804+0000","last_change":"2022-04-28T14:41:43.936626+0000","last_active":"2022-04-28T14:41:52.961804+0000","last_peered":"2022-04-28T14:41:52.961804+0000","last_clean":"2022-04-28T14:41:52.961804+0000","last_became_active":"2022-04-28T14:41:43.936256+0000","last_became_peered":"2022-04-28T14:41:43.936256+0000","last_unstale":"2022-04-28T14:41:52.961804+0000","last_undegraded":"2022-04-28T14:41:52.961804+0000","last_fullsized":"2022-04-28T14:41:52.961804+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.962062+0000","last_change":"2022-04-28T14:41:43.935916+0000","last_active":"2022-04-28T14:41:52.962062+0000","last_peered":"2022-04-28T14:41:52.962062+0000","last_clean":"2022-04-28T14:41:52.962062+0000","last_became_active":"2022-04-28T14:41:43.935526+0000","last_became_peered":"2022-04-28T14:41:43.935526+0000","last_unstale":"2022-04-28T14:41:52.962062+0000","last_undegraded":"2022-04-28T14:41:52.962062+0000","last_fullsized":"2022-04-28T14:41:52.962062+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":8616,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":19,"num_read_kb":20,"num_write":115,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":17232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":30,"seq":128849018885,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":5872,"kb_used_data":360,"kb_used_omap":12,"kb_used_meta":5491,"kb_avail":94365968,"statfs":{"total":96636764160,"available":96630751232,"internally_reserved":0,"allocated":368640,"data_stored":152586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12626,"internal_metadata":5623470},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]}]},{"osd":1,"up_from":28,"seq":120259084293,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":5664,"kb_used_data":344,"kb_used_omap":13,"kb_used_meta":5298,"kb_avail":94366176,"statfs":{"total":96636764160,"available":96630964224,"internally_reserved":0,"allocated":352256,"data_stored":146118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13413,"internal_metadata":5426075},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]}]},{"osd":2,"up_from":29,"seq":124554051589,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":5532,"kb_used_data":340,"kb_used_omap":11,"kb_used_meta":5172,"kb_avail":94366308,"statfs":{"total":96636764160,"available":96631099392,"internally_reserved":0,"allocated":348160,"data_stored":145554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11905,"internal_metadata":5296511},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]}]},{"osd":0,"up_from":27,"seq":115964116997,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":5868,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":94365972,"statfs":{"total":96636764160,"available":96630755328,"internally_reserved":0,"allocated":364544,"data_stored":151926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":7848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-04-28T14:41:59.582 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-04-28T14:41:59.701 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.696+0000 7f113b9e6700 1 Processor -- start 2022-04-28T14:41:59.701 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.696+0000 7f113b9e6700 1 -- start start 2022-04-28T14:41:59.703 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.697+0000 7f113b9e6700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1134063e20 0x7f113409a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:59.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.697+0000 7f113b9e6700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1134099420 0x7f1134097ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:59.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.697+0000 7f113b9e6700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f113409c6b0 0x7f113409cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:59.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.697+0000 7f113b9e6700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1134064200 con 0x7f1134099420 2022-04-28T14:41:59.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.697+0000 7f113b9e6700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11340988b0 con 0x7f113409c6b0 2022-04-28T14:41:59.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.697+0000 7f113b9e6700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1134098b50 con 0x7f1134063e20 2022-04-28T14:41:59.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.697+0000 7f1139782700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1134063e20 0x7f113409a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:59.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.697+0000 7f1138f81700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1134099420 0x7f1134097ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:59.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.697+0000 7f1139f83700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f113409c6b0 0x7f113409cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:59.704 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.697+0000 7f1139782700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1134063e20 0x7f113409a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48728/0 (socket says 172.21.15.22:48728) 2022-04-28T14:41:59.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.697+0000 7f1139f83700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f113409c6b0 0x7f113409cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48948/0 (socket says 172.21.15.22:48948) 2022-04-28T14:41:59.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.697+0000 7f1138f81700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1134099420 0x7f1134097ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51376/0 (socket says 172.21.15.22:51376) 2022-04-28T14:41:59.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.697+0000 7f1139782700 1 -- 172.21.15.22:0/3216420339 learned_addr learned my addr 172.21.15.22:0/3216420339 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:59.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.697+0000 7f1139782700 1 -- 172.21.15.22:0/3216420339 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f113409c6b0 msgr2=0x7f113409cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:59.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.697+0000 7f1139782700 1 --2- 172.21.15.22:0/3216420339 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f113409c6b0 0x7f113409cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:59.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.697+0000 7f1139782700 1 -- 172.21.15.22:0/3216420339 >> v2:172.21.15.22:3300/0 conn(0x7f1134099420 msgr2=0x7f1134097ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:41:59.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.697+0000 7f1139782700 1 --2- 172.21.15.22:0/3216420339 >> v2:172.21.15.22:3300/0 conn(0x7f1134099420 0x7f1134097ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:59.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.697+0000 7f1139782700 1 -- 172.21.15.22:0/3216420339 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1134099840 con 0x7f1134063e20 2022-04-28T14:41:59.705 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.697+0000 7f1139f83700 1 --2- 172.21.15.22:0/3216420339 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f113409c6b0 0x7f113409cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:59.706 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.697+0000 7f1138f81700 1 --2- 172.21.15.22:0/3216420339 >> v2:172.21.15.22:3300/0 conn(0x7f1134099420 0x7f1134097ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:41:59.706 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.697+0000 7f1139782700 1 --2- 172.21.15.22:0/3216420339 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1134063e20 0x7f113409a6e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f1124006fd0 tx=0x7f112400b3b0).ready entity=mon.2 client_cookie=70d436d53568d64 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:59.706 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.698+0000 7f1123fff700 1 -- 172.21.15.22:0/3216420339 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112400da70 con 0x7f1134063e20 2022-04-28T14:41:59.706 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.698+0000 7f1123fff700 1 -- 172.21.15.22:0/3216420339 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112400dbd0 con 0x7f1134063e20 2022-04-28T14:41:59.706 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.698+0000 7f1123fff700 1 -- 172.21.15.22:0/3216420339 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1124010470 con 0x7f1134063e20 2022-04-28T14:41:59.706 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.698+0000 7f113b9e6700 1 -- 172.21.15.22:0/3216420339 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1134063e20 msgr2=0x7f113409a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:59.706 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.698+0000 7f113b9e6700 1 --2- 172.21.15.22:0/3216420339 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1134063e20 0x7f113409a6e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f1124006fd0 tx=0x7f112400b3b0).stop 2022-04-28T14:41:59.706 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.698+0000 7f113b9e6700 1 -- 172.21.15.22:0/3216420339 shutdown_connections 2022-04-28T14:41:59.706 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.698+0000 7f113b9e6700 1 --2- 172.21.15.22:0/3216420339 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f113409c6b0 0x7f113409cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:59.706 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.698+0000 7f113b9e6700 1 --2- 172.21.15.22:0/3216420339 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1134063e20 0x7f113409a6e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:59.707 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.698+0000 7f113b9e6700 1 --2- 172.21.15.22:0/3216420339 >> v2:172.21.15.22:3300/0 conn(0x7f1134099420 0x7f1134097ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:59.707 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.698+0000 7f113b9e6700 1 -- 172.21.15.22:0/3216420339 >> 172.21.15.22:0/3216420339 conn(0x7f11340aaf80 msgr2=0x7f11340ab390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:59.707 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.698+0000 7f113b9e6700 1 -- 172.21.15.22:0/3216420339 shutdown_connections 2022-04-28T14:41:59.707 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.698+0000 7f113b9e6700 1 -- 172.21.15.22:0/3216420339 wait complete. 2022-04-28T14:41:59.707 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.699+0000 7f113b9e6700 1 Processor -- start 2022-04-28T14:41:59.707 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.699+0000 7f113b9e6700 1 -- start start 2022-04-28T14:41:59.709 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.700+0000 7f113b9e6700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1134063e20 0x7f11340a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:59.710 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.700+0000 7f113b9e6700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1134099420 0x7f113409ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:59.710 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.700+0000 7f113b9e6700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f113409c6b0 0x7f1134146ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:41:59.710 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.700+0000 7f113b9e6700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11340a0910 con 0x7f113409c6b0 2022-04-28T14:41:59.710 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.700+0000 7f113b9e6700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113409f600 con 0x7f1134099420 2022-04-28T14:41:59.710 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.700+0000 7f113b9e6700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f113409e9b0 con 0x7f1134063e20 2022-04-28T14:41:59.710 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.700+0000 7f1138f81700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1134099420 0x7f113409ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:59.710 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.700+0000 7f1138f81700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1134099420 0x7f113409ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48952/0 (socket says 172.21.15.22:48952) 2022-04-28T14:41:59.710 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.700+0000 7f1138f81700 1 -- 172.21.15.22:0/2262464979 learned_addr learned my addr 172.21.15.22:0/2262464979 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:41:59.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.700+0000 7f1139f83700 1 --2- 172.21.15.22:0/2262464979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f113409c6b0 0x7f1134146ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:59.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.700+0000 7f1139782700 1 --2- 172.21.15.22:0/2262464979 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1134063e20 0x7f11340a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:41:59.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.700+0000 7f1138f81700 1 -- 172.21.15.22:0/2262464979 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1134063e20 msgr2=0x7f11340a12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:59.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.700+0000 7f1138f81700 1 --2- 172.21.15.22:0/2262464979 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1134063e20 0x7f11340a12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:59.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.700+0000 7f1138f81700 1 -- 172.21.15.22:0/2262464979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f113409c6b0 msgr2=0x7f1134146ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:59.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.700+0000 7f1138f81700 1 --2- 172.21.15.22:0/2262464979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f113409c6b0 0x7f1134146ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:59.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.700+0000 7f1138f81700 1 -- 172.21.15.22:0/2262464979 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11300092a0 con 0x7f1134099420 2022-04-28T14:41:59.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.700+0000 7f1138f81700 1 --2- 172.21.15.22:0/2262464979 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1134099420 0x7f113409ed10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f113000e9d0 tx=0x7f1130009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:41:59.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.701+0000 7f11217fa700 1 -- 172.21.15.22:0/2262464979 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113000eec0 con 0x7f1134099420 2022-04-28T14:41:59.711 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.701+0000 7f11217fa700 1 -- 172.21.15.22:0/2262464979 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113000c850 con 0x7f1134099420 2022-04-28T14:41:59.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.701+0000 7f113b9e6700 1 -- 172.21.15.22:0/2262464979 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f112c009a20 con 0x7f1134099420 2022-04-28T14:41:59.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.701+0000 7f11217fa700 1 -- 172.21.15.22:0/2262464979 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113000cbd0 con 0x7f1134099420 2022-04-28T14:41:59.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.701+0000 7f113b9e6700 1 -- 172.21.15.22:0/2262464979 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f112400b610 con 0x7f1134099420 2022-04-28T14:41:59.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.702+0000 7f113b9e6700 1 -- 172.21.15.22:0/2262464979 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1134098ff0 con 0x7f1134099420 2022-04-28T14:41:59.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.702+0000 7f11217fa700 1 -- 172.21.15.22:0/2262464979 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f1130022070 con 0x7f1134099420 2022-04-28T14:41:59.712 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.702+0000 7f11217fa700 1 -- 172.21.15.22:0/2262464979 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7f11300558e0 con 0x7f1134099420 2022-04-28T14:41:59.713 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.705+0000 7f11217fa700 1 -- 172.21.15.22:0/2262464979 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f1130036090 con 0x7f1134099420 2022-04-28T14:41:59.844 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.840+0000 7f113b9e6700 1 -- 172.21.15.22:0/2262464979 --> v1:172.21.15.22:6808/92758 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1134066da0 con 0x7f1114041b00 2022-04-28T14:41:59.852 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.848+0000 7f11217fa700 1 -- 172.21.15.22:0/2262464979 <== mgr.14100 v1:172.21.15.22:6808/92758 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+321090 (unknown 2965378022 0 1198718481) 0x7f1134066da0 con 0x7f1114041b00 2022-04-28T14:41:59.856 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:41:59.859 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.851+0000 7f113b9e6700 1 -- 172.21.15.22:0/2262464979 >> v1:172.21.15.22:6808/92758 conn(0x7f1114041b00 legacy=0x7f1114043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:59.859 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.851+0000 7f113b9e6700 1 -- 172.21.15.22:0/2262464979 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1134099420 msgr2=0x7f113409ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:41:59.859 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.851+0000 7f113b9e6700 1 --2- 172.21.15.22:0/2262464979 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1134099420 0x7f113409ed10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f113000e9d0 tx=0x7f1130009060).stop 2022-04-28T14:41:59.860 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.851+0000 7f113b9e6700 1 -- 172.21.15.22:0/2262464979 shutdown_connections 2022-04-28T14:41:59.860 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.851+0000 7f113b9e6700 1 --2- 172.21.15.22:0/2262464979 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f113409c6b0 0x7f1134146ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:59.860 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.851+0000 7f113b9e6700 1 --2- 172.21.15.22:0/2262464979 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f1134063e20 0x7f11340a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:59.860 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.851+0000 7f113b9e6700 1 --2- 172.21.15.22:0/2262464979 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f1134099420 0x7f113409ed10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:41:59.860 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.851+0000 7f113b9e6700 1 -- 172.21.15.22:0/2262464979 >> 172.21.15.22:0/2262464979 conn(0x7f11340aaf80 msgr2=0x7f11340aa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:41:59.860 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.851+0000 7f113b9e6700 1 -- 172.21.15.22:0/2262464979 shutdown_connections 2022-04-28T14:41:59.860 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:41:59.851+0000 7f113b9e6700 1 -- 172.21.15.22:0/2262464979 wait complete. 2022-04-28T14:41:59.860 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2022-04-28T14:41:59.867 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2022-04-28T14:41:59.148425+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8616,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":19,"num_read_kb":20,"num_write":116,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":106,"ondisk_log_size":106,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":22936,"kb_used_data":1400,"kb_used_omap":37,"kb_used_meta":21466,"kb_avail":377464424,"statfs":{"total":386547056640,"available":386523570176,"internally_reserved":0,"allocated":1433600,"data_stored":596184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37944,"internal_metadata":21982152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":272,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":14,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.196974"},"pg_stats":[{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959499+0000","last_change":"2022-04-28T14:41:44.934416+0000","last_active":"2022-04-28T14:41:52.959499+0000","last_peered":"2022-04-28T14:41:52.959499+0000","last_clean":"2022-04-28T14:41:52.959499+0000","last_became_active":"2022-04-28T14:41:44.934108+0000","last_became_peered":"2022-04-28T14:41:44.934108+0000","last_unstale":"2022-04-28T14:41:52.959499+0000","last_undegraded":"2022-04-28T14:41:52.959499+0000","last_fullsized":"2022-04-28T14:41:52.959499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"17'9","reported_seq":53,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959671+0000","last_change":"2022-04-28T14:41:45.931291+0000","last_active":"2022-04-28T14:41:52.959671+0000","last_peered":"2022-04-28T14:41:52.959671+0000","last_clean":"2022-04-28T14:41:52.959671+0000","last_became_active":"2022-04-28T14:41:45.930533+0000","last_became_peered":"2022-04-28T14:41:45.930533+0000","last_unstale":"2022-04-28T14:41:52.959671+0000","last_undegraded":"2022-04-28T14:41:52.959671+0000","last_fullsized":"2022-04-28T14:41:52.959671+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2190,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.962956+0000","last_change":"2022-04-28T14:41:45.927790+0000","last_active":"2022-04-28T14:41:52.962956+0000","last_peered":"2022-04-28T14:41:52.962956+0000","last_clean":"2022-04-28T14:41:52.962956+0000","last_became_active":"2022-04-28T14:41:45.926775+0000","last_became_peered":"2022-04-28T14:41:45.926775+0000","last_unstale":"2022-04-28T14:41:52.962956+0000","last_undegraded":"2022-04-28T14:41:52.962956+0000","last_fullsized":"2022-04-28T14:41:52.962956+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960102+0000","last_change":"2022-04-28T14:41:45.919663+0000","last_active":"2022-04-28T14:41:52.960102+0000","last_peered":"2022-04-28T14:41:52.960102+0000","last_clean":"2022-04-28T14:41:52.960102+0000","last_became_active":"2022-04-28T14:41:45.919261+0000","last_became_peered":"2022-04-28T14:41:45.919261+0000","last_unstale":"2022-04-28T14:41:52.960102+0000","last_undegraded":"2022-04-28T14:41:52.960102+0000","last_fullsized":"2022-04-28T14:41:52.960102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959756+0000","last_change":"2022-04-28T14:41:45.927911+0000","last_active":"2022-04-28T14:41:52.959756+0000","last_peered":"2022-04-28T14:41:52.959756+0000","last_clean":"2022-04-28T14:41:52.959756+0000","last_became_active":"2022-04-28T14:41:45.927631+0000","last_became_peered":"2022-04-28T14:41:45.927631+0000","last_unstale":"2022-04-28T14:41:52.959756+0000","last_undegraded":"2022-04-28T14:41:52.959756+0000","last_fullsized":"2022-04-28T14:41:52.959756+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960428+0000","last_change":"2022-04-28T14:41:45.919167+0000","last_active":"2022-04-28T14:41:52.960428+0000","last_peered":"2022-04-28T14:41:52.960428+0000","last_clean":"2022-04-28T14:41:52.960428+0000","last_became_active":"2022-04-28T14:41:45.918846+0000","last_became_peered":"2022-04-28T14:41:45.918846+0000","last_unstale":"2022-04-28T14:41:52.960428+0000","last_undegraded":"2022-04-28T14:41:52.960428+0000","last_fullsized":"2022-04-28T14:41:52.960428+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.958967+0000","last_change":"2022-04-28T14:41:45.926475+0000","last_active":"2022-04-28T14:41:52.958967+0000","last_peered":"2022-04-28T14:41:52.958967+0000","last_clean":"2022-04-28T14:41:52.958967+0000","last_became_active":"2022-04-28T14:41:45.926034+0000","last_became_peered":"2022-04-28T14:41:45.926034+0000","last_unstale":"2022-04-28T14:41:52.958967+0000","last_undegraded":"2022-04-28T14:41:52.958967+0000","last_fullsized":"2022-04-28T14:41:52.958967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959786+0000","last_change":"2022-04-28T14:41:45.939303+0000","last_active":"2022-04-28T14:41:52.959786+0000","last_peered":"2022-04-28T14:41:52.959786+0000","last_clean":"2022-04-28T14:41:52.959786+0000","last_became_active":"2022-04-28T14:41:45.938732+0000","last_became_peered":"2022-04-28T14:41:45.938732+0000","last_unstale":"2022-04-28T14:41:52.959786+0000","last_undegraded":"2022-04-28T14:41:52.959786+0000","last_fullsized":"2022-04-28T14:41:52.959786+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.893351+0000","last_change":"2022-04-28T14:41:45.923129+0000","last_active":"2022-04-28T14:41:53.893351+0000","last_peered":"2022-04-28T14:41:53.893351+0000","last_clean":"2022-04-28T14:41:53.893351+0000","last_became_active":"2022-04-28T14:41:45.922124+0000","last_became_peered":"2022-04-28T14:41:45.922124+0000","last_unstale":"2022-04-28T14:41:53.893351+0000","last_undegraded":"2022-04-28T14:41:53.893351+0000","last_fullsized":"2022-04-28T14:41:53.893351+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"17'7","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961948+0000","last_change":"2022-04-28T14:41:44.933426+0000","last_active":"2022-04-28T14:41:52.961948+0000","last_peered":"2022-04-28T14:41:52.961948+0000","last_clean":"2022-04-28T14:41:52.961948+0000","last_became_active":"2022-04-28T14:41:44.930226+0000","last_became_peered":"2022-04-28T14:41:44.930226+0000","last_unstale":"2022-04-28T14:41:52.961948+0000","last_undegraded":"2022-04-28T14:41:52.961948+0000","last_fullsized":"2022-04-28T14:41:52.961948+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964982+0000","last_change":"2022-04-28T14:41:45.927393+0000","last_active":"2022-04-28T14:41:52.964982+0000","last_peered":"2022-04-28T14:41:52.964982+0000","last_clean":"2022-04-28T14:41:52.964982+0000","last_became_active":"2022-04-28T14:41:45.927113+0000","last_became_peered":"2022-04-28T14:41:45.927113+0000","last_unstale":"2022-04-28T14:41:52.964982+0000","last_undegraded":"2022-04-28T14:41:52.964982+0000","last_fullsized":"2022-04-28T14:41:52.964982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964390+0000","last_change":"2022-04-28T14:41:43.934513+0000","last_active":"2022-04-28T14:41:52.964390+0000","last_peered":"2022-04-28T14:41:52.964390+0000","last_clean":"2022-04-28T14:41:52.964390+0000","last_became_active":"2022-04-28T14:41:43.933829+0000","last_became_peered":"2022-04-28T14:41:43.933829+0000","last_unstale":"2022-04-28T14:41:52.964390+0000","last_undegraded":"2022-04-28T14:41:52.964390+0000","last_fullsized":"2022-04-28T14:41:52.964390+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960332+0000","last_change":"2022-04-28T14:41:45.929077+0000","last_active":"2022-04-28T14:41:52.960332+0000","last_peered":"2022-04-28T14:41:52.960332+0000","last_clean":"2022-04-28T14:41:52.960332+0000","last_became_active":"2022-04-28T14:41:45.928564+0000","last_became_peered":"2022-04-28T14:41:45.928564+0000","last_unstale":"2022-04-28T14:41:52.960332+0000","last_undegraded":"2022-04-28T14:41:52.960332+0000","last_fullsized":"2022-04-28T14:41:52.960332+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"16'4","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961213+0000","last_change":"2022-04-28T14:41:45.935835+0000","last_active":"2022-04-28T14:41:52.961213+0000","last_peered":"2022-04-28T14:41:52.961213+0000","last_clean":"2022-04-28T14:41:52.961213+0000","last_became_active":"2022-04-28T14:41:45.935207+0000","last_became_peered":"2022-04-28T14:41:45.935207+0000","last_unstale":"2022-04-28T14:41:52.961213+0000","last_undegraded":"2022-04-28T14:41:52.961213+0000","last_fullsized":"2022-04-28T14:41:52.961213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964524+0000","last_change":"2022-04-28T14:41:45.921280+0000","last_active":"2022-04-28T14:41:52.964524+0000","last_peered":"2022-04-28T14:41:52.964524+0000","last_clean":"2022-04-28T14:41:52.964524+0000","last_became_active":"2022-04-28T14:41:45.920652+0000","last_became_peered":"2022-04-28T14:41:45.920652+0000","last_unstale":"2022-04-28T14:41:52.964524+0000","last_undegraded":"2022-04-28T14:41:52.964524+0000","last_fullsized":"2022-04-28T14:41:52.964524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"36'5","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.892966+0000","last_change":"2022-04-28T14:41:45.914460+0000","last_active":"2022-04-28T14:41:53.892966+0000","last_peered":"2022-04-28T14:41:53.892966+0000","last_clean":"2022-04-28T14:41:53.892966+0000","last_became_active":"2022-04-28T14:41:45.914150+0000","last_became_peered":"2022-04-28T14:41:45.914150+0000","last_unstale":"2022-04-28T14:41:53.892966+0000","last_undegraded":"2022-04-28T14:41:53.892966+0000","last_fullsized":"2022-04-28T14:41:53.892966+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":634,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.963025+0000","last_change":"2022-04-28T14:41:45.927213+0000","last_active":"2022-04-28T14:41:52.963025+0000","last_peered":"2022-04-28T14:41:52.963025+0000","last_clean":"2022-04-28T14:41:52.963025+0000","last_became_active":"2022-04-28T14:41:45.926934+0000","last_became_peered":"2022-04-28T14:41:45.926934+0000","last_unstale":"2022-04-28T14:41:52.963025+0000","last_undegraded":"2022-04-28T14:41:52.963025+0000","last_fullsized":"2022-04-28T14:41:52.963025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"16'3","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.963214+0000","last_change":"2022-04-28T14:41:45.928157+0000","last_active":"2022-04-28T14:41:52.963214+0000","last_peered":"2022-04-28T14:41:52.963214+0000","last_clean":"2022-04-28T14:41:52.963214+0000","last_became_active":"2022-04-28T14:41:45.927485+0000","last_became_peered":"2022-04-28T14:41:45.927485+0000","last_unstale":"2022-04-28T14:41:52.963214+0000","last_undegraded":"2022-04-28T14:41:52.963214+0000","last_fullsized":"2022-04-28T14:41:52.963214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960158+0000","last_change":"2022-04-28T14:41:45.931460+0000","last_active":"2022-04-28T14:41:52.960158+0000","last_peered":"2022-04-28T14:41:52.960158+0000","last_clean":"2022-04-28T14:41:52.960158+0000","last_became_active":"2022-04-28T14:41:45.930955+0000","last_became_peered":"2022-04-28T14:41:45.930955+0000","last_unstale":"2022-04-28T14:41:52.960158+0000","last_undegraded":"2022-04-28T14:41:52.960158+0000","last_fullsized":"2022-04-28T14:41:52.960158+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"16'3","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960438+0000","last_change":"2022-04-28T14:41:45.924773+0000","last_active":"2022-04-28T14:41:52.960438+0000","last_peered":"2022-04-28T14:41:52.960438+0000","last_clean":"2022-04-28T14:41:52.960438+0000","last_became_active":"2022-04-28T14:41:45.924504+0000","last_became_peered":"2022-04-28T14:41:45.924504+0000","last_unstale":"2022-04-28T14:41:52.960438+0000","last_undegraded":"2022-04-28T14:41:52.960438+0000","last_fullsized":"2022-04-28T14:41:52.960438+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.958963+0000","last_change":"2022-04-28T14:41:43.929322+0000","last_active":"2022-04-28T14:41:52.958963+0000","last_peered":"2022-04-28T14:41:52.958963+0000","last_clean":"2022-04-28T14:41:52.958963+0000","last_became_active":"2022-04-28T14:41:43.929096+0000","last_became_peered":"2022-04-28T14:41:43.929096+0000","last_unstale":"2022-04-28T14:41:52.958963+0000","last_undegraded":"2022-04-28T14:41:52.958963+0000","last_fullsized":"2022-04-28T14:41:52.958963+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.963166+0000","last_change":"2022-04-28T14:41:45.920916+0000","last_active":"2022-04-28T14:41:52.963166+0000","last_peered":"2022-04-28T14:41:52.963166+0000","last_clean":"2022-04-28T14:41:52.963166+0000","last_became_active":"2022-04-28T14:41:45.920621+0000","last_became_peered":"2022-04-28T14:41:45.920621+0000","last_unstale":"2022-04-28T14:41:52.963166+0000","last_undegraded":"2022-04-28T14:41:52.963166+0000","last_fullsized":"2022-04-28T14:41:52.963166+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959433+0000","last_change":"2022-04-28T14:41:45.925058+0000","last_active":"2022-04-28T14:41:52.959433+0000","last_peered":"2022-04-28T14:41:52.959433+0000","last_clean":"2022-04-28T14:41:52.959433+0000","last_became_active":"2022-04-28T14:41:45.924431+0000","last_became_peered":"2022-04-28T14:41:45.924431+0000","last_unstale":"2022-04-28T14:41:52.959433+0000","last_undegraded":"2022-04-28T14:41:52.959433+0000","last_fullsized":"2022-04-28T14:41:52.959433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"15'4","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.892330+0000","last_change":"2022-04-28T14:41:44.931965+0000","last_active":"2022-04-28T14:41:53.892330+0000","last_peered":"2022-04-28T14:41:53.892330+0000","last_clean":"2022-04-28T14:41:53.892330+0000","last_became_active":"2022-04-28T14:41:44.931368+0000","last_became_peered":"2022-04-28T14:41:44.931368+0000","last_unstale":"2022-04-28T14:41:53.892330+0000","last_undegraded":"2022-04-28T14:41:53.892330+0000","last_fullsized":"2022-04-28T14:41:53.892330+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.893268+0000","last_change":"2022-04-28T14:41:44.948003+0000","last_active":"2022-04-28T14:41:53.893268+0000","last_peered":"2022-04-28T14:41:53.893268+0000","last_clean":"2022-04-28T14:41:53.893268+0000","last_became_active":"2022-04-28T14:41:44.939336+0000","last_became_peered":"2022-04-28T14:41:44.939336+0000","last_unstale":"2022-04-28T14:41:53.893268+0000","last_undegraded":"2022-04-28T14:41:53.893268+0000","last_fullsized":"2022-04-28T14:41:53.893268+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964488+0000","last_change":"2022-04-28T14:41:43.935719+0000","last_active":"2022-04-28T14:41:52.964488+0000","last_peered":"2022-04-28T14:41:52.964488+0000","last_clean":"2022-04-28T14:41:52.964488+0000","last_became_active":"2022-04-28T14:41:43.934180+0000","last_became_peered":"2022-04-28T14:41:43.934180+0000","last_unstale":"2022-04-28T14:41:52.964488+0000","last_undegraded":"2022-04-28T14:41:52.964488+0000","last_fullsized":"2022-04-28T14:41:52.964488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964798+0000","last_change":"2022-04-28T14:41:43.935879+0000","last_active":"2022-04-28T14:41:52.964798+0000","last_peered":"2022-04-28T14:41:52.964798+0000","last_clean":"2022-04-28T14:41:52.964798+0000","last_became_active":"2022-04-28T14:41:43.934746+0000","last_became_peered":"2022-04-28T14:41:43.934746+0000","last_unstale":"2022-04-28T14:41:52.964798+0000","last_undegraded":"2022-04-28T14:41:52.964798+0000","last_fullsized":"2022-04-28T14:41:52.964798+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.893457+0000","last_change":"2022-04-28T14:41:45.923492+0000","last_active":"2022-04-28T14:41:53.893457+0000","last_peered":"2022-04-28T14:41:53.893457+0000","last_clean":"2022-04-28T14:41:53.893457+0000","last_became_active":"2022-04-28T14:41:45.922641+0000","last_became_peered":"2022-04-28T14:41:45.922641+0000","last_unstale":"2022-04-28T14:41:53.893457+0000","last_undegraded":"2022-04-28T14:41:53.893457+0000","last_fullsized":"2022-04-28T14:41:53.893457+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.963408+0000","last_change":"2022-04-28T14:41:45.924090+0000","last_active":"2022-04-28T14:41:52.963408+0000","last_peered":"2022-04-28T14:41:52.963408+0000","last_clean":"2022-04-28T14:41:52.963408+0000","last_became_active":"2022-04-28T14:41:45.923798+0000","last_became_peered":"2022-04-28T14:41:45.923798+0000","last_unstale":"2022-04-28T14:41:52.963408+0000","last_undegraded":"2022-04-28T14:41:52.963408+0000","last_fullsized":"2022-04-28T14:41:52.963408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961392+0000","last_change":"2022-04-28T14:41:45.935788+0000","last_active":"2022-04-28T14:41:52.961392+0000","last_peered":"2022-04-28T14:41:52.961392+0000","last_clean":"2022-04-28T14:41:52.961392+0000","last_became_active":"2022-04-28T14:41:45.935188+0000","last_became_peered":"2022-04-28T14:41:45.935188+0000","last_unstale":"2022-04-28T14:41:52.961392+0000","last_undegraded":"2022-04-28T14:41:52.961392+0000","last_fullsized":"2022-04-28T14:41:52.961392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960380+0000","last_change":"2022-04-28T14:41:45.926324+0000","last_active":"2022-04-28T14:41:52.960380+0000","last_peered":"2022-04-28T14:41:52.960380+0000","last_clean":"2022-04-28T14:41:52.960380+0000","last_became_active":"2022-04-28T14:41:45.925869+0000","last_became_peered":"2022-04-28T14:41:45.925869+0000","last_unstale":"2022-04-28T14:41:52.960380+0000","last_undegraded":"2022-04-28T14:41:52.960380+0000","last_fullsized":"2022-04-28T14:41:52.960380+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.893234+0000","last_change":"2022-04-28T14:41:44.947883+0000","last_active":"2022-04-28T14:41:53.893234+0000","last_peered":"2022-04-28T14:41:53.893234+0000","last_clean":"2022-04-28T14:41:53.893234+0000","last_became_active":"2022-04-28T14:41:44.939732+0000","last_became_peered":"2022-04-28T14:41:44.939732+0000","last_unstale":"2022-04-28T14:41:53.893234+0000","last_undegraded":"2022-04-28T14:41:53.893234+0000","last_fullsized":"2022-04-28T14:41:53.893234+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960653+0000","last_change":"2022-04-28T14:41:45.937304+0000","last_active":"2022-04-28T14:41:52.960653+0000","last_peered":"2022-04-28T14:41:52.960653+0000","last_clean":"2022-04-28T14:41:52.960653+0000","last_became_active":"2022-04-28T14:41:45.937008+0000","last_became_peered":"2022-04-28T14:41:45.937008+0000","last_unstale":"2022-04-28T14:41:52.960653+0000","last_undegraded":"2022-04-28T14:41:52.960653+0000","last_fullsized":"2022-04-28T14:41:52.960653+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"15'1","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960239+0000","last_change":"2022-04-28T14:41:45.929284+0000","last_active":"2022-04-28T14:41:52.960239+0000","last_peered":"2022-04-28T14:41:52.960239+0000","last_clean":"2022-04-28T14:41:52.960239+0000","last_became_active":"2022-04-28T14:41:45.928853+0000","last_became_peered":"2022-04-28T14:41:45.928853+0000","last_unstale":"2022-04-28T14:41:52.960239+0000","last_undegraded":"2022-04-28T14:41:52.960239+0000","last_fullsized":"2022-04-28T14:41:52.960239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959811+0000","last_change":"2022-04-28T14:41:45.931460+0000","last_active":"2022-04-28T14:41:52.959811+0000","last_peered":"2022-04-28T14:41:52.959811+0000","last_clean":"2022-04-28T14:41:52.959811+0000","last_became_active":"2022-04-28T14:41:45.930906+0000","last_became_peered":"2022-04-28T14:41:45.930906+0000","last_unstale":"2022-04-28T14:41:52.959811+0000","last_undegraded":"2022-04-28T14:41:52.959811+0000","last_fullsized":"2022-04-28T14:41:52.959811+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959583+0000","last_change":"2022-04-28T14:41:45.936694+0000","last_active":"2022-04-28T14:41:52.959583+0000","last_peered":"2022-04-28T14:41:52.959583+0000","last_clean":"2022-04-28T14:41:52.959583+0000","last_became_active":"2022-04-28T14:41:45.936358+0000","last_became_peered":"2022-04-28T14:41:45.936358+0000","last_unstale":"2022-04-28T14:41:52.959583+0000","last_undegraded":"2022-04-28T14:41:52.959583+0000","last_fullsized":"2022-04-28T14:41:52.959583+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959193+0000","last_change":"2022-04-28T14:41:45.939118+0000","last_active":"2022-04-28T14:41:52.959193+0000","last_peered":"2022-04-28T14:41:52.959193+0000","last_clean":"2022-04-28T14:41:52.959193+0000","last_became_active":"2022-04-28T14:41:45.938026+0000","last_became_peered":"2022-04-28T14:41:45.938026+0000","last_unstale":"2022-04-28T14:41:52.959193+0000","last_undegraded":"2022-04-28T14:41:52.959193+0000","last_fullsized":"2022-04-28T14:41:52.959193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"16'3","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959193+0000","last_change":"2022-04-28T14:41:43.935902+0000","last_active":"2022-04-28T14:41:52.959193+0000","last_peered":"2022-04-28T14:41:52.959193+0000","last_clean":"2022-04-28T14:41:52.959193+0000","last_became_active":"2022-04-28T14:41:43.935543+0000","last_became_peered":"2022-04-28T14:41:43.935543+0000","last_unstale":"2022-04-28T14:41:52.959193+0000","last_undegraded":"2022-04-28T14:41:52.959193+0000","last_fullsized":"2022-04-28T14:41:52.959193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960317+0000","last_change":"2022-04-28T14:41:45.925021+0000","last_active":"2022-04-28T14:41:52.960317+0000","last_peered":"2022-04-28T14:41:52.960317+0000","last_clean":"2022-04-28T14:41:52.960317+0000","last_became_active":"2022-04-28T14:41:45.924776+0000","last_became_peered":"2022-04-28T14:41:45.924776+0000","last_unstale":"2022-04-28T14:41:52.960317+0000","last_undegraded":"2022-04-28T14:41:52.960317+0000","last_fullsized":"2022-04-28T14:41:52.960317+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.962692+0000","last_change":"2022-04-28T14:41:44.937267+0000","last_active":"2022-04-28T14:41:52.962692+0000","last_peered":"2022-04-28T14:41:52.962692+0000","last_clean":"2022-04-28T14:41:52.962692+0000","last_became_active":"2022-04-28T14:41:44.936726+0000","last_became_peered":"2022-04-28T14:41:44.936726+0000","last_unstale":"2022-04-28T14:41:52.962692+0000","last_undegraded":"2022-04-28T14:41:52.962692+0000","last_fullsized":"2022-04-28T14:41:52.962692+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"20'1","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959633+0000","last_change":"2022-04-28T14:41:45.939493+0000","last_active":"2022-04-28T14:41:52.959633+0000","last_peered":"2022-04-28T14:41:52.959633+0000","last_clean":"2022-04-28T14:41:52.959633+0000","last_became_active":"2022-04-28T14:41:45.938801+0000","last_became_peered":"2022-04-28T14:41:45.938801+0000","last_unstale":"2022-04-28T14:41:52.959633+0000","last_undegraded":"2022-04-28T14:41:52.959633+0000","last_fullsized":"2022-04-28T14:41:52.959633+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:41:26.135911+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:41:26.135911+0000","last_clean_scrub_stamp":"2022-04-28T14:41:26.135911+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960549+0000","last_change":"2022-04-28T14:41:45.926215+0000","last_active":"2022-04-28T14:41:52.960549+0000","last_peered":"2022-04-28T14:41:52.960549+0000","last_clean":"2022-04-28T14:41:52.960549+0000","last_became_active":"2022-04-28T14:41:45.925932+0000","last_became_peered":"2022-04-28T14:41:45.925932+0000","last_unstale":"2022-04-28T14:41:52.960549+0000","last_undegraded":"2022-04-28T14:41:52.960549+0000","last_fullsized":"2022-04-28T14:41:52.960549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.893221+0000","last_change":"2022-04-28T14:41:45.920379+0000","last_active":"2022-04-28T14:41:53.893221+0000","last_peered":"2022-04-28T14:41:53.893221+0000","last_clean":"2022-04-28T14:41:53.893221+0000","last_became_active":"2022-04-28T14:41:45.919929+0000","last_became_peered":"2022-04-28T14:41:45.919929+0000","last_unstale":"2022-04-28T14:41:53.893221+0000","last_undegraded":"2022-04-28T14:41:53.893221+0000","last_fullsized":"2022-04-28T14:41:53.893221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961560+0000","last_change":"2022-04-28T14:41:43.929313+0000","last_active":"2022-04-28T14:41:52.961560+0000","last_peered":"2022-04-28T14:41:52.961560+0000","last_clean":"2022-04-28T14:41:52.961560+0000","last_became_active":"2022-04-28T14:41:43.928992+0000","last_became_peered":"2022-04-28T14:41:43.928992+0000","last_unstale":"2022-04-28T14:41:52.961560+0000","last_undegraded":"2022-04-28T14:41:52.961560+0000","last_fullsized":"2022-04-28T14:41:52.961560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964561+0000","last_change":"2022-04-28T14:41:43.934741+0000","last_active":"2022-04-28T14:41:52.964561+0000","last_peered":"2022-04-28T14:41:52.964561+0000","last_clean":"2022-04-28T14:41:52.964561+0000","last_became_active":"2022-04-28T14:41:43.934176+0000","last_became_peered":"2022-04-28T14:41:43.934176+0000","last_unstale":"2022-04-28T14:41:52.964561+0000","last_undegraded":"2022-04-28T14:41:52.964561+0000","last_fullsized":"2022-04-28T14:41:52.964561+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959848+0000","last_change":"2022-04-28T14:41:45.921659+0000","last_active":"2022-04-28T14:41:52.959848+0000","last_peered":"2022-04-28T14:41:52.959848+0000","last_clean":"2022-04-28T14:41:52.959848+0000","last_became_active":"2022-04-28T14:41:45.921070+0000","last_became_peered":"2022-04-28T14:41:45.921070+0000","last_unstale":"2022-04-28T14:41:52.959848+0000","last_undegraded":"2022-04-28T14:41:52.959848+0000","last_fullsized":"2022-04-28T14:41:52.959848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959979+0000","last_change":"2022-04-28T14:41:45.920804+0000","last_active":"2022-04-28T14:41:52.959979+0000","last_peered":"2022-04-28T14:41:52.959979+0000","last_clean":"2022-04-28T14:41:52.959979+0000","last_became_active":"2022-04-28T14:41:45.920305+0000","last_became_peered":"2022-04-28T14:41:45.920305+0000","last_unstale":"2022-04-28T14:41:52.959979+0000","last_undegraded":"2022-04-28T14:41:52.959979+0000","last_fullsized":"2022-04-28T14:41:52.959979+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.958864+0000","last_change":"2022-04-28T14:41:44.931126+0000","last_active":"2022-04-28T14:41:52.958864+0000","last_peered":"2022-04-28T14:41:52.958864+0000","last_clean":"2022-04-28T14:41:52.958864+0000","last_became_active":"2022-04-28T14:41:44.930679+0000","last_became_peered":"2022-04-28T14:41:44.930679+0000","last_unstale":"2022-04-28T14:41:52.958864+0000","last_undegraded":"2022-04-28T14:41:52.958864+0000","last_fullsized":"2022-04-28T14:41:52.958864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'1","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959026+0000","last_change":"2022-04-28T14:41:45.939154+0000","last_active":"2022-04-28T14:41:52.959026+0000","last_peered":"2022-04-28T14:41:52.959026+0000","last_clean":"2022-04-28T14:41:52.959026+0000","last_became_active":"2022-04-28T14:41:45.938396+0000","last_became_peered":"2022-04-28T14:41:45.938396+0000","last_unstale":"2022-04-28T14:41:52.959026+0000","last_undegraded":"2022-04-28T14:41:52.959026+0000","last_fullsized":"2022-04-28T14:41:52.959026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.963101+0000","last_change":"2022-04-28T14:41:44.938186+0000","last_active":"2022-04-28T14:41:52.963101+0000","last_peered":"2022-04-28T14:41:52.963101+0000","last_clean":"2022-04-28T14:41:52.963101+0000","last_became_active":"2022-04-28T14:41:44.937871+0000","last_became_peered":"2022-04-28T14:41:44.937871+0000","last_unstale":"2022-04-28T14:41:52.963101+0000","last_undegraded":"2022-04-28T14:41:52.963101+0000","last_fullsized":"2022-04-28T14:41:52.963101+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.962767+0000","last_change":"2022-04-28T14:41:43.929510+0000","last_active":"2022-04-28T14:41:52.962767+0000","last_peered":"2022-04-28T14:41:52.962767+0000","last_clean":"2022-04-28T14:41:52.962767+0000","last_became_active":"2022-04-28T14:41:43.929204+0000","last_became_peered":"2022-04-28T14:41:43.929204+0000","last_unstale":"2022-04-28T14:41:52.962767+0000","last_undegraded":"2022-04-28T14:41:52.962767+0000","last_fullsized":"2022-04-28T14:41:52.962767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"16'1","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.892400+0000","last_change":"2022-04-28T14:41:45.924049+0000","last_active":"2022-04-28T14:41:53.892400+0000","last_peered":"2022-04-28T14:41:53.892400+0000","last_clean":"2022-04-28T14:41:53.892400+0000","last_became_active":"2022-04-28T14:41:45.920694+0000","last_became_peered":"2022-04-28T14:41:45.920694+0000","last_unstale":"2022-04-28T14:41:53.892400+0000","last_undegraded":"2022-04-28T14:41:53.892400+0000","last_fullsized":"2022-04-28T14:41:53.892400+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959189+0000","last_change":"2022-04-28T14:41:44.930830+0000","last_active":"2022-04-28T14:41:52.959189+0000","last_peered":"2022-04-28T14:41:52.959189+0000","last_clean":"2022-04-28T14:41:52.959189+0000","last_became_active":"2022-04-28T14:41:44.930545+0000","last_became_peered":"2022-04-28T14:41:44.930545+0000","last_unstale":"2022-04-28T14:41:52.959189+0000","last_undegraded":"2022-04-28T14:41:52.959189+0000","last_fullsized":"2022-04-28T14:41:52.959189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.958351+0000","last_change":"2022-04-28T14:41:43.929762+0000","last_active":"2022-04-28T14:41:52.958351+0000","last_peered":"2022-04-28T14:41:52.958351+0000","last_clean":"2022-04-28T14:41:52.958351+0000","last_became_active":"2022-04-28T14:41:43.929422+0000","last_became_peered":"2022-04-28T14:41:43.929422+0000","last_unstale":"2022-04-28T14:41:52.958351+0000","last_undegraded":"2022-04-28T14:41:52.958351+0000","last_fullsized":"2022-04-28T14:41:52.958351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'3","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959556+0000","last_change":"2022-04-28T14:41:45.929159+0000","last_active":"2022-04-28T14:41:52.959556+0000","last_peered":"2022-04-28T14:41:52.959556+0000","last_clean":"2022-04-28T14:41:52.959556+0000","last_became_active":"2022-04-28T14:41:45.928488+0000","last_became_peered":"2022-04-28T14:41:45.928488+0000","last_unstale":"2022-04-28T14:41:52.959556+0000","last_undegraded":"2022-04-28T14:41:52.959556+0000","last_fullsized":"2022-04-28T14:41:52.959556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959475+0000","last_change":"2022-04-28T14:41:45.913037+0000","last_active":"2022-04-28T14:41:52.959475+0000","last_peered":"2022-04-28T14:41:52.959475+0000","last_clean":"2022-04-28T14:41:52.959475+0000","last_became_active":"2022-04-28T14:41:45.912757+0000","last_became_peered":"2022-04-28T14:41:45.912757+0000","last_unstale":"2022-04-28T14:41:52.959475+0000","last_undegraded":"2022-04-28T14:41:52.959475+0000","last_fullsized":"2022-04-28T14:41:52.959475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959013+0000","last_change":"2022-04-28T14:41:45.919657+0000","last_active":"2022-04-28T14:41:52.959013+0000","last_peered":"2022-04-28T14:41:52.959013+0000","last_clean":"2022-04-28T14:41:52.959013+0000","last_became_active":"2022-04-28T14:41:45.919190+0000","last_became_peered":"2022-04-28T14:41:45.919190+0000","last_unstale":"2022-04-28T14:41:52.959013+0000","last_undegraded":"2022-04-28T14:41:52.959013+0000","last_fullsized":"2022-04-28T14:41:52.959013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960751+0000","last_change":"2022-04-28T14:41:45.937351+0000","last_active":"2022-04-28T14:41:52.960751+0000","last_peered":"2022-04-28T14:41:52.960751+0000","last_clean":"2022-04-28T14:41:52.960751+0000","last_became_active":"2022-04-28T14:41:45.937056+0000","last_became_peered":"2022-04-28T14:41:45.937056+0000","last_unstale":"2022-04-28T14:41:52.960751+0000","last_undegraded":"2022-04-28T14:41:52.960751+0000","last_fullsized":"2022-04-28T14:41:52.960751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.963130+0000","last_change":"2022-04-28T14:41:44.937509+0000","last_active":"2022-04-28T14:41:52.963130+0000","last_peered":"2022-04-28T14:41:52.963130+0000","last_clean":"2022-04-28T14:41:52.963130+0000","last_became_active":"2022-04-28T14:41:44.937184+0000","last_became_peered":"2022-04-28T14:41:44.937184+0000","last_unstale":"2022-04-28T14:41:52.963130+0000","last_undegraded":"2022-04-28T14:41:52.963130+0000","last_fullsized":"2022-04-28T14:41:52.963130+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959927+0000","last_change":"2022-04-28T14:41:45.918958+0000","last_active":"2022-04-28T14:41:52.959927+0000","last_peered":"2022-04-28T14:41:52.959927+0000","last_clean":"2022-04-28T14:41:52.959927+0000","last_became_active":"2022-04-28T14:41:45.918666+0000","last_became_peered":"2022-04-28T14:41:45.918666+0000","last_unstale":"2022-04-28T14:41:52.959927+0000","last_undegraded":"2022-04-28T14:41:52.959927+0000","last_fullsized":"2022-04-28T14:41:52.959927+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959984+0000","last_change":"2022-04-28T14:41:45.923175+0000","last_active":"2022-04-28T14:41:52.959984+0000","last_peered":"2022-04-28T14:41:52.959984+0000","last_clean":"2022-04-28T14:41:52.959984+0000","last_became_active":"2022-04-28T14:41:45.922408+0000","last_became_peered":"2022-04-28T14:41:45.922408+0000","last_unstale":"2022-04-28T14:41:52.959984+0000","last_undegraded":"2022-04-28T14:41:52.959984+0000","last_fullsized":"2022-04-28T14:41:52.959984+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961161+0000","last_change":"2022-04-28T14:41:44.934084+0000","last_active":"2022-04-28T14:41:52.961161+0000","last_peered":"2022-04-28T14:41:52.961161+0000","last_clean":"2022-04-28T14:41:52.961161+0000","last_became_active":"2022-04-28T14:41:44.930208+0000","last_became_peered":"2022-04-28T14:41:44.930208+0000","last_unstale":"2022-04-28T14:41:52.961161+0000","last_undegraded":"2022-04-28T14:41:52.961161+0000","last_fullsized":"2022-04-28T14:41:52.961161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961716+0000","last_change":"2022-04-28T14:41:45.926604+0000","last_active":"2022-04-28T14:41:52.961716+0000","last_peered":"2022-04-28T14:41:52.961716+0000","last_clean":"2022-04-28T14:41:52.961716+0000","last_became_active":"2022-04-28T14:41:45.926289+0000","last_became_peered":"2022-04-28T14:41:45.926289+0000","last_unstale":"2022-04-28T14:41:52.961716+0000","last_undegraded":"2022-04-28T14:41:52.961716+0000","last_fullsized":"2022-04-28T14:41:52.961716+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:04.377361+0000","last_clean_scrub_stamp":"2022-04-28T14:39:04.377361+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960663+0000","last_change":"2022-04-28T14:41:43.936705+0000","last_active":"2022-04-28T14:41:52.960663+0000","last_peered":"2022-04-28T14:41:52.960663+0000","last_clean":"2022-04-28T14:41:52.960663+0000","last_became_active":"2022-04-28T14:41:43.936257+0000","last_became_peered":"2022-04-28T14:41:43.936257+0000","last_unstale":"2022-04-28T14:41:52.960663+0000","last_undegraded":"2022-04-28T14:41:52.960663+0000","last_fullsized":"2022-04-28T14:41:52.960663+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.893162+0000","last_change":"2022-04-28T14:41:45.920198+0000","last_active":"2022-04-28T14:41:53.893162+0000","last_peered":"2022-04-28T14:41:53.893162+0000","last_clean":"2022-04-28T14:41:53.893162+0000","last_became_active":"2022-04-28T14:41:45.919589+0000","last_became_peered":"2022-04-28T14:41:45.919589+0000","last_unstale":"2022-04-28T14:41:53.893162+0000","last_undegraded":"2022-04-28T14:41:53.893162+0000","last_fullsized":"2022-04-28T14:41:53.893162+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960952+0000","last_change":"2022-04-28T14:41:45.929830+0000","last_active":"2022-04-28T14:41:52.960952+0000","last_peered":"2022-04-28T14:41:52.960952+0000","last_clean":"2022-04-28T14:41:52.960952+0000","last_became_active":"2022-04-28T14:41:45.929543+0000","last_became_peered":"2022-04-28T14:41:45.929543+0000","last_unstale":"2022-04-28T14:41:52.960952+0000","last_undegraded":"2022-04-28T14:41:52.960952+0000","last_fullsized":"2022-04-28T14:41:52.960952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.963402+0000","last_change":"2022-04-28T14:41:43.935382+0000","last_active":"2022-04-28T14:41:52.963402+0000","last_peered":"2022-04-28T14:41:52.963402+0000","last_clean":"2022-04-28T14:41:52.963402+0000","last_became_active":"2022-04-28T14:41:43.934889+0000","last_became_peered":"2022-04-28T14:41:43.934889+0000","last_unstale":"2022-04-28T14:41:52.963402+0000","last_undegraded":"2022-04-28T14:41:52.963402+0000","last_fullsized":"2022-04-28T14:41:52.963402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961420+0000","last_change":"2022-04-28T14:41:43.936831+0000","last_active":"2022-04-28T14:41:52.961420+0000","last_peered":"2022-04-28T14:41:52.961420+0000","last_clean":"2022-04-28T14:41:52.961420+0000","last_became_active":"2022-04-28T14:41:43.936375+0000","last_became_peered":"2022-04-28T14:41:43.936375+0000","last_unstale":"2022-04-28T14:41:52.961420+0000","last_undegraded":"2022-04-28T14:41:52.961420+0000","last_fullsized":"2022-04-28T14:41:52.961420+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964276+0000","last_change":"2022-04-28T14:41:43.933641+0000","last_active":"2022-04-28T14:41:52.964276+0000","last_peered":"2022-04-28T14:41:52.964276+0000","last_clean":"2022-04-28T14:41:52.964276+0000","last_became_active":"2022-04-28T14:41:43.933285+0000","last_became_peered":"2022-04-28T14:41:43.933285+0000","last_unstale":"2022-04-28T14:41:52.964276+0000","last_undegraded":"2022-04-28T14:41:52.964276+0000","last_fullsized":"2022-04-28T14:41:52.964276+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964880+0000","last_change":"2022-04-28T14:41:43.935902+0000","last_active":"2022-04-28T14:41:52.964880+0000","last_peered":"2022-04-28T14:41:52.964880+0000","last_clean":"2022-04-28T14:41:52.964880+0000","last_became_active":"2022-04-28T14:41:43.935588+0000","last_became_peered":"2022-04-28T14:41:43.935588+0000","last_unstale":"2022-04-28T14:41:52.964880+0000","last_undegraded":"2022-04-28T14:41:52.964880+0000","last_fullsized":"2022-04-28T14:41:52.964880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"34'2","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961498+0000","last_change":"2022-04-28T14:41:45.928326+0000","last_active":"2022-04-28T14:41:52.961498+0000","last_peered":"2022-04-28T14:41:52.961498+0000","last_clean":"2022-04-28T14:41:52.961498+0000","last_became_active":"2022-04-28T14:41:45.928009+0000","last_became_peered":"2022-04-28T14:41:45.928009+0000","last_unstale":"2022-04-28T14:41:52.961498+0000","last_undegraded":"2022-04-28T14:41:52.961498+0000","last_fullsized":"2022-04-28T14:41:52.961498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961725+0000","last_change":"2022-04-28T14:41:45.932474+0000","last_active":"2022-04-28T14:41:52.961725+0000","last_peered":"2022-04-28T14:41:52.961725+0000","last_clean":"2022-04-28T14:41:52.961725+0000","last_became_active":"2022-04-28T14:41:45.931952+0000","last_became_peered":"2022-04-28T14:41:45.931952+0000","last_unstale":"2022-04-28T14:41:52.961725+0000","last_undegraded":"2022-04-28T14:41:52.961725+0000","last_fullsized":"2022-04-28T14:41:52.961725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"34'2","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964711+0000","last_change":"2022-04-28T14:41:45.922641+0000","last_active":"2022-04-28T14:41:52.964711+0000","last_peered":"2022-04-28T14:41:52.964711+0000","last_clean":"2022-04-28T14:41:52.964711+0000","last_became_active":"2022-04-28T14:41:45.921979+0000","last_became_peered":"2022-04-28T14:41:45.921979+0000","last_unstale":"2022-04-28T14:41:52.964711+0000","last_undegraded":"2022-04-28T14:41:52.964711+0000","last_fullsized":"2022-04-28T14:41:52.964711+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.892696+0000","last_change":"2022-04-28T14:41:44.930876+0000","last_active":"2022-04-28T14:41:53.892696+0000","last_peered":"2022-04-28T14:41:53.892696+0000","last_clean":"2022-04-28T14:41:53.892696+0000","last_became_active":"2022-04-28T14:41:44.930402+0000","last_became_peered":"2022-04-28T14:41:44.930402+0000","last_unstale":"2022-04-28T14:41:53.892696+0000","last_undegraded":"2022-04-28T14:41:53.892696+0000","last_fullsized":"2022-04-28T14:41:53.892696+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.20","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959330+0000","last_change":"2022-04-28T14:41:45.938922+0000","last_active":"2022-04-28T14:41:52.959330+0000","last_peered":"2022-04-28T14:41:52.959330+0000","last_clean":"2022-04-28T14:41:52.959330+0000","last_became_active":"2022-04-28T14:41:45.938004+0000","last_became_peered":"2022-04-28T14:41:45.938004+0000","last_unstale":"2022-04-28T14:41:52.959330+0000","last_undegraded":"2022-04-28T14:41:52.959330+0000","last_fullsized":"2022-04-28T14:41:52.959330+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.892393+0000","last_change":"2022-04-28T14:41:44.945035+0000","last_active":"2022-04-28T14:41:53.892393+0000","last_peered":"2022-04-28T14:41:53.892393+0000","last_clean":"2022-04-28T14:41:53.892393+0000","last_became_active":"2022-04-28T14:41:44.938814+0000","last_became_peered":"2022-04-28T14:41:44.938814+0000","last_unstale":"2022-04-28T14:41:53.892393+0000","last_undegraded":"2022-04-28T14:41:53.892393+0000","last_fullsized":"2022-04-28T14:41:53.892393+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.21","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.892743+0000","last_change":"2022-04-28T14:41:44.946296+0000","last_active":"2022-04-28T14:41:53.892743+0000","last_peered":"2022-04-28T14:41:53.892743+0000","last_clean":"2022-04-28T14:41:53.892743+0000","last_became_active":"2022-04-28T14:41:44.945985+0000","last_became_peered":"2022-04-28T14:41:44.945985+0000","last_unstale":"2022-04-28T14:41:53.892743+0000","last_undegraded":"2022-04-28T14:41:53.892743+0000","last_fullsized":"2022-04-28T14:41:53.892743+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.963487+0000","last_change":"2022-04-28T14:41:45.927954+0000","last_active":"2022-04-28T14:41:52.963487+0000","last_peered":"2022-04-28T14:41:52.963487+0000","last_clean":"2022-04-28T14:41:52.963487+0000","last_became_active":"2022-04-28T14:41:45.927121+0000","last_became_peered":"2022-04-28T14:41:45.927121+0000","last_unstale":"2022-04-28T14:41:52.963487+0000","last_undegraded":"2022-04-28T14:41:52.963487+0000","last_fullsized":"2022-04-28T14:41:52.963487+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.22","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960250+0000","last_change":"2022-04-28T14:41:45.928068+0000","last_active":"2022-04-28T14:41:52.960250+0000","last_peered":"2022-04-28T14:41:52.960250+0000","last_clean":"2022-04-28T14:41:52.960250+0000","last_became_active":"2022-04-28T14:41:45.927687+0000","last_became_peered":"2022-04-28T14:41:45.927687+0000","last_unstale":"2022-04-28T14:41:52.960250+0000","last_undegraded":"2022-04-28T14:41:52.960250+0000","last_fullsized":"2022-04-28T14:41:52.960250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960552+0000","last_change":"2022-04-28T14:41:45.929786+0000","last_active":"2022-04-28T14:41:52.960552+0000","last_peered":"2022-04-28T14:41:52.960552+0000","last_clean":"2022-04-28T14:41:52.960552+0000","last_became_active":"2022-04-28T14:41:45.929519+0000","last_became_peered":"2022-04-28T14:41:45.929519+0000","last_unstale":"2022-04-28T14:41:52.960552+0000","last_undegraded":"2022-04-28T14:41:52.960552+0000","last_fullsized":"2022-04-28T14:41:52.960552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.23","version":"0'0","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960111+0000","last_change":"2022-04-28T14:41:45.936838+0000","last_active":"2022-04-28T14:41:52.960111+0000","last_peered":"2022-04-28T14:41:52.960111+0000","last_clean":"2022-04-28T14:41:52.960111+0000","last_became_active":"2022-04-28T14:41:45.936515+0000","last_became_peered":"2022-04-28T14:41:45.936515+0000","last_unstale":"2022-04-28T14:41:52.960111+0000","last_undegraded":"2022-04-28T14:41:52.960111+0000","last_fullsized":"2022-04-28T14:41:52.960111+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961516+0000","last_change":"2022-04-28T14:41:45.935972+0000","last_active":"2022-04-28T14:41:52.961516+0000","last_peered":"2022-04-28T14:41:52.961516+0000","last_clean":"2022-04-28T14:41:52.961516+0000","last_became_active":"2022-04-28T14:41:45.935521+0000","last_became_peered":"2022-04-28T14:41:45.935521+0000","last_unstale":"2022-04-28T14:41:52.961516+0000","last_undegraded":"2022-04-28T14:41:52.961516+0000","last_fullsized":"2022-04-28T14:41:52.961516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.24","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961594+0000","last_change":"2022-04-28T14:41:43.936857+0000","last_active":"2022-04-28T14:41:52.961594+0000","last_peered":"2022-04-28T14:41:52.961594+0000","last_clean":"2022-04-28T14:41:52.961594+0000","last_became_active":"2022-04-28T14:41:43.936580+0000","last_became_peered":"2022-04-28T14:41:43.936580+0000","last_unstale":"2022-04-28T14:41:52.961594+0000","last_undegraded":"2022-04-28T14:41:52.961594+0000","last_fullsized":"2022-04-28T14:41:52.961594+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960074+0000","last_change":"2022-04-28T14:41:45.921839+0000","last_active":"2022-04-28T14:41:52.960074+0000","last_peered":"2022-04-28T14:41:52.960074+0000","last_clean":"2022-04-28T14:41:52.960074+0000","last_became_active":"2022-04-28T14:41:45.921397+0000","last_became_peered":"2022-04-28T14:41:45.921397+0000","last_unstale":"2022-04-28T14:41:52.960074+0000","last_undegraded":"2022-04-28T14:41:52.960074+0000","last_fullsized":"2022-04-28T14:41:52.960074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.25","version":"16'1","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.893295+0000","last_change":"2022-04-28T14:41:44.939386+0000","last_active":"2022-04-28T14:41:53.893295+0000","last_peered":"2022-04-28T14:41:53.893295+0000","last_clean":"2022-04-28T14:41:53.893295+0000","last_became_active":"2022-04-28T14:41:44.938959+0000","last_became_peered":"2022-04-28T14:41:44.938959+0000","last_unstale":"2022-04-28T14:41:53.893295+0000","last_undegraded":"2022-04-28T14:41:53.893295+0000","last_fullsized":"2022-04-28T14:41:53.893295+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960435+0000","last_change":"2022-04-28T14:41:45.935801+0000","last_active":"2022-04-28T14:41:52.960435+0000","last_peered":"2022-04-28T14:41:52.960435+0000","last_clean":"2022-04-28T14:41:52.960435+0000","last_became_active":"2022-04-28T14:41:45.935389+0000","last_became_peered":"2022-04-28T14:41:45.935389+0000","last_unstale":"2022-04-28T14:41:52.960435+0000","last_undegraded":"2022-04-28T14:41:52.960435+0000","last_fullsized":"2022-04-28T14:41:52.960435+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.26","version":"17'3","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964884+0000","last_change":"2022-04-28T14:41:45.925593+0000","last_active":"2022-04-28T14:41:52.964884+0000","last_peered":"2022-04-28T14:41:52.964884+0000","last_clean":"2022-04-28T14:41:52.964884+0000","last_became_active":"2022-04-28T14:41:45.925071+0000","last_became_peered":"2022-04-28T14:41:45.925071+0000","last_unstale":"2022-04-28T14:41:52.964884+0000","last_undegraded":"2022-04-28T14:41:52.964884+0000","last_fullsized":"2022-04-28T14:41:52.964884+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.893392+0000","last_change":"2022-04-28T14:41:45.923312+0000","last_active":"2022-04-28T14:41:53.893392+0000","last_peered":"2022-04-28T14:41:53.893392+0000","last_clean":"2022-04-28T14:41:53.893392+0000","last_became_active":"2022-04-28T14:41:45.922271+0000","last_became_peered":"2022-04-28T14:41:45.922271+0000","last_unstale":"2022-04-28T14:41:53.893392+0000","last_undegraded":"2022-04-28T14:41:53.893392+0000","last_fullsized":"2022-04-28T14:41:53.893392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.27","version":"16'2","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960963+0000","last_change":"2022-04-28T14:41:45.938022+0000","last_active":"2022-04-28T14:41:52.960963+0000","last_peered":"2022-04-28T14:41:52.960963+0000","last_clean":"2022-04-28T14:41:52.960963+0000","last_became_active":"2022-04-28T14:41:45.937746+0000","last_became_peered":"2022-04-28T14:41:45.937746+0000","last_unstale":"2022-04-28T14:41:52.960963+0000","last_undegraded":"2022-04-28T14:41:52.960963+0000","last_fullsized":"2022-04-28T14:41:52.960963+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959329+0000","last_change":"2022-04-28T14:41:45.924919+0000","last_active":"2022-04-28T14:41:52.959329+0000","last_peered":"2022-04-28T14:41:52.959329+0000","last_clean":"2022-04-28T14:41:52.959329+0000","last_became_active":"2022-04-28T14:41:45.924096+0000","last_became_peered":"2022-04-28T14:41:45.924096+0000","last_unstale":"2022-04-28T14:41:52.959329+0000","last_undegraded":"2022-04-28T14:41:52.959329+0000","last_fullsized":"2022-04-28T14:41:52.959329+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.28","version":"16'2","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959556+0000","last_change":"2022-04-28T14:41:45.939314+0000","last_active":"2022-04-28T14:41:52.959556+0000","last_peered":"2022-04-28T14:41:52.959556+0000","last_clean":"2022-04-28T14:41:52.959556+0000","last_became_active":"2022-04-28T14:41:45.938409+0000","last_became_peered":"2022-04-28T14:41:45.938409+0000","last_unstale":"2022-04-28T14:41:52.959556+0000","last_undegraded":"2022-04-28T14:41:52.959556+0000","last_fullsized":"2022-04-28T14:41:52.959556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959876+0000","last_change":"2022-04-28T14:41:45.925058+0000","last_active":"2022-04-28T14:41:52.959876+0000","last_peered":"2022-04-28T14:41:52.959876+0000","last_clean":"2022-04-28T14:41:52.959876+0000","last_became_active":"2022-04-28T14:41:45.924600+0000","last_became_peered":"2022-04-28T14:41:45.924600+0000","last_unstale":"2022-04-28T14:41:52.959876+0000","last_undegraded":"2022-04-28T14:41:52.959876+0000","last_fullsized":"2022-04-28T14:41:52.959876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.29","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959066+0000","last_change":"2022-04-28T14:41:45.926318+0000","last_active":"2022-04-28T14:41:52.959066+0000","last_peered":"2022-04-28T14:41:52.959066+0000","last_clean":"2022-04-28T14:41:52.959066+0000","last_became_active":"2022-04-28T14:41:45.925741+0000","last_became_peered":"2022-04-28T14:41:45.925741+0000","last_unstale":"2022-04-28T14:41:52.959066+0000","last_undegraded":"2022-04-28T14:41:52.959066+0000","last_fullsized":"2022-04-28T14:41:52.959066+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.963319+0000","last_change":"2022-04-28T14:41:44.935067+0000","last_active":"2022-04-28T14:41:52.963319+0000","last_peered":"2022-04-28T14:41:52.963319+0000","last_clean":"2022-04-28T14:41:52.963319+0000","last_became_active":"2022-04-28T14:41:44.934787+0000","last_became_peered":"2022-04-28T14:41:44.934787+0000","last_unstale":"2022-04-28T14:41:52.963319+0000","last_undegraded":"2022-04-28T14:41:52.963319+0000","last_fullsized":"2022-04-28T14:41:52.963319+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2a","version":"17'4","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.958956+0000","last_change":"2022-04-28T14:41:43.937297+0000","last_active":"2022-04-28T14:41:52.958956+0000","last_peered":"2022-04-28T14:41:52.958956+0000","last_clean":"2022-04-28T14:41:52.958956+0000","last_became_active":"2022-04-28T14:41:43.937003+0000","last_became_peered":"2022-04-28T14:41:43.937003+0000","last_unstale":"2022-04-28T14:41:52.958956+0000","last_undegraded":"2022-04-28T14:41:52.958956+0000","last_fullsized":"2022-04-28T14:41:52.958956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959402+0000","last_change":"2022-04-28T14:41:43.937199+0000","last_active":"2022-04-28T14:41:52.959402+0000","last_peered":"2022-04-28T14:41:52.959402+0000","last_clean":"2022-04-28T14:41:52.959402+0000","last_became_active":"2022-04-28T14:41:43.936795+0000","last_became_peered":"2022-04-28T14:41:43.936795+0000","last_unstale":"2022-04-28T14:41:52.959402+0000","last_undegraded":"2022-04-28T14:41:52.959402+0000","last_fullsized":"2022-04-28T14:41:52.959402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2b","version":"34'4","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.893006+0000","last_change":"2022-04-28T14:41:45.919269+0000","last_active":"2022-04-28T14:41:53.893006+0000","last_peered":"2022-04-28T14:41:53.893006+0000","last_clean":"2022-04-28T14:41:53.893006+0000","last_became_active":"2022-04-28T14:41:45.918916+0000","last_became_peered":"2022-04-28T14:41:45.918916+0000","last_unstale":"2022-04-28T14:41:53.893006+0000","last_undegraded":"2022-04-28T14:41:53.893006+0000","last_fullsized":"2022-04-28T14:41:53.893006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960526+0000","last_change":"2022-04-28T14:41:45.926152+0000","last_active":"2022-04-28T14:41:52.960526+0000","last_peered":"2022-04-28T14:41:52.960526+0000","last_clean":"2022-04-28T14:41:52.960526+0000","last_became_active":"2022-04-28T14:41:45.925302+0000","last_became_peered":"2022-04-28T14:41:45.925302+0000","last_unstale":"2022-04-28T14:41:52.960526+0000","last_undegraded":"2022-04-28T14:41:52.960526+0000","last_fullsized":"2022-04-28T14:41:52.960526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2c","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.892930+0000","last_change":"2022-04-28T14:41:44.940023+0000","last_active":"2022-04-28T14:41:53.892930+0000","last_peered":"2022-04-28T14:41:53.892930+0000","last_clean":"2022-04-28T14:41:53.892930+0000","last_became_active":"2022-04-28T14:41:44.939344+0000","last_became_peered":"2022-04-28T14:41:44.939344+0000","last_unstale":"2022-04-28T14:41:53.892930+0000","last_undegraded":"2022-04-28T14:41:53.892930+0000","last_fullsized":"2022-04-28T14:41:53.892930+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.963520+0000","last_change":"2022-04-28T14:41:43.935203+0000","last_active":"2022-04-28T14:41:52.963520+0000","last_peered":"2022-04-28T14:41:52.963520+0000","last_clean":"2022-04-28T14:41:52.963520+0000","last_became_active":"2022-04-28T14:41:43.934876+0000","last_became_peered":"2022-04-28T14:41:43.934876+0000","last_unstale":"2022-04-28T14:41:52.963520+0000","last_undegraded":"2022-04-28T14:41:52.963520+0000","last_fullsized":"2022-04-28T14:41:52.963520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2d","version":"15'1","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960842+0000","last_change":"2022-04-28T14:41:45.927690+0000","last_active":"2022-04-28T14:41:52.960842+0000","last_peered":"2022-04-28T14:41:52.960842+0000","last_clean":"2022-04-28T14:41:52.960842+0000","last_became_active":"2022-04-28T14:41:45.925615+0000","last_became_peered":"2022-04-28T14:41:45.925615+0000","last_unstale":"2022-04-28T14:41:52.960842+0000","last_undegraded":"2022-04-28T14:41:52.960842+0000","last_fullsized":"2022-04-28T14:41:52.960842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960850+0000","last_change":"2022-04-28T14:41:45.929916+0000","last_active":"2022-04-28T14:41:52.960850+0000","last_peered":"2022-04-28T14:41:52.960850+0000","last_clean":"2022-04-28T14:41:52.960850+0000","last_became_active":"2022-04-28T14:41:45.929638+0000","last_became_peered":"2022-04-28T14:41:45.929638+0000","last_unstale":"2022-04-28T14:41:52.960850+0000","last_undegraded":"2022-04-28T14:41:52.960850+0000","last_fullsized":"2022-04-28T14:41:52.960850+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2e","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961689+0000","last_change":"2022-04-28T14:41:45.927448+0000","last_active":"2022-04-28T14:41:52.961689+0000","last_peered":"2022-04-28T14:41:52.961689+0000","last_clean":"2022-04-28T14:41:52.961689+0000","last_became_active":"2022-04-28T14:41:45.926975+0000","last_became_peered":"2022-04-28T14:41:45.926975+0000","last_unstale":"2022-04-28T14:41:52.961689+0000","last_undegraded":"2022-04-28T14:41:52.961689+0000","last_fullsized":"2022-04-28T14:41:52.961689+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.893247+0000","last_change":"2022-04-28T14:41:45.922943+0000","last_active":"2022-04-28T14:41:53.893247+0000","last_peered":"2022-04-28T14:41:53.893247+0000","last_clean":"2022-04-28T14:41:53.893247+0000","last_became_active":"2022-04-28T14:41:45.921915+0000","last_became_peered":"2022-04-28T14:41:45.921915+0000","last_unstale":"2022-04-28T14:41:53.893247+0000","last_undegraded":"2022-04-28T14:41:53.893247+0000","last_fullsized":"2022-04-28T14:41:53.893247+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2f","version":"0'0","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959782+0000","last_change":"2022-04-28T14:41:45.920514+0000","last_active":"2022-04-28T14:41:52.959782+0000","last_peered":"2022-04-28T14:41:52.959782+0000","last_clean":"2022-04-28T14:41:52.959782+0000","last_became_active":"2022-04-28T14:41:45.919565+0000","last_became_peered":"2022-04-28T14:41:45.919565+0000","last_unstale":"2022-04-28T14:41:52.959782+0000","last_undegraded":"2022-04-28T14:41:52.959782+0000","last_fullsized":"2022-04-28T14:41:52.959782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.958851+0000","last_change":"2022-04-28T14:41:43.929389+0000","last_active":"2022-04-28T14:41:52.958851+0000","last_peered":"2022-04-28T14:41:52.958851+0000","last_clean":"2022-04-28T14:41:52.958851+0000","last_became_active":"2022-04-28T14:41:43.929060+0000","last_became_peered":"2022-04-28T14:41:43.929060+0000","last_unstale":"2022-04-28T14:41:52.958851+0000","last_undegraded":"2022-04-28T14:41:52.958851+0000","last_fullsized":"2022-04-28T14:41:52.958851+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.30","version":"16'6","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.962553+0000","last_change":"2022-04-28T14:41:43.935035+0000","last_active":"2022-04-28T14:41:52.962553+0000","last_peered":"2022-04-28T14:41:52.962553+0000","last_clean":"2022-04-28T14:41:52.962553+0000","last_became_active":"2022-04-28T14:41:43.933871+0000","last_became_peered":"2022-04-28T14:41:43.933871+0000","last_unstale":"2022-04-28T14:41:52.962553+0000","last_undegraded":"2022-04-28T14:41:52.962553+0000","last_fullsized":"2022-04-28T14:41:52.962553+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959444+0000","last_change":"2022-04-28T14:41:45.924876+0000","last_active":"2022-04-28T14:41:52.959444+0000","last_peered":"2022-04-28T14:41:52.959444+0000","last_clean":"2022-04-28T14:41:52.959444+0000","last_became_active":"2022-04-28T14:41:45.924268+0000","last_became_peered":"2022-04-28T14:41:45.924268+0000","last_unstale":"2022-04-28T14:41:52.959444+0000","last_undegraded":"2022-04-28T14:41:52.959444+0000","last_fullsized":"2022-04-28T14:41:52.959444+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.31","version":"0'0","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.962735+0000","last_change":"2022-04-28T14:41:43.934742+0000","last_active":"2022-04-28T14:41:52.962735+0000","last_peered":"2022-04-28T14:41:52.962735+0000","last_clean":"2022-04-28T14:41:52.962735+0000","last_became_active":"2022-04-28T14:41:43.934398+0000","last_became_peered":"2022-04-28T14:41:43.934398+0000","last_unstale":"2022-04-28T14:41:52.962735+0000","last_undegraded":"2022-04-28T14:41:52.962735+0000","last_fullsized":"2022-04-28T14:41:52.962735+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959604+0000","last_change":"2022-04-28T14:41:45.931265+0000","last_active":"2022-04-28T14:41:52.959604+0000","last_peered":"2022-04-28T14:41:52.959604+0000","last_clean":"2022-04-28T14:41:52.959604+0000","last_became_active":"2022-04-28T14:41:45.930183+0000","last_became_peered":"2022-04-28T14:41:45.930183+0000","last_unstale":"2022-04-28T14:41:52.959604+0000","last_undegraded":"2022-04-28T14:41:52.959604+0000","last_fullsized":"2022-04-28T14:41:52.959604+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.32","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.892665+0000","last_change":"2022-04-28T14:41:45.916403+0000","last_active":"2022-04-28T14:41:53.892665+0000","last_peered":"2022-04-28T14:41:53.892665+0000","last_clean":"2022-04-28T14:41:53.892665+0000","last_became_active":"2022-04-28T14:41:45.915819+0000","last_became_peered":"2022-04-28T14:41:45.915819+0000","last_unstale":"2022-04-28T14:41:53.892665+0000","last_undegraded":"2022-04-28T14:41:53.892665+0000","last_fullsized":"2022-04-28T14:41:53.892665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.963184+0000","last_change":"2022-04-28T14:41:43.934880+0000","last_active":"2022-04-28T14:41:52.963184+0000","last_peered":"2022-04-28T14:41:52.963184+0000","last_clean":"2022-04-28T14:41:52.963184+0000","last_became_active":"2022-04-28T14:41:43.934485+0000","last_became_peered":"2022-04-28T14:41:43.934485+0000","last_unstale":"2022-04-28T14:41:52.963184+0000","last_undegraded":"2022-04-28T14:41:52.963184+0000","last_fullsized":"2022-04-28T14:41:52.963184+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.33","version":"15'1","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960739+0000","last_change":"2022-04-28T14:41:44.930995+0000","last_active":"2022-04-28T14:41:52.960739+0000","last_peered":"2022-04-28T14:41:52.960739+0000","last_clean":"2022-04-28T14:41:52.960739+0000","last_became_active":"2022-04-28T14:41:44.930298+0000","last_became_peered":"2022-04-28T14:41:44.930298+0000","last_unstale":"2022-04-28T14:41:52.960739+0000","last_undegraded":"2022-04-28T14:41:52.960739+0000","last_fullsized":"2022-04-28T14:41:52.960739+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964519+0000","last_change":"2022-04-28T14:41:45.921459+0000","last_active":"2022-04-28T14:41:52.964519+0000","last_peered":"2022-04-28T14:41:52.964519+0000","last_clean":"2022-04-28T14:41:52.964519+0000","last_became_active":"2022-04-28T14:41:45.920994+0000","last_became_peered":"2022-04-28T14:41:45.920994+0000","last_unstale":"2022-04-28T14:41:52.964519+0000","last_undegraded":"2022-04-28T14:41:52.964519+0000","last_fullsized":"2022-04-28T14:41:52.964519+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.34","version":"35'14","reported_seq":60,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.960203+0000","last_change":"2022-04-28T14:41:45.930704+0000","last_active":"2022-04-28T14:41:52.960203+0000","last_peered":"2022-04-28T14:41:52.960203+0000","last_clean":"2022-04-28T14:41:52.960203+0000","last_became_active":"2022-04-28T14:41:45.930289+0000","last_became_peered":"2022-04-28T14:41:45.930289+0000","last_unstale":"2022-04-28T14:41:52.960203+0000","last_undegraded":"2022-04-28T14:41:52.960203+0000","last_fullsized":"2022-04-28T14:41:52.960203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4286,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":14,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.963292+0000","last_change":"2022-04-28T14:41:43.935169+0000","last_active":"2022-04-28T14:41:52.963292+0000","last_peered":"2022-04-28T14:41:52.963292+0000","last_clean":"2022-04-28T14:41:52.963292+0000","last_became_active":"2022-04-28T14:41:43.934249+0000","last_became_peered":"2022-04-28T14:41:43.934249+0000","last_unstale":"2022-04-28T14:41:52.963292+0000","last_undegraded":"2022-04-28T14:41:52.963292+0000","last_fullsized":"2022-04-28T14:41:52.963292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.35","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961610+0000","last_change":"2022-04-28T14:41:45.936019+0000","last_active":"2022-04-28T14:41:52.961610+0000","last_peered":"2022-04-28T14:41:52.961610+0000","last_clean":"2022-04-28T14:41:52.961610+0000","last_became_active":"2022-04-28T14:41:45.935557+0000","last_became_peered":"2022-04-28T14:41:45.935557+0000","last_unstale":"2022-04-28T14:41:52.961610+0000","last_undegraded":"2022-04-28T14:41:52.961610+0000","last_fullsized":"2022-04-28T14:41:52.961610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961894+0000","last_change":"2022-04-28T14:41:45.926070+0000","last_active":"2022-04-28T14:41:52.961894+0000","last_peered":"2022-04-28T14:41:52.961894+0000","last_clean":"2022-04-28T14:41:52.961894+0000","last_became_active":"2022-04-28T14:41:45.925745+0000","last_became_peered":"2022-04-28T14:41:45.925745+0000","last_unstale":"2022-04-28T14:41:52.961894+0000","last_undegraded":"2022-04-28T14:41:52.961894+0000","last_fullsized":"2022-04-28T14:41:52.961894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.36","version":"16'2","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961822+0000","last_change":"2022-04-28T14:41:45.927276+0000","last_active":"2022-04-28T14:41:52.961822+0000","last_peered":"2022-04-28T14:41:52.961822+0000","last_clean":"2022-04-28T14:41:52.961822+0000","last_became_active":"2022-04-28T14:41:45.926618+0000","last_became_peered":"2022-04-28T14:41:45.926618+0000","last_unstale":"2022-04-28T14:41:52.961822+0000","last_undegraded":"2022-04-28T14:41:52.961822+0000","last_fullsized":"2022-04-28T14:41:52.961822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964770+0000","last_change":"2022-04-28T14:41:44.937836+0000","last_active":"2022-04-28T14:41:52.964770+0000","last_peered":"2022-04-28T14:41:52.964770+0000","last_clean":"2022-04-28T14:41:52.964770+0000","last_became_active":"2022-04-28T14:41:44.937280+0000","last_became_peered":"2022-04-28T14:41:44.937280+0000","last_unstale":"2022-04-28T14:41:52.964770+0000","last_undegraded":"2022-04-28T14:41:52.964770+0000","last_fullsized":"2022-04-28T14:41:52.964770+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.37","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964559+0000","last_change":"2022-04-28T14:41:44.933921+0000","last_active":"2022-04-28T14:41:52.964559+0000","last_peered":"2022-04-28T14:41:52.964559+0000","last_clean":"2022-04-28T14:41:52.964559+0000","last_became_active":"2022-04-28T14:41:44.933639+0000","last_became_peered":"2022-04-28T14:41:44.933639+0000","last_unstale":"2022-04-28T14:41:52.964559+0000","last_undegraded":"2022-04-28T14:41:52.964559+0000","last_fullsized":"2022-04-28T14:41:52.964559+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.962635+0000","last_change":"2022-04-28T14:41:43.935976+0000","last_active":"2022-04-28T14:41:52.962635+0000","last_peered":"2022-04-28T14:41:52.962635+0000","last_clean":"2022-04-28T14:41:52.962635+0000","last_became_active":"2022-04-28T14:41:43.934329+0000","last_became_peered":"2022-04-28T14:41:43.934329+0000","last_unstale":"2022-04-28T14:41:52.962635+0000","last_undegraded":"2022-04-28T14:41:52.962635+0000","last_fullsized":"2022-04-28T14:41:52.962635+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.38","version":"16'1","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.962790+0000","last_change":"2022-04-28T14:41:43.935266+0000","last_active":"2022-04-28T14:41:52.962790+0000","last_peered":"2022-04-28T14:41:52.962790+0000","last_clean":"2022-04-28T14:41:52.962790+0000","last_became_active":"2022-04-28T14:41:43.934676+0000","last_became_peered":"2022-04-28T14:41:43.934676+0000","last_unstale":"2022-04-28T14:41:52.962790+0000","last_undegraded":"2022-04-28T14:41:52.962790+0000","last_fullsized":"2022-04-28T14:41:52.962790+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959688+0000","last_change":"2022-04-28T14:41:45.927634+0000","last_active":"2022-04-28T14:41:52.959688+0000","last_peered":"2022-04-28T14:41:52.959688+0000","last_clean":"2022-04-28T14:41:52.959688+0000","last_became_active":"2022-04-28T14:41:45.927293+0000","last_became_peered":"2022-04-28T14:41:45.927293+0000","last_unstale":"2022-04-28T14:41:52.959688+0000","last_undegraded":"2022-04-28T14:41:52.959688+0000","last_fullsized":"2022-04-28T14:41:52.959688+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.39","version":"0'0","reported_seq":29,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.959291+0000","last_change":"2022-04-28T14:41:44.932968+0000","last_active":"2022-04-28T14:41:52.959291+0000","last_peered":"2022-04-28T14:41:52.959291+0000","last_clean":"2022-04-28T14:41:52.959291+0000","last_became_active":"2022-04-28T14:41:44.932674+0000","last_became_peered":"2022-04-28T14:41:44.932674+0000","last_unstale":"2022-04-28T14:41:52.959291+0000","last_undegraded":"2022-04-28T14:41:52.959291+0000","last_fullsized":"2022-04-28T14:41:52.959291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.962945+0000","last_change":"2022-04-28T14:41:44.934580+0000","last_active":"2022-04-28T14:41:52.962945+0000","last_peered":"2022-04-28T14:41:52.962945+0000","last_clean":"2022-04-28T14:41:52.962945+0000","last_became_active":"2022-04-28T14:41:44.934290+0000","last_became_peered":"2022-04-28T14:41:44.934290+0000","last_unstale":"2022-04-28T14:41:52.962945+0000","last_undegraded":"2022-04-28T14:41:52.962945+0000","last_fullsized":"2022-04-28T14:41:52.962945+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3a","version":"34'2","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.892529+0000","last_change":"2022-04-28T14:41:45.916208+0000","last_active":"2022-04-28T14:41:53.892529+0000","last_peered":"2022-04-28T14:41:53.892529+0000","last_clean":"2022-04-28T14:41:53.892529+0000","last_became_active":"2022-04-28T14:41:45.915499+0000","last_became_peered":"2022-04-28T14:41:45.915499+0000","last_unstale":"2022-04-28T14:41:53.892529+0000","last_undegraded":"2022-04-28T14:41:53.892529+0000","last_fullsized":"2022-04-28T14:41:53.892529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.892697+0000","last_change":"2022-04-28T14:41:44.946355+0000","last_active":"2022-04-28T14:41:53.892697+0000","last_peered":"2022-04-28T14:41:53.892697+0000","last_clean":"2022-04-28T14:41:53.892697+0000","last_became_active":"2022-04-28T14:41:44.946061+0000","last_became_peered":"2022-04-28T14:41:44.946061+0000","last_unstale":"2022-04-28T14:41:53.892697+0000","last_undegraded":"2022-04-28T14:41:53.892697+0000","last_fullsized":"2022-04-28T14:41:53.892697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3b","version":"34'2","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.963416+0000","last_change":"2022-04-28T14:41:43.929902+0000","last_active":"2022-04-28T14:41:52.963416+0000","last_peered":"2022-04-28T14:41:52.963416+0000","last_clean":"2022-04-28T14:41:52.963416+0000","last_became_active":"2022-04-28T14:41:43.929564+0000","last_became_peered":"2022-04-28T14:41:43.929564+0000","last_unstale":"2022-04-28T14:41:52.963416+0000","last_undegraded":"2022-04-28T14:41:52.963416+0000","last_fullsized":"2022-04-28T14:41:52.963416+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964269+0000","last_change":"2022-04-28T14:41:44.930278+0000","last_active":"2022-04-28T14:41:52.964269+0000","last_peered":"2022-04-28T14:41:52.964269+0000","last_clean":"2022-04-28T14:41:52.964269+0000","last_became_active":"2022-04-28T14:41:44.929926+0000","last_became_peered":"2022-04-28T14:41:44.929926+0000","last_unstale":"2022-04-28T14:41:52.964269+0000","last_undegraded":"2022-04-28T14:41:52.964269+0000","last_fullsized":"2022-04-28T14:41:52.964269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3c","version":"15'2","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.963180+0000","last_change":"2022-04-28T14:41:43.934602+0000","last_active":"2022-04-28T14:41:52.963180+0000","last_peered":"2022-04-28T14:41:52.963180+0000","last_clean":"2022-04-28T14:41:52.963180+0000","last_became_active":"2022-04-28T14:41:43.933840+0000","last_became_peered":"2022-04-28T14:41:43.933840+0000","last_unstale":"2022-04-28T14:41:52.963180+0000","last_undegraded":"2022-04-28T14:41:52.963180+0000","last_fullsized":"2022-04-28T14:41:52.963180+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:53.893100+0000","last_change":"2022-04-28T14:41:45.918878+0000","last_active":"2022-04-28T14:41:53.893100+0000","last_peered":"2022-04-28T14:41:53.893100+0000","last_clean":"2022-04-28T14:41:53.893100+0000","last_became_active":"2022-04-28T14:41:45.918588+0000","last_became_peered":"2022-04-28T14:41:45.918588+0000","last_unstale":"2022-04-28T14:41:53.893100+0000","last_undegraded":"2022-04-28T14:41:53.893100+0000","last_fullsized":"2022-04-28T14:41:53.893100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3d","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961340+0000","last_change":"2022-04-28T14:41:43.936054+0000","last_active":"2022-04-28T14:41:52.961340+0000","last_peered":"2022-04-28T14:41:52.961340+0000","last_clean":"2022-04-28T14:41:52.961340+0000","last_became_active":"2022-04-28T14:41:43.935725+0000","last_became_peered":"2022-04-28T14:41:43.935725+0000","last_unstale":"2022-04-28T14:41:52.961340+0000","last_undegraded":"2022-04-28T14:41:52.961340+0000","last_fullsized":"2022-04-28T14:41:52.961340+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964688+0000","last_change":"2022-04-28T14:41:45.922826+0000","last_active":"2022-04-28T14:41:52.964688+0000","last_peered":"2022-04-28T14:41:52.964688+0000","last_clean":"2022-04-28T14:41:52.964688+0000","last_became_active":"2022-04-28T14:41:45.922332+0000","last_became_peered":"2022-04-28T14:41:45.922332+0000","last_unstale":"2022-04-28T14:41:52.964688+0000","last_undegraded":"2022-04-28T14:41:52.964688+0000","last_fullsized":"2022-04-28T14:41:52.964688+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3e","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.964527+0000","last_change":"2022-04-28T14:41:45.927039+0000","last_active":"2022-04-28T14:41:52.964527+0000","last_peered":"2022-04-28T14:41:52.964527+0000","last_clean":"2022-04-28T14:41:52.964527+0000","last_became_active":"2022-04-28T14:41:45.926737+0000","last_became_peered":"2022-04-28T14:41:45.926737+0000","last_unstale":"2022-04-28T14:41:52.964527+0000","last_undegraded":"2022-04-28T14:41:52.964527+0000","last_fullsized":"2022-04-28T14:41:52.964527+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.961804+0000","last_change":"2022-04-28T14:41:43.936626+0000","last_active":"2022-04-28T14:41:52.961804+0000","last_peered":"2022-04-28T14:41:52.961804+0000","last_clean":"2022-04-28T14:41:52.961804+0000","last_became_active":"2022-04-28T14:41:43.936256+0000","last_became_peered":"2022-04-28T14:41:43.936256+0000","last_unstale":"2022-04-28T14:41:52.961804+0000","last_undegraded":"2022-04-28T14:41:52.961804+0000","last_fullsized":"2022-04-28T14:41:52.961804+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:13.574505+0000","last_clean_scrub_stamp":"2022-04-28T14:39:13.574505+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3f","version":"15'3","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2022-04-28T14:41:52.962062+0000","last_change":"2022-04-28T14:41:43.935916+0000","last_active":"2022-04-28T14:41:52.962062+0000","last_peered":"2022-04-28T14:41:52.962062+0000","last_clean":"2022-04-28T14:41:52.962062+0000","last_became_active":"2022-04-28T14:41:43.935526+0000","last_became_peered":"2022-04-28T14:41:43.935526+0000","last_unstale":"2022-04-28T14:41:52.962062+0000","last_undegraded":"2022-04-28T14:41:52.962062+0000","last_fullsized":"2022-04-28T14:41:52.962062+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-28T14:39:12.570501+0000","last_clean_scrub_stamp":"2022-04-28T14:39:12.570501+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":544,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":2,"num_pg":64,"stat_sum":{"num_bytes":8616,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":19,"num_read_kb":20,"num_write":115,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":17232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":128,"acting":128,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":30,"seq":128849018885,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":5872,"kb_used_data":360,"kb_used_omap":12,"kb_used_meta":5491,"kb_avail":94365968,"statfs":{"total":96636764160,"available":96630751232,"internally_reserved":0,"allocated":368640,"data_stored":152586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12626,"internal_metadata":5623470},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]}]},{"osd":1,"up_from":28,"seq":120259084293,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":5664,"kb_used_data":344,"kb_used_omap":13,"kb_used_meta":5298,"kb_avail":94366176,"statfs":{"total":96636764160,"available":96630964224,"internally_reserved":0,"allocated":352256,"data_stored":146118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13413,"internal_metadata":5426075},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]}]},{"osd":2,"up_from":29,"seq":124554051589,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":5532,"kb_used_data":340,"kb_used_omap":11,"kb_used_meta":5172,"kb_avail":94366308,"statfs":{"total":96636764160,"available":96631099392,"internally_reserved":0,"allocated":348160,"data_stored":145554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11905,"internal_metadata":5296511},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]}]},{"osd":0,"up_from":27,"seq":115964116997,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":5868,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":94365972,"statfs":{"total":96636764160,"available":96630755328,"internally_reserved":0,"allocated":364544,"data_stored":151926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":7848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-04-28T14:41:59.909 INFO:tasks.ceph.ceph_manager.ceph:clean! 2022-04-28T14:41:59.909 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2022-04-28T14:41:59.909 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2022-04-28T14:41:59.910 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2022-04-28T14:42:00.031 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.026+0000 7f2339ce8700 1 Processor -- start 2022-04-28T14:42:00.031 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.026+0000 7f2339ce8700 1 -- start start 2022-04-28T14:42:00.036 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.027+0000 7f2339ce8700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2334063e20 0x7f2334067a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:00.037 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.027+0000 7f2339ce8700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f233413ea20 0x7f2334140e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:00.037 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.027+0000 7f2339ce8700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2334064200 con 0x7f2334139bc0 2022-04-28T14:42:00.037 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.027+0000 7f2339ce8700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2334068040 con 0x7f2334063e20 2022-04-28T14:42:00.037 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.027+0000 7f2339ce8700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2334063960 con 0x7f233413ea20 2022-04-28T14:42:00.037 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.027+0000 7f23337fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2334063e20 0x7f2334067a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:00.037 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.027+0000 7f2333fff700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f233413ea20 0x7f2334140e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:00.037 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.027+0000 7f23337fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2334063e20 0x7f2334067a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48958/0 (socket says 172.21.15.22:48958) 2022-04-28T14:42:00.037 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.027+0000 7f23337fe700 1 -- 172.21.15.22:0/1342413238 learned_addr learned my addr 172.21.15.22:0/1342413238 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:42:00.038 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.027+0000 7f23327fc700 1 -- 172.21.15.22:0/1342413238 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3021020927 0 0) 0x7f2334064200 con 0x7f2334139bc0 2022-04-28T14:42:00.038 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.027+0000 7f2333fff700 1 -- 172.21.15.22:0/1342413238 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2334063e20 msgr2=0x7f2334067a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:42:00.038 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.027+0000 7f2333fff700 1 --2- 172.21.15.22:0/1342413238 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2334063e20 0x7f2334067a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.038 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.027+0000 7f2333fff700 1 -- 172.21.15.22:0/1342413238 >> v1:172.21.15.22:6789/0 conn(0x7f2334139bc0 legacy=0x7f2334139fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:00.038 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.027+0000 7f2333fff700 1 -- 172.21.15.22:0/1342413238 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233409daf0 con 0x7f233413ea20 2022-04-28T14:42:00.038 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.027+0000 7f23337fe700 1 --2- 172.21.15.22:0/1342413238 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2334063e20 0x7f2334067a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:42:00.038 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.027+0000 7f2333fff700 1 --2- 172.21.15.22:0/1342413238 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f233413ea20 0x7f2334140e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f232c009e90 tx=0x7f232c009780).ready entity=mon.2 client_cookie=1027194fad4151b3 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:42:00.039 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.027+0000 7f23327fc700 1 -- 172.21.15.22:0/1342413238 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c00e070 con 0x7f233413ea20 2022-04-28T14:42:00.039 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.027+0000 7f23327fc700 1 -- 172.21.15.22:0/1342413238 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232c00bb60 con 0x7f233413ea20 2022-04-28T14:42:00.039 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.027+0000 7f23327fc700 1 -- 172.21.15.22:0/1342413238 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c012410 con 0x7f233413ea20 2022-04-28T14:42:00.039 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.028+0000 7f2339ce8700 1 -- 172.21.15.22:0/1342413238 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f233413ea20 msgr2=0x7f2334140e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:00.040 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.028+0000 7f2339ce8700 1 --2- 172.21.15.22:0/1342413238 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f233413ea20 0x7f2334140e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f232c009e90 tx=0x7f232c009780).stop 2022-04-28T14:42:00.040 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.028+0000 7f2339ce8700 1 -- 172.21.15.22:0/1342413238 shutdown_connections 2022-04-28T14:42:00.040 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.028+0000 7f2339ce8700 1 --2- 172.21.15.22:0/1342413238 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f233413ea20 0x7f2334140e10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.040 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.028+0000 7f2339ce8700 1 --2- 172.21.15.22:0/1342413238 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2334063e20 0x7f2334067a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.040 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.028+0000 7f2339ce8700 1 -- 172.21.15.22:0/1342413238 >> 172.21.15.22:0/1342413238 conn(0x7f23340aaf80 msgr2=0x7f23340ab390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:42:00.041 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.028+0000 7f2339ce8700 1 -- 172.21.15.22:0/1342413238 shutdown_connections 2022-04-28T14:42:00.041 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.028+0000 7f2339ce8700 1 -- 172.21.15.22:0/1342413238 wait complete. 2022-04-28T14:42:00.041 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.029+0000 7f2339ce8700 1 Processor -- start 2022-04-28T14:42:00.041 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.029+0000 7f2339ce8700 1 -- start start 2022-04-28T14:42:00.041 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.030+0000 7f2339ce8700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2334063e20 0x7f233414c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:00.042 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.030+0000 7f2339ce8700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2334139bc0 0x7f233414f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:00.042 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.030+0000 7f2339ce8700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f233413ea20 0x7f233414fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:00.042 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.030+0000 7f2339ce8700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233414d0a0 con 0x7f233413ea20 2022-04-28T14:42:00.042 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.030+0000 7f2339ce8700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2334090cf0 con 0x7f2334063e20 2022-04-28T14:42:00.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.030+0000 7f2339ce8700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23340a8a10 con 0x7f2334139bc0 2022-04-28T14:42:00.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.030+0000 7f23337fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2334063e20 0x7f233414c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:00.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.030+0000 7f2332ffd700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2334139bc0 0x7f233414f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:00.043 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.030+0000 7f23337fe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2334063e20 0x7f233414c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48964/0 (socket says 172.21.15.22:48964) 2022-04-28T14:42:00.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.030+0000 7f23337fe700 1 -- 172.21.15.22:0/3520570335 learned_addr learned my addr 172.21.15.22:0/3520570335 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:42:00.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.030+0000 7f2333fff700 1 --2- 172.21.15.22:0/3520570335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f233413ea20 0x7f233414fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:00.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.030+0000 7f2332ffd700 1 -- 172.21.15.22:0/3520570335 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2334063e20 msgr2=0x7f233414c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:00.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.030+0000 7f2332ffd700 1 --2- 172.21.15.22:0/3520570335 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2334063e20 0x7f233414c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.044 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.030+0000 7f2332ffd700 1 -- 172.21.15.22:0/3520570335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f233413ea20 msgr2=0x7f233414fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:00.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.030+0000 7f2332ffd700 1 --2- 172.21.15.22:0/3520570335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f233413ea20 0x7f233414fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.030+0000 7f2332ffd700 1 -- 172.21.15.22:0/3520570335 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c009370 con 0x7f2334139bc0 2022-04-28T14:42:00.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.030+0000 7f2332ffd700 1 --2- 172.21.15.22:0/3520570335 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2334139bc0 0x7f233414f700 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f232400c410 tx=0x7f2324007b60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:42:00.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.030+0000 7f232b7fe700 1 -- 172.21.15.22:0/3520570335 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232400ce60 con 0x7f2334139bc0 2022-04-28T14:42:00.045 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.030+0000 7f232b7fe700 1 -- 172.21.15.22:0/3520570335 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232400f470 con 0x7f2334139bc0 2022-04-28T14:42:00.046 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.030+0000 7f2339ce8700 1 -- 172.21.15.22:0/3520570335 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232c009a20 con 0x7f2334139bc0 2022-04-28T14:42:00.046 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.030+0000 7f232b7fe700 1 -- 172.21.15.22:0/3520570335 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232400f810 con 0x7f2334139bc0 2022-04-28T14:42:00.046 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.031+0000 7f2339ce8700 1 -- 172.21.15.22:0/3520570335 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233413d3f0 con 0x7f2334139bc0 2022-04-28T14:42:00.046 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.031+0000 7f2339ce8700 1 -- 172.21.15.22:0/3520570335 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2334066da0 con 0x7f2334139bc0 2022-04-28T14:42:00.046 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.031+0000 7f232b7fe700 1 -- 172.21.15.22:0/3520570335 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f2324019030 con 0x7f2334139bc0 2022-04-28T14:42:00.047 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.032+0000 7f232b7fe700 1 -- 172.21.15.22:0/3520570335 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7f2324054940 con 0x7f2334139bc0 2022-04-28T14:42:00.047 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.035+0000 7f232b7fe700 1 -- 172.21.15.22:0/3520570335 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f2324034f20 con 0x7f2334139bc0 2022-04-28T14:42:00.206 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.201+0000 7f2339ce8700 1 -- 172.21.15.22:0/3520570335 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f233409cb40 con 0x7f2334139bc0 2022-04-28T14:42:00.206 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.201+0000 7f232b7fe700 1 -- 172.21.15.22:0/3520570335 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f2324017070 con 0x7f2334139bc0 2022-04-28T14:42:00.207 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:42:00.209 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.202+0000 7f2339ce8700 1 -- 172.21.15.22:0/3520570335 >> v1:172.21.15.22:6808/92758 conn(0x7f2318041ad0 legacy=0x7f2318043f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:00.209 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.202+0000 7f2339ce8700 1 -- 172.21.15.22:0/3520570335 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2334139bc0 msgr2=0x7f233414f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:00.209 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.202+0000 7f2339ce8700 1 --2- 172.21.15.22:0/3520570335 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2334139bc0 0x7f233414f700 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f232400c410 tx=0x7f2324007b60).stop 2022-04-28T14:42:00.209 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.202+0000 7f2339ce8700 1 -- 172.21.15.22:0/3520570335 shutdown_connections 2022-04-28T14:42:00.210 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.202+0000 7f2339ce8700 1 --2- 172.21.15.22:0/3520570335 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f233413ea20 0x7f233414fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.211 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.202+0000 7f2339ce8700 1 --2- 172.21.15.22:0/3520570335 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2334063e20 0x7f233414c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.211 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.202+0000 7f2339ce8700 1 --2- 172.21.15.22:0/3520570335 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2334139bc0 0x7f233414f700 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.211 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.202+0000 7f2339ce8700 1 -- 172.21.15.22:0/3520570335 >> 172.21.15.22:0/3520570335 conn(0x7f23340aaf80 msgr2=0x7f233413e300 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:42:00.211 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.202+0000 7f2339ce8700 1 -- 172.21.15.22:0/3520570335 shutdown_connections 2022-04-28T14:42:00.211 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.202+0000 7f2339ce8700 1 -- 172.21.15.22:0/3520570335 wait complete. 2022-04-28T14:42:00.219 INFO:teuthology.orchestra.run.smithi022.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2022-04-28T14:42:00.219 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2022-04-28T14:42:00.219 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-04-28T14:42:00.337 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.332+0000 7f667c274700 1 Processor -- start 2022-04-28T14:42:00.337 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.332+0000 7f667c274700 1 -- start start 2022-04-28T14:42:00.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.333+0000 7f667c274700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6674064530 0x7f667413bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:00.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.333+0000 7f667c274700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f667413b850 0x7f6674138920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:00.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.333+0000 7f667c274700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66740a7930 con 0x7f66740681c0 2022-04-28T14:42:00.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.333+0000 7f667c274700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6674064910 con 0x7f6674064530 2022-04-28T14:42:00.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.333+0000 7f667c274700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6674138410 con 0x7f667413b850 2022-04-28T14:42:00.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.333+0000 7f667a010700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6674064530 0x7f667413bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:00.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.333+0000 7f667980f700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f667413b850 0x7f6674138920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:00.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.333+0000 7f667a811700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f66740681c0 0x7f66740a80a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40804/0 (socket says 172.21.15.22:40804) 2022-04-28T14:42:00.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.333+0000 7f667a811700 1 -- 172.21.15.22:0/147148652 learned_addr learned my addr 172.21.15.22:0/147148652 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:42:00.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.334+0000 7f667a010700 1 -- 172.21.15.22:0/147148652 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f667413b850 msgr2=0x7f6674138920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:42:00.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.334+0000 7f667a010700 1 --2- 172.21.15.22:0/147148652 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f667413b850 0x7f6674138920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.334+0000 7f667a010700 1 -- 172.21.15.22:0/147148652 >> v1:172.21.15.22:6789/0 conn(0x7f66740681c0 legacy=0x7f66740a80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:00.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.334+0000 7f667900e700 1 -- 172.21.15.22:0/147148652 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1351012984 0 0) 0x7f66740a7930 con 0x7f66740681c0 2022-04-28T14:42:00.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.334+0000 7f667a010700 1 -- 172.21.15.22:0/147148652 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6674138670 con 0x7f6674064530 2022-04-28T14:42:00.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.334+0000 7f667980f700 1 --2- 172.21.15.22:0/147148652 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f667413b850 0x7f6674138920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:42:00.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.334+0000 7f667a010700 1 --2- 172.21.15.22:0/147148652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6674064530 0x7f667413bf60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f6670009760 tx=0x7f6670009060).ready entity=mon.0 client_cookie=4d5b22be7f20dc83 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:42:00.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.334+0000 7f667900e700 1 -- 172.21.15.22:0/147148652 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667000f510 con 0x7f6674064530 2022-04-28T14:42:00.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.334+0000 7f667900e700 1 -- 172.21.15.22:0/147148652 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667000f670 con 0x7f6674064530 2022-04-28T14:42:00.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.334+0000 7f667900e700 1 -- 172.21.15.22:0/147148652 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667000f9f0 con 0x7f6674064530 2022-04-28T14:42:00.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.334+0000 7f667c274700 1 -- 172.21.15.22:0/147148652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6674064530 msgr2=0x7f667413bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:00.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.334+0000 7f667c274700 1 --2- 172.21.15.22:0/147148652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6674064530 0x7f667413bf60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f6670009760 tx=0x7f6670009060).stop 2022-04-28T14:42:00.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.335+0000 7f667c274700 1 -- 172.21.15.22:0/147148652 shutdown_connections 2022-04-28T14:42:00.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.335+0000 7f667c274700 1 --2- 172.21.15.22:0/147148652 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6674064530 0x7f667413bf60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.335+0000 7f667c274700 1 --2- 172.21.15.22:0/147148652 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f667413b850 0x7f6674138920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.335+0000 7f667c274700 1 -- 172.21.15.22:0/147148652 >> 172.21.15.22:0/147148652 conn(0x7f6674067070 msgr2=0x7f6674063c60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:42:00.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.335+0000 7f667c274700 1 -- 172.21.15.22:0/147148652 shutdown_connections 2022-04-28T14:42:00.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.335+0000 7f667c274700 1 -- 172.21.15.22:0/147148652 wait complete. 2022-04-28T14:42:00.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.335+0000 7f667c274700 1 Processor -- start 2022-04-28T14:42:00.343 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.336+0000 7f667c274700 1 -- start start 2022-04-28T14:42:00.346 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.336+0000 7f667c274700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6674064530 0x7f667409f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:00.346 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.336+0000 7f667c274700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f66740681c0 0x7f66740a07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:00.346 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.336+0000 7f667c274700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f667413b850 0x7f6674147c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:00.384 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.336+0000 7f667c274700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66740a0f90 con 0x7f667413b850 2022-04-28T14:42:00.385 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.336+0000 7f667c274700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66740a0340 con 0x7f66740681c0 2022-04-28T14:42:00.385 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.336+0000 7f667c274700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6674147a20 con 0x7f6674064530 2022-04-28T14:42:00.385 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.336+0000 7f667a010700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6674064530 0x7f667409f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:00.385 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.336+0000 7f667980f700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f66740681c0 0x7f66740a07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:00.385 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.336+0000 7f667a010700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6674064530 0x7f667409f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48762/0 (socket says 172.21.15.22:48762) 2022-04-28T14:42:00.385 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.336+0000 7f667a010700 1 -- 172.21.15.22:0/2252649361 learned_addr learned my addr 172.21.15.22:0/2252649361 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:42:00.385 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.336+0000 7f667a811700 1 --2- 172.21.15.22:0/2252649361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f667413b850 0x7f6674147c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:00.385 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.336+0000 7f667a010700 1 -- 172.21.15.22:0/2252649361 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f66740681c0 msgr2=0x7f66740a07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:00.385 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.336+0000 7f667a010700 1 --2- 172.21.15.22:0/2252649361 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f66740681c0 0x7f66740a07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.385 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.336+0000 7f667a010700 1 -- 172.21.15.22:0/2252649361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f667413b850 msgr2=0x7f6674147c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:00.386 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.336+0000 7f667a010700 1 --2- 172.21.15.22:0/2252649361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f667413b850 0x7f6674147c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.386 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.337+0000 7f667a010700 1 -- 172.21.15.22:0/2252649361 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66680092a0 con 0x7f6674064530 2022-04-28T14:42:00.386 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.337+0000 7f667980f700 1 --2- 172.21.15.22:0/2252649361 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f66740681c0 0x7f66740a07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:42:00.386 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.337+0000 7f667a010700 1 --2- 172.21.15.22:0/2252649361 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6674064530 0x7f667409f6c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f6670006d90 tx=0x7f6670017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:42:00.386 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.337+0000 7f66667fc700 1 -- 172.21.15.22:0/2252649361 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667000f7e0 con 0x7f6674064530 2022-04-28T14:42:00.386 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.337+0000 7f66667fc700 1 -- 172.21.15.22:0/2252649361 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667000f940 con 0x7f6674064530 2022-04-28T14:42:00.386 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.337+0000 7f66667fc700 1 -- 172.21.15.22:0/2252649361 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667001b660 con 0x7f6674064530 2022-04-28T14:42:00.386 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.337+0000 7f667c274700 1 -- 172.21.15.22:0/2252649361 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66700092a0 con 0x7f6674064530 2022-04-28T14:42:00.386 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.337+0000 7f667c274700 1 -- 172.21.15.22:0/2252649361 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f667413e2d0 con 0x7f6674064530 2022-04-28T14:42:00.386 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.338+0000 7f667c274700 1 -- 172.21.15.22:0/2252649361 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f667413e550 con 0x7f6674064530 2022-04-28T14:42:00.387 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.338+0000 7f66667fc700 1 -- 172.21.15.22:0/2252649361 <== mon.2 v2:172.21.15.22:3302/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f667002c070 con 0x7f6674064530 2022-04-28T14:42:00.387 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.338+0000 7f66667fc700 1 -- 172.21.15.22:0/2252649361 <== mon.2 v2:172.21.15.22:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7f6670056df0 con 0x7f6674064530 2022-04-28T14:42:00.387 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.341+0000 7f66667fc700 1 -- 172.21.15.22:0/2252649361 <== mon.2 v2:172.21.15.22:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f66700259e0 con 0x7f6674064530 2022-04-28T14:42:00.485 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.480+0000 7f667c274700 1 -- 172.21.15.22:0/2252649361 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6674046540 con 0x7f6674064530 2022-04-28T14:42:00.485 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.481+0000 7f66667fc700 1 -- 172.21.15.22:0/2252649361 <== mon.2 v2:172.21.15.22:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+11369 (secure 0 0 0) 0x7f66700259e0 con 0x7f6674064530 2022-04-28T14:42:00.486 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:42:00.486 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":39,"fsid":"3047163a-0285-4058-8e05-ce74c6fbb9c5","created":"2022-04-28T14:38:54.232890+0000","modified":"2022-04-28T14:41:53.956290+0000","last_up_change":"2022-04-28T14:41:44.899394+0000","last_in_change":"2022-04-28T14:39:00.269721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"nautilus","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-04-28T14:39:03.639717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2022-04-28T14:39:12.000229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2022-04-28T14:39:12.915097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":4,"pool_name":"device_health_metrics","create_time":"2022-04-28T14:41:25.197740+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"782ee638-1ada-48d9-9454-f9e0ca8a3135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":21,"up_from":27,"up_thru":30,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6800","nonce":94303}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":94303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":94303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":94303}]},"public_addr":"172.21.15.22:6800/94303","cluster_addr":"172.21.15.22:6801/94303","heartbeat_back_addr":"172.21.15.22:6803/94303","heartbeat_front_addr":"172.21.15.22:6802/94303","state":["exists","up"]},{"osd":1,"uuid":"61ca6f96-fb4f-4c0f-b68b-edf1e7011f1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":30,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":94391}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":94391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":94391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":94391}]},"public_addr":"172.21.15.22:6804/94391","cluster_addr":"172.21.15.22:6805/94391","heartbeat_back_addr":"172.21.15.22:6807/94391","heartbeat_front_addr":"172.21.15.22:6806/94391","state":["exists","up"]},{"osd":2,"uuid":"4b3043b9-50df-4b7f-a55a-ac8e6148c449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":30,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":94493}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":94493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":94493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":94493}]},"public_addr":"172.21.15.22:6809/94493","cluster_addr":"172.21.15.22:6810/94493","heartbeat_back_addr":"172.21.15.22:6812/94493","heartbeat_front_addr":"172.21.15.22:6811/94493","state":["exists","up"]},{"osd":3,"uuid":"7807bcd1-53f8-44b5-9992-57c328e5b299","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":30,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":94624}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":94624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6816","nonce":94624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":94624}]},"public_addr":"172.21.15.22:6813/94624","cluster_addr":"172.21.15.22:6814/94624","heartbeat_back_addr":"172.21.15.22:6816/94624","heartbeat_front_addr":"172.21.15.22:6815/94624","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"2022-04-28T14:41:38.872482+0000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:6819/356491488":"2022-04-29T14:41:48.026821+0000","172.21.15.22:6808/86956":"2022-04-29T14:41:24.302858+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-04-28T14:42:00.487 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.482+0000 7f667c274700 1 -- 172.21.15.22:0/2252649361 >> v1:172.21.15.22:6808/92758 conn(0x7f6654041b00 legacy=0x7f6654043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:00.488 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.482+0000 7f667c274700 1 -- 172.21.15.22:0/2252649361 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6674064530 msgr2=0x7f667409f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:00.488 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.482+0000 7f667c274700 1 --2- 172.21.15.22:0/2252649361 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6674064530 0x7f667409f6c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f6670006d90 tx=0x7f6670017000).stop 2022-04-28T14:42:00.488 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.483+0000 7f667c274700 1 -- 172.21.15.22:0/2252649361 shutdown_connections 2022-04-28T14:42:00.488 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.483+0000 7f667c274700 1 --2- 172.21.15.22:0/2252649361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f667413b850 0x7f6674147c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.488 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.483+0000 7f667c274700 1 --2- 172.21.15.22:0/2252649361 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f6674064530 0x7f667409f6c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.488 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.483+0000 7f667c274700 1 --2- 172.21.15.22:0/2252649361 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f66740681c0 0x7f66740a07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.488 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.483+0000 7f667c274700 1 -- 172.21.15.22:0/2252649361 >> 172.21.15.22:0/2252649361 conn(0x7f6674067070 msgr2=0x7f6674137730 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:42:00.488 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.483+0000 7f667c274700 1 -- 172.21.15.22:0/2252649361 shutdown_connections 2022-04-28T14:42:00.488 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.483+0000 7f667c274700 1 -- 172.21.15.22:0/2252649361 wait complete. 2022-04-28T14:42:00.499 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2022-04-28T14:39:03.639717+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2022-04-28T14:39:12.000229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2022-04-28T14:39:12.915097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 4, 'pool_name': 'device_health_metrics', 'create_time': '2022-04-28T14:41:25.197740+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2022-04-28T14:42:00.500 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-04-28T14:42:00.625 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.616+0000 7ff521163700 1 Processor -- start 2022-04-28T14:42:00.625 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.616+0000 7ff521163700 1 -- start start 2022-04-28T14:42:00.625 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.616+0000 7ff521163700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff51c0a3320 0x7ff51c0691d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:00.625 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.616+0000 7ff521163700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff51c13b980 0x7ff51c067cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:00.625 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.616+0000 7ff521163700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff51c0a3700 con 0x7ff51c13bdc0 2022-04-28T14:42:00.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.616+0000 7ff521163700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c0a2c40 con 0x7ff51c0a3320 2022-04-28T14:42:00.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.616+0000 7ff521163700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c0a29d0 con 0x7ff51c13b980 2022-04-28T14:42:00.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.616+0000 7ff51ad9d700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff51c0a3320 0x7ff51c0691d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:00.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.616+0000 7ff51a59c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff51c13b980 0x7ff51c067cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:00.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.616+0000 7ff51ad9d700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff51c0a3320 0x7ff51c0691d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48986/0 (socket says 172.21.15.22:48986) 2022-04-28T14:42:00.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.616+0000 7ff51b59e700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff51c13bdc0 0x7ff51c138430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40818/0 (socket says 172.21.15.22:40818) 2022-04-28T14:42:00.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.616+0000 7ff51a59c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff51c13b980 0x7ff51c067cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48770/0 (socket says 172.21.15.22:48770) 2022-04-28T14:42:00.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.616+0000 7ff51ad9d700 1 -- 172.21.15.22:0/2522249654 learned_addr learned my addr 172.21.15.22:0/2522249654 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:42:00.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.617+0000 7ff519d9b700 1 -- 172.21.15.22:0/2522249654 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2411588638 0 0) 0x7ff51c0a3700 con 0x7ff51c13bdc0 2022-04-28T14:42:00.626 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.617+0000 7ff519d9b700 1 -- 172.21.15.22:0/2522249654 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5080033f0 con 0x7ff51c13bdc0 2022-04-28T14:42:00.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.617+0000 7ff51ad9d700 1 -- 172.21.15.22:0/2522249654 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff51c13b980 msgr2=0x7ff51c067cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:42:00.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.617+0000 7ff51ad9d700 1 --2- 172.21.15.22:0/2522249654 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff51c13b980 0x7ff51c067cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.617+0000 7ff51ad9d700 1 -- 172.21.15.22:0/2522249654 >> v1:172.21.15.22:6789/0 conn(0x7ff51c13bdc0 legacy=0x7ff51c138430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:00.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.617+0000 7ff51ad9d700 1 -- 172.21.15.22:0/2522249654 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51c13c240 con 0x7ff51c0a3320 2022-04-28T14:42:00.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.617+0000 7ff51a59c700 1 --2- 172.21.15.22:0/2522249654 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff51c13b980 0x7ff51c067cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:42:00.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.617+0000 7ff51ad9d700 1 --2- 172.21.15.22:0/2522249654 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff51c0a3320 0x7ff51c0691d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7ff50c009830 tx=0x7ff50c0090f0).ready entity=mon.1 client_cookie=ea838e599be2b50f server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:42:00.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.617+0000 7ff519d9b700 1 -- 172.21.15.22:0/2522249654 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c00f510 con 0x7ff51c0a3320 2022-04-28T14:42:00.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.617+0000 7ff519d9b700 1 -- 172.21.15.22:0/2522249654 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50c00f670 con 0x7ff51c0a3320 2022-04-28T14:42:00.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.617+0000 7ff519d9b700 1 -- 172.21.15.22:0/2522249654 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c00f9f0 con 0x7ff51c0a3320 2022-04-28T14:42:00.627 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.617+0000 7ff521163700 1 -- 172.21.15.22:0/2522249654 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff51c0a3320 msgr2=0x7ff51c0691d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:00.628 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.617+0000 7ff521163700 1 --2- 172.21.15.22:0/2522249654 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff51c0a3320 0x7ff51c0691d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7ff50c009830 tx=0x7ff50c0090f0).stop 2022-04-28T14:42:00.628 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.618+0000 7ff521163700 1 -- 172.21.15.22:0/2522249654 shutdown_connections 2022-04-28T14:42:00.628 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.618+0000 7ff521163700 1 --2- 172.21.15.22:0/2522249654 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff51c0a3320 0x7ff51c0691d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.628 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.618+0000 7ff521163700 1 --2- 172.21.15.22:0/2522249654 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff51c13b980 0x7ff51c067cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.628 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.618+0000 7ff521163700 1 -- 172.21.15.22:0/2522249654 >> 172.21.15.22:0/2522249654 conn(0x7ff51c0ae9c0 msgr2=0x7ff51c0aeda0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:42:00.628 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.618+0000 7ff521163700 1 -- 172.21.15.22:0/2522249654 shutdown_connections 2022-04-28T14:42:00.628 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.618+0000 7ff521163700 1 -- 172.21.15.22:0/2522249654 wait complete. 2022-04-28T14:42:00.628 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.619+0000 7ff521163700 1 Processor -- start 2022-04-28T14:42:00.628 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.619+0000 7ff521163700 1 -- start start 2022-04-28T14:42:00.629 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.619+0000 7ff521163700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff51c0a3320 0x7ff51c0a9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:00.629 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.619+0000 7ff521163700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff51c13b980 0x7ff51c0a90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:00.629 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.619+0000 7ff521163700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff51c13bdc0 0x7ff51c14b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:00.629 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.619+0000 7ff521163700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c0a7c70 con 0x7ff51c13bdc0 2022-04-28T14:42:00.629 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.619+0000 7ff521163700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c148520 con 0x7ff51c13b980 2022-04-28T14:42:00.629 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.619+0000 7ff521163700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c1487c0 con 0x7ff51c0a3320 2022-04-28T14:42:00.629 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.619+0000 7ff51ad9d700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff51c0a3320 0x7ff51c0a9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:00.629 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.619+0000 7ff51a59c700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff51c13b980 0x7ff51c0a90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:00.629 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.619+0000 7ff51b59e700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff51c13bdc0 0x7ff51c14b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:00.630 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.619+0000 7ff51a59c700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff51c13b980 0x7ff51c0a90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:48994/0 (socket says 172.21.15.22:48994) 2022-04-28T14:42:00.630 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.619+0000 7ff51ad9d700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff51c0a3320 0x7ff51c0a9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48776/0 (socket says 172.21.15.22:48776) 2022-04-28T14:42:00.630 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.619+0000 7ff51a59c700 1 -- 172.21.15.22:0/810236826 learned_addr learned my addr 172.21.15.22:0/810236826 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:42:00.630 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.620+0000 7ff51a59c700 1 -- 172.21.15.22:0/810236826 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff51c0a3320 msgr2=0x7ff51c0a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:00.630 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.620+0000 7ff51a59c700 1 --2- 172.21.15.22:0/810236826 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff51c0a3320 0x7ff51c0a9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.630 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.620+0000 7ff51a59c700 1 -- 172.21.15.22:0/810236826 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff51c13bdc0 msgr2=0x7ff51c14b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:00.630 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.620+0000 7ff51a59c700 1 --2- 172.21.15.22:0/810236826 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff51c13bdc0 0x7ff51c14b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.630 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.620+0000 7ff51a59c700 1 -- 172.21.15.22:0/810236826 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff510009250 con 0x7ff51c13b980 2022-04-28T14:42:00.630 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.620+0000 7ff51b59e700 1 --2- 172.21.15.22:0/810236826 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff51c13bdc0 0x7ff51c14b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:42:00.631 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.620+0000 7ff51a59c700 1 --2- 172.21.15.22:0/810236826 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff51c13b980 0x7ff51c0a90a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7ff51000ecb0 tx=0x7ff510006f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:42:00.631 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.620+0000 7ff502ffd700 1 -- 172.21.15.22:0/810236826 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51000c850 con 0x7ff51c13b980 2022-04-28T14:42:00.631 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.620+0000 7ff502ffd700 1 -- 172.21.15.22:0/810236826 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51000c9b0 con 0x7ff51c13b980 2022-04-28T14:42:00.631 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.620+0000 7ff521163700 1 -- 172.21.15.22:0/810236826 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff50c009370 con 0x7ff51c13b980 2022-04-28T14:42:00.631 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.620+0000 7ff502ffd700 1 -- 172.21.15.22:0/810236826 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51000cd30 con 0x7ff51c13b980 2022-04-28T14:42:00.631 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.620+0000 7ff521163700 1 -- 172.21.15.22:0/810236826 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51c0a9640 con 0x7ff51c13b980 2022-04-28T14:42:00.632 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.621+0000 7ff521163700 1 -- 172.21.15.22:0/810236826 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff51c0aa4a0 con 0x7ff51c13b980 2022-04-28T14:42:00.632 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.621+0000 7ff502ffd700 1 -- 172.21.15.22:0/810236826 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7ff510022070 con 0x7ff51c13b980 2022-04-28T14:42:00.632 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.621+0000 7ff502ffd700 1 -- 172.21.15.22:0/810236826 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7ff5100558a0 con 0x7ff51c13b980 2022-04-28T14:42:00.632 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.625+0000 7ff502ffd700 1 -- 172.21.15.22:0/810236826 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7ff510035e80 con 0x7ff51c13b980 2022-04-28T14:42:00.766 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.761+0000 7ff521163700 1 -- 172.21.15.22:0/810236826 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff51c046da0 con 0x7ff51c13b980 2022-04-28T14:42:00.766 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.762+0000 7ff502ffd700 1 -- 172.21.15.22:0/810236826 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v39) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff510039670 con 0x7ff51c13b980 2022-04-28T14:42:00.767 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 8 2022-04-28T14:42:00.768 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.763+0000 7ff521163700 1 -- 172.21.15.22:0/810236826 >> v1:172.21.15.22:6808/92758 conn(0x7ff4fc041b30 legacy=0x7ff4fc043ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:00.768 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.763+0000 7ff521163700 1 -- 172.21.15.22:0/810236826 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff51c13b980 msgr2=0x7ff51c0a90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:00.768 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.763+0000 7ff521163700 1 --2- 172.21.15.22:0/810236826 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff51c13b980 0x7ff51c0a90a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7ff51000ecb0 tx=0x7ff510006f40).stop 2022-04-28T14:42:00.768 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.763+0000 7ff521163700 1 -- 172.21.15.22:0/810236826 shutdown_connections 2022-04-28T14:42:00.768 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.763+0000 7ff521163700 1 --2- 172.21.15.22:0/810236826 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff51c13bdc0 0x7ff51c14b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.763+0000 7ff521163700 1 --2- 172.21.15.22:0/810236826 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7ff51c0a3320 0x7ff51c0a9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.763+0000 7ff521163700 1 --2- 172.21.15.22:0/810236826 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7ff51c13b980 0x7ff51c0a90a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.763+0000 7ff521163700 1 -- 172.21.15.22:0/810236826 >> 172.21.15.22:0/810236826 conn(0x7ff51c0ae9c0 msgr2=0x7ff51c066ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:42:00.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.763+0000 7ff521163700 1 -- 172.21.15.22:0/810236826 shutdown_connections 2022-04-28T14:42:00.769 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.763+0000 7ff521163700 1 -- 172.21.15.22:0/810236826 wait complete. 2022-04-28T14:42:00.780 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-04-28T14:42:00.901 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.897+0000 7f286124b700 1 Processor -- start 2022-04-28T14:42:00.902 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.897+0000 7f286124b700 1 -- start start 2022-04-28T14:42:00.904 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.897+0000 7f286124b700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f285c069100 0x7f285c0a56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:00.904 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.897+0000 7f286124b700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f285c066ca0 0x7f285c137d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:00.905 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.897+0000 7f286124b700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f285c0694e0 con 0x7f285c066860 2022-04-28T14:42:00.905 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.897+0000 7f286124b700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f285c0a4ee0 con 0x7f285c066ca0 2022-04-28T14:42:00.905 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.897+0000 7f286124b700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285c067230 con 0x7f285c069100 2022-04-28T14:42:00.905 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.897+0000 7f285ad9d700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f285c069100 0x7f285c0a56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:00.905 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.897+0000 7f285ad9d700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f285c069100 0x7f285c0a56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:49000/0 (socket says 172.21.15.22:49000) 2022-04-28T14:42:00.905 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.897+0000 7f285ad9d700 1 -- 172.21.15.22:0/106457887 learned_addr learned my addr 172.21.15.22:0/106457887 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:42:00.905 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.898+0000 7f285b59e700 1 --2- 172.21.15.22:0/106457887 >> v2:172.21.15.22:3300/0 conn(0x7f285c066ca0 0x7f285c137d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:00.905 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.898+0000 7f285ad9d700 1 -- 172.21.15.22:0/106457887 >> v2:172.21.15.22:3300/0 conn(0x7f285c066ca0 msgr2=0x7f285c137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:42:00.905 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.898+0000 7f285ad9d700 1 --2- 172.21.15.22:0/106457887 >> v2:172.21.15.22:3300/0 conn(0x7f285c066ca0 0x7f285c137d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.906 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.898+0000 7f285ad9d700 1 -- 172.21.15.22:0/106457887 >> v1:172.21.15.22:6789/0 conn(0x7f285c066860 legacy=0x7f285c1375f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:00.906 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.898+0000 7f285ad9d700 1 -- 172.21.15.22:0/106457887 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c0674d0 con 0x7f285c069100 2022-04-28T14:42:00.906 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.898+0000 7f285ad9d700 1 --2- 172.21.15.22:0/106457887 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f285c069100 0x7f285c0a56c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f284c006fd0 tx=0x7f284c0090f0).ready entity=mon.1 client_cookie=896d4d2b2817a7f0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:42:00.906 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.898+0000 7f2859d9b700 1 -- 172.21.15.22:0/106457887 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c00b580 con 0x7f285c069100 2022-04-28T14:42:00.906 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.898+0000 7f2859d9b700 1 -- 172.21.15.22:0/106457887 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284c00b6e0 con 0x7f285c069100 2022-04-28T14:42:00.906 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.898+0000 7f2859d9b700 1 -- 172.21.15.22:0/106457887 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c00ba60 con 0x7f285c069100 2022-04-28T14:42:00.906 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.898+0000 7f286124b700 1 -- 172.21.15.22:0/106457887 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f285c069100 msgr2=0x7f285c0a56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:00.906 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.898+0000 7f286124b700 1 --2- 172.21.15.22:0/106457887 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f285c069100 0x7f285c0a56c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f284c006fd0 tx=0x7f284c0090f0).stop 2022-04-28T14:42:00.906 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.899+0000 7f286124b700 1 -- 172.21.15.22:0/106457887 shutdown_connections 2022-04-28T14:42:00.906 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.899+0000 7f286124b700 1 --2- 172.21.15.22:0/106457887 >> v2:172.21.15.22:3300/0 conn(0x7f285c066ca0 0x7f285c137d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.907 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.899+0000 7f286124b700 1 --2- 172.21.15.22:0/106457887 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f285c069100 0x7f285c0a56c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.907 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.899+0000 7f286124b700 1 -- 172.21.15.22:0/106457887 >> 172.21.15.22:0/106457887 conn(0x7f285c0ad210 msgr2=0x7f285c061f30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:42:00.907 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.899+0000 7f286124b700 1 -- 172.21.15.22:0/106457887 shutdown_connections 2022-04-28T14:42:00.907 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.899+0000 7f286124b700 1 -- 172.21.15.22:0/106457887 wait complete. 2022-04-28T14:42:00.907 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.900+0000 7f286124b700 1 Processor -- start 2022-04-28T14:42:00.907 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.900+0000 7f286124b700 1 -- start start 2022-04-28T14:42:00.909 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.900+0000 7f286124b700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f285c066860 0x7f285c1152d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:00.909 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.900+0000 7f286124b700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f285c066ca0 0x7f285c116430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:00.910 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.900+0000 7f286124b700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f285c069100 0x7f285c0a7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:00.910 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.900+0000 7f286124b700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c115c50 con 0x7f285c069100 2022-04-28T14:42:00.910 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.900+0000 7f286124b700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285c115f30 con 0x7f285c066ca0 2022-04-28T14:42:00.910 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.900+0000 7f286124b700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f285c1157c0 con 0x7f285c066860 2022-04-28T14:42:00.910 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.900+0000 7f285a59c700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f285c066ca0 0x7f285c116430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:00.910 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.900+0000 7f285ad9d700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f285c066860 0x7f285c1152d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:00.910 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.900+0000 7f285a59c700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f285c066ca0 0x7f285c116430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:49008/0 (socket says 172.21.15.22:49008) 2022-04-28T14:42:00.911 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.900+0000 7f285a59c700 1 -- 172.21.15.22:0/2687000514 learned_addr learned my addr 172.21.15.22:0/2687000514 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:42:00.911 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.900+0000 7f285b59e700 1 --2- 172.21.15.22:0/2687000514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f285c069100 0x7f285c0a7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:00.911 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.901+0000 7f285a59c700 1 -- 172.21.15.22:0/2687000514 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f285c066860 msgr2=0x7f285c1152d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:00.911 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.901+0000 7f285a59c700 1 --2- 172.21.15.22:0/2687000514 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f285c066860 0x7f285c1152d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.911 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.901+0000 7f285a59c700 1 -- 172.21.15.22:0/2687000514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f285c069100 msgr2=0x7f285c0a7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:00.911 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.901+0000 7f285a59c700 1 --2- 172.21.15.22:0/2687000514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f285c069100 0x7f285c0a7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:00.911 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.901+0000 7f285a59c700 1 -- 172.21.15.22:0/2687000514 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c009370 con 0x7f285c066ca0 2022-04-28T14:42:00.911 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.901+0000 7f285a59c700 1 --2- 172.21.15.22:0/2687000514 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f285c066ca0 0x7f285c116430 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f285000c4c0 tx=0x7f2850007dd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:42:00.911 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.901+0000 7f2842ffd700 1 -- 172.21.15.22:0/2687000514 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285000ce10 con 0x7f285c066ca0 2022-04-28T14:42:00.911 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.901+0000 7f2842ffd700 1 -- 172.21.15.22:0/2687000514 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2850007020 con 0x7f285c066ca0 2022-04-28T14:42:00.912 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.901+0000 7f286124b700 1 -- 172.21.15.22:0/2687000514 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f285c148260 con 0x7f285c066ca0 2022-04-28T14:42:00.912 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.901+0000 7f2842ffd700 1 -- 172.21.15.22:0/2687000514 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28500073c0 con 0x7f285c066ca0 2022-04-28T14:42:00.912 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.901+0000 7f286124b700 1 -- 172.21.15.22:0/2687000514 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f285c0a88b0 con 0x7f285c066ca0 2022-04-28T14:42:00.912 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.902+0000 7f286124b700 1 -- 172.21.15.22:0/2687000514 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f285c0a55e0 con 0x7f285c066ca0 2022-04-28T14:42:00.912 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.902+0000 7f2842ffd700 1 -- 172.21.15.22:0/2687000514 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f2850010070 con 0x7f285c066ca0 2022-04-28T14:42:00.912 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.902+0000 7f2842ffd700 1 -- 172.21.15.22:0/2687000514 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7f2850054660 con 0x7f285c066ca0 2022-04-28T14:42:00.912 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:00.906+0000 7f2842ffd700 1 -- 172.21.15.22:0/2687000514 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f2850034c40 con 0x7f285c066ca0 2022-04-28T14:42:01.054 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.049+0000 7f286124b700 1 -- 172.21.15.22:0/2687000514 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f285c116070 con 0x7f285c066ca0 2022-04-28T14:42:01.054 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.049+0000 7f2842ffd700 1 -- 172.21.15.22:0/2687000514 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7f285c116070 con 0x7f285c066ca0 2022-04-28T14:42:01.054 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2022-04-28T14:42:01.056 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.051+0000 7f286124b700 1 -- 172.21.15.22:0/2687000514 >> v1:172.21.15.22:6808/92758 conn(0x7f283c041b30 legacy=0x7f283c043ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:01.056 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.051+0000 7f286124b700 1 -- 172.21.15.22:0/2687000514 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f285c066ca0 msgr2=0x7f285c116430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:01.056 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.051+0000 7f286124b700 1 --2- 172.21.15.22:0/2687000514 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f285c066ca0 0x7f285c116430 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f285000c4c0 tx=0x7f2850007dd0).stop 2022-04-28T14:42:01.056 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.051+0000 7f286124b700 1 -- 172.21.15.22:0/2687000514 shutdown_connections 2022-04-28T14:42:01.056 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.051+0000 7f286124b700 1 --2- 172.21.15.22:0/2687000514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f285c069100 0x7f285c0a7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.056 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.051+0000 7f286124b700 1 --2- 172.21.15.22:0/2687000514 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f285c066860 0x7f285c1152d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.056 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.051+0000 7f286124b700 1 --2- 172.21.15.22:0/2687000514 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f285c066ca0 0x7f285c116430 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.056 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.051+0000 7f286124b700 1 -- 172.21.15.22:0/2687000514 >> 172.21.15.22:0/2687000514 conn(0x7f285c0ad210 msgr2=0x7f285c138e70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:42:01.057 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.051+0000 7f286124b700 1 -- 172.21.15.22:0/2687000514 shutdown_connections 2022-04-28T14:42:01.057 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.051+0000 7f286124b700 1 -- 172.21.15.22:0/2687000514 wait complete. 2022-04-28T14:42:01.067 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-04-28T14:42:01.189 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.184+0000 7f965ce90700 1 Processor -- start 2022-04-28T14:42:01.189 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.184+0000 7f965ce90700 1 -- start start 2022-04-28T14:42:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.185+0000 7f965ce90700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9658063e20 0x7f96580a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.185+0000 7f965ce90700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f96580a6cc0 0x7f9658142b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.185+0000 7f965ce90700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9658064200 con 0x7f96580a6640 2022-04-28T14:42:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.185+0000 7f965ce90700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96580a5c70 con 0x7f96580a6cc0 2022-04-28T14:42:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.185+0000 7f965ce90700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96580a61b0 con 0x7f9658063e20 2022-04-28T14:42:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.185+0000 7f965659c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9658063e20 0x7f96580a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:01.195 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.185+0000 7f9656d9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f96580a6cc0 0x7f9658142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:01.196 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.185+0000 7f9656d9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f96580a6cc0 0x7f9658142b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51450/0 (socket says 172.21.15.22:51450) 2022-04-28T14:42:01.196 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.185+0000 7f9656d9d700 1 -- 172.21.15.22:0/3927894407 learned_addr learned my addr 172.21.15.22:0/3927894407 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:42:01.196 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.185+0000 7f965659c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9658063e20 0x7f96580a4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48798/0 (socket says 172.21.15.22:48798) 2022-04-28T14:42:01.196 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.185+0000 7f9655d9b700 1 --1- 172.21.15.22:0/3927894407 >> v1:172.21.15.22:6789/0 conn(0x7f96580a6640 0x7f9658135640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40844/0 (socket says 172.21.15.22:40844) 2022-04-28T14:42:01.196 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.185+0000 7f965659c700 1 -- 172.21.15.22:0/3927894407 >> v2:172.21.15.22:3300/0 conn(0x7f96580a6cc0 msgr2=0x7f9658142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:42:01.196 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.185+0000 7f965659c700 1 --2- 172.21.15.22:0/3927894407 >> v2:172.21.15.22:3300/0 conn(0x7f96580a6cc0 0x7f9658142b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.196 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.185+0000 7f965659c700 1 -- 172.21.15.22:0/3927894407 >> v1:172.21.15.22:6789/0 conn(0x7f96580a6640 legacy=0x7f9658135640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:01.196 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.185+0000 7f965559a700 1 -- 172.21.15.22:0/3927894407 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3241714582 0 0) 0x7f9658064200 con 0x7f96580a6640 2022-04-28T14:42:01.196 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.185+0000 7f965659c700 1 -- 172.21.15.22:0/3927894407 --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96580a5070 con 0x7f9658063e20 2022-04-28T14:42:01.196 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.185+0000 7f9656d9d700 1 --2- 172.21.15.22:0/3927894407 >> v2:172.21.15.22:3300/0 conn(0x7f96580a6cc0 0x7f9658142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:42:01.197 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.185+0000 7f965659c700 1 --2- 172.21.15.22:0/3927894407 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9658063e20 0x7f96580a4a30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f964c009760 tx=0x7f964c009060).ready entity=mon.2 client_cookie=f08debcf28b4dfb8 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:42:01.197 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.186+0000 7f965559a700 1 -- 172.21.15.22:0/3927894407 <== mon.2 v2:172.21.15.22:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c00f510 con 0x7f9658063e20 2022-04-28T14:42:01.197 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.186+0000 7f965559a700 1 -- 172.21.15.22:0/3927894407 <== mon.2 v2:172.21.15.22:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964c00f670 con 0x7f9658063e20 2022-04-28T14:42:01.197 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.186+0000 7f965559a700 1 -- 172.21.15.22:0/3927894407 <== mon.2 v2:172.21.15.22:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c00f9f0 con 0x7f9658063e20 2022-04-28T14:42:01.197 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.186+0000 7f965ce90700 1 -- 172.21.15.22:0/3927894407 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9658063e20 msgr2=0x7f96580a4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:01.197 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.186+0000 7f965ce90700 1 --2- 172.21.15.22:0/3927894407 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9658063e20 0x7f96580a4a30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f964c009760 tx=0x7f964c009060).stop 2022-04-28T14:42:01.197 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.186+0000 7f965ce90700 1 -- 172.21.15.22:0/3927894407 shutdown_connections 2022-04-28T14:42:01.197 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.186+0000 7f965ce90700 1 --2- 172.21.15.22:0/3927894407 >> v2:172.21.15.22:3300/0 conn(0x7f96580a6cc0 0x7f9658142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.197 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.186+0000 7f965ce90700 1 --2- 172.21.15.22:0/3927894407 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9658063e20 0x7f96580a4a30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.197 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.186+0000 7f965ce90700 1 -- 172.21.15.22:0/3927894407 >> 172.21.15.22:0/3927894407 conn(0x7f9658066a00 msgr2=0x7f96580aaea0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:42:01.198 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.186+0000 7f965ce90700 1 -- 172.21.15.22:0/3927894407 shutdown_connections 2022-04-28T14:42:01.198 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.186+0000 7f965ce90700 1 -- 172.21.15.22:0/3927894407 wait complete. 2022-04-28T14:42:01.198 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.187+0000 7f965ce90700 1 Processor -- start 2022-04-28T14:42:01.198 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.187+0000 7f965ce90700 1 -- start start 2022-04-28T14:42:01.198 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.188+0000 7f965ce90700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9658063e20 0x7f9658113120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:01.198 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.188+0000 7f965ce90700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f96580a6640 0x7f9658114430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:01.198 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.188+0000 7f965ce90700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96580a6cc0 0x7f9658130200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:01.198 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.188+0000 7f965ce90700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965813b920 con 0x7f96580a6cc0 2022-04-28T14:42:01.198 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.188+0000 7f965ce90700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9658113aa0 con 0x7f96580a6640 2022-04-28T14:42:01.199 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.188+0000 7f965ce90700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f965813bb50 con 0x7f9658063e20 2022-04-28T14:42:01.199 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.188+0000 7f965659c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9658063e20 0x7f9658113120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:01.199 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.188+0000 7f965659c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9658063e20 0x7f9658113120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48804/0 (socket says 172.21.15.22:48804) 2022-04-28T14:42:01.199 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.188+0000 7f965659c700 1 -- 172.21.15.22:0/437358723 learned_addr learned my addr 172.21.15.22:0/437358723 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:42:01.199 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.188+0000 7f9655d9b700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f96580a6640 0x7f9658114430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:01.199 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.188+0000 7f9656d9d700 1 --2- 172.21.15.22:0/437358723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96580a6cc0 0x7f9658130200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:01.199 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.188+0000 7f9656d9d700 1 -- 172.21.15.22:0/437358723 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9658063e20 msgr2=0x7f9658113120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:01.199 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.188+0000 7f9656d9d700 1 --2- 172.21.15.22:0/437358723 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9658063e20 0x7f9658113120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.199 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.188+0000 7f9656d9d700 1 -- 172.21.15.22:0/437358723 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f96580a6640 msgr2=0x7f9658114430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:01.199 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.188+0000 7f9656d9d700 1 --2- 172.21.15.22:0/437358723 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f96580a6640 0x7f9658114430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.188+0000 7f9656d9d700 1 -- 172.21.15.22:0/437358723 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9650009ae0 con 0x7f96580a6cc0 2022-04-28T14:42:01.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.188+0000 7f965659c700 1 --2- 172.21.15.22:0/437358723 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9658063e20 0x7f9658113120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:42:01.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.188+0000 7f9656d9d700 1 --2- 172.21.15.22:0/437358723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96580a6cc0 0x7f9658130200 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f9650009e70 tx=0x7f965000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:42:01.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.188+0000 7f96467fc700 1 -- 172.21.15.22:0/437358723 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96500092e0 con 0x7f96580a6cc0 2022-04-28T14:42:01.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.188+0000 7f96467fc700 1 -- 172.21.15.22:0/437358723 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965000f040 con 0x7f96580a6cc0 2022-04-28T14:42:01.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.188+0000 7f965ce90700 1 -- 172.21.15.22:0/437358723 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f964c0092a0 con 0x7f96580a6cc0 2022-04-28T14:42:01.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.188+0000 7f96467fc700 1 -- 172.21.15.22:0/437358723 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965000caa0 con 0x7f96580a6cc0 2022-04-28T14:42:01.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.188+0000 7f965ce90700 1 -- 172.21.15.22:0/437358723 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96581348f0 con 0x7f96580a6cc0 2022-04-28T14:42:01.200 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.189+0000 7f96467fc700 1 -- 172.21.15.22:0/437358723 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f965001b030 con 0x7f96580a6cc0 2022-04-28T14:42:01.201 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.189+0000 7f965ce90700 1 -- 172.21.15.22:0/437358723 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9658046da0 con 0x7f96580a6cc0 2022-04-28T14:42:01.201 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.190+0000 7f96467fc700 1 -- 172.21.15.22:0/437358723 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7f9650055300 con 0x7f96580a6cc0 2022-04-28T14:42:01.201 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.193+0000 7f96467fc700 1 -- 172.21.15.22:0/437358723 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f96500358e0 con 0x7f96580a6cc0 2022-04-28T14:42:01.337 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.332+0000 7f965ce90700 1 -- 172.21.15.22:0/437358723 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f96580a4810 con 0x7f96580a6cc0 2022-04-28T14:42:01.337 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.332+0000 7f96467fc700 1 -- 172.21.15.22:0/437358723 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7f96500390d0 con 0x7f96580a6cc0 2022-04-28T14:42:01.338 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2022-04-28T14:42:01.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.334+0000 7f965ce90700 1 -- 172.21.15.22:0/437358723 >> v1:172.21.15.22:6808/92758 conn(0x7f9634041b00 legacy=0x7f9634043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:01.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.334+0000 7f965ce90700 1 -- 172.21.15.22:0/437358723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96580a6cc0 msgr2=0x7f9658130200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:01.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.334+0000 7f965ce90700 1 --2- 172.21.15.22:0/437358723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96580a6cc0 0x7f9658130200 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f9650009e70 tx=0x7f965000b040).stop 2022-04-28T14:42:01.340 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.334+0000 7f965ce90700 1 -- 172.21.15.22:0/437358723 shutdown_connections 2022-04-28T14:42:01.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.334+0000 7f965ce90700 1 --2- 172.21.15.22:0/437358723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f96580a6cc0 0x7f9658130200 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.334+0000 7f965ce90700 1 --2- 172.21.15.22:0/437358723 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f9658063e20 0x7f9658113120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.334+0000 7f965ce90700 1 --2- 172.21.15.22:0/437358723 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f96580a6640 0x7f9658114430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.341 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.334+0000 7f965ce90700 1 -- 172.21.15.22:0/437358723 >> 172.21.15.22:0/437358723 conn(0x7f9658066a00 msgr2=0x7f9658135250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:42:01.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.334+0000 7f965ce90700 1 -- 172.21.15.22:0/437358723 shutdown_connections 2022-04-28T14:42:01.342 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.334+0000 7f965ce90700 1 -- 172.21.15.22:0/437358723 wait complete. 2022-04-28T14:42:01.350 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-04-28T14:42:01.508 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.504+0000 7f2e90800700 1 Processor -- start 2022-04-28T14:42:01.509 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.504+0000 7f2e90800700 1 -- start start 2022-04-28T14:42:01.514 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.504+0000 7f2e90800700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2e880a19e0 0x7f2e880a3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:01.514 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.504+0000 7f2e90800700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2e88068470 0x7f2e88143230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:01.514 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.504+0000 7f2e90800700 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e880abb50 con 0x7f2e880af2e0 2022-04-28T14:42:01.514 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.504+0000 7f2e90800700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e880a3e50 con 0x7f2e88068470 2022-04-28T14:42:01.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.504+0000 7f2e90800700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e880af6c0 con 0x7f2e880a19e0 2022-04-28T14:42:01.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.504+0000 7f2e8ed9d700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2e88068470 0x7f2e88143230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:01.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.504+0000 7f2e8dd9b700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2e880a19e0 0x7f2e880a3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:01.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.504+0000 7f2e8e59c700 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2e880af2e0 0x7f2e88067d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40856/0 (socket says 172.21.15.22:40856) 2022-04-28T14:42:01.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.505+0000 7f2e8e59c700 1 -- 172.21.15.22:0/655469585 learned_addr learned my addr 172.21.15.22:0/655469585 (peer_addr_for_me v1:172.21.15.22:0/0) 2022-04-28T14:42:01.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.505+0000 7f2e8ed9d700 1 -- 172.21.15.22:0/655469585 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2e880a19e0 msgr2=0x7f2e880a3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:42:01.515 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.505+0000 7f2e8ed9d700 1 --2- 172.21.15.22:0/655469585 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2e880a19e0 0x7f2e880a3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.505+0000 7f2e8ed9d700 1 -- 172.21.15.22:0/655469585 >> v1:172.21.15.22:6789/0 conn(0x7f2e880af2e0 legacy=0x7f2e88067d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:01.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.505+0000 7f2e8ed9d700 1 -- 172.21.15.22:0/655469585 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e880a2f30 con 0x7f2e88068470 2022-04-28T14:42:01.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.505+0000 7f2e8d59a700 1 -- 172.21.15.22:0/655469585 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2644082560 0 0) 0x7f2e880abb50 con 0x7f2e880af2e0 2022-04-28T14:42:01.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.505+0000 7f2e8dd9b700 1 --2- 172.21.15.22:0/655469585 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2e880a19e0 0x7f2e880a3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:42:01.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.505+0000 7f2e8ed9d700 1 --2- 172.21.15.22:0/655469585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e88068470 0x7f2e88143230 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f2e84009e60 tx=0x7f2e84009780).ready entity=mon.0 client_cookie=84e864e856d236ef server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:42:01.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.505+0000 7f2e8d59a700 1 -- 172.21.15.22:0/655469585 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8400e070 con 0x7f2e88068470 2022-04-28T14:42:01.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.505+0000 7f2e8d59a700 1 -- 172.21.15.22:0/655469585 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8400bb60 con 0x7f2e88068470 2022-04-28T14:42:01.516 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.505+0000 7f2e8d59a700 1 -- 172.21.15.22:0/655469585 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84012410 con 0x7f2e88068470 2022-04-28T14:42:01.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.506+0000 7f2e90800700 1 -- 172.21.15.22:0/655469585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e88068470 msgr2=0x7f2e88143230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:01.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.506+0000 7f2e90800700 1 --2- 172.21.15.22:0/655469585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e88068470 0x7f2e88143230 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f2e84009e60 tx=0x7f2e84009780).stop 2022-04-28T14:42:01.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.506+0000 7f2e90800700 1 -- 172.21.15.22:0/655469585 shutdown_connections 2022-04-28T14:42:01.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.506+0000 7f2e90800700 1 --2- 172.21.15.22:0/655469585 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e88068470 0x7f2e88143230 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.506+0000 7f2e90800700 1 --2- 172.21.15.22:0/655469585 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2e880a19e0 0x7f2e880a3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.506+0000 7f2e90800700 1 -- 172.21.15.22:0/655469585 >> 172.21.15.22:0/655469585 conn(0x7f2e880634a0 msgr2=0x7f2e880aea10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:42:01.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.506+0000 7f2e90800700 1 -- 172.21.15.22:0/655469585 shutdown_connections 2022-04-28T14:42:01.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.506+0000 7f2e90800700 1 -- 172.21.15.22:0/655469585 wait complete. 2022-04-28T14:42:01.517 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.507+0000 7f2e90800700 1 Processor -- start 2022-04-28T14:42:01.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.507+0000 7f2e90800700 1 -- start start 2022-04-28T14:42:01.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.507+0000 7f2e90800700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2e88068470 0x7f2e88096ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:01.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.507+0000 7f2e90800700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2e880a19e0 0x7f2e880951d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:01.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.507+0000 7f2e90800700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e880af2e0 0x7f2e8813a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:01.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.507+0000 7f2e90800700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e88096100 con 0x7f2e880af2e0 2022-04-28T14:42:01.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.507+0000 7f2e90800700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e88097490 con 0x7f2e880a19e0 2022-04-28T14:42:01.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.507+0000 7f2e90800700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e880a8a00 con 0x7f2e88068470 2022-04-28T14:42:01.518 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.507+0000 7f2e8dd9b700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2e880a19e0 0x7f2e880951d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:01.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.507+0000 7f2e8e59c700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2e88068470 0x7f2e88096ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:01.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.507+0000 7f2e8dd9b700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2e880a19e0 0x7f2e880951d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:49036/0 (socket says 172.21.15.22:49036) 2022-04-28T14:42:01.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.507+0000 7f2e8dd9b700 1 -- 172.21.15.22:0/970145226 learned_addr learned my addr 172.21.15.22:0/970145226 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:42:01.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.507+0000 7f2e8ed9d700 1 --2- 172.21.15.22:0/970145226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e880af2e0 0x7f2e8813a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:01.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.508+0000 7f2e8dd9b700 1 -- 172.21.15.22:0/970145226 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2e88068470 msgr2=0x7f2e88096ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:01.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.508+0000 7f2e8dd9b700 1 --2- 172.21.15.22:0/970145226 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2e88068470 0x7f2e88096ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.508+0000 7f2e8dd9b700 1 -- 172.21.15.22:0/970145226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e880af2e0 msgr2=0x7f2e8813a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:01.519 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.508+0000 7f2e8dd9b700 1 --2- 172.21.15.22:0/970145226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e880af2e0 0x7f2e8813a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.520 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.508+0000 7f2e8dd9b700 1 -- 172.21.15.22:0/970145226 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e740092a0 con 0x7f2e880a19e0 2022-04-28T14:42:01.520 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.508+0000 7f2e8e59c700 1 --2- 172.21.15.22:0/970145226 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2e88068470 0x7f2e88096ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:42:01.520 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.508+0000 7f2e8dd9b700 1 --2- 172.21.15.22:0/970145226 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2e880a19e0 0x7f2e880951d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f2e7400e9a0 tx=0x7f2e74009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:42:01.520 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.508+0000 7f2e827fc700 1 -- 172.21.15.22:0/970145226 <== mon.1 v2:172.21.15.22:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7400c670 con 0x7f2e880a19e0 2022-04-28T14:42:01.523 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.508+0000 7f2e827fc700 1 -- 172.21.15.22:0/970145226 <== mon.1 v2:172.21.15.22:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7400c7d0 con 0x7f2e880a19e0 2022-04-28T14:42:01.524 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.508+0000 7f2e90800700 1 -- 172.21.15.22:0/970145226 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e84009a20 con 0x7f2e880a19e0 2022-04-28T14:42:01.524 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.508+0000 7f2e827fc700 1 -- 172.21.15.22:0/970145226 <== mon.1 v2:172.21.15.22:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7400cb50 con 0x7f2e880a19e0 2022-04-28T14:42:01.524 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.508+0000 7f2e90800700 1 -- 172.21.15.22:0/970145226 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e880a9680 con 0x7f2e880a19e0 2022-04-28T14:42:01.524 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.509+0000 7f2e90800700 1 -- 172.21.15.22:0/970145226 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e88046da0 con 0x7f2e880a19e0 2022-04-28T14:42:01.524 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.509+0000 7f2e827fc700 1 -- 172.21.15.22:0/970145226 <== mon.1 v2:172.21.15.22:3301/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7f2e74022070 con 0x7f2e880a19e0 2022-04-28T14:42:01.524 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.509+0000 7f2e827fc700 1 -- 172.21.15.22:0/970145226 <== mon.1 v2:172.21.15.22:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7f2e74055830 con 0x7f2e880a19e0 2022-04-28T14:42:01.525 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.513+0000 7f2e827fc700 1 -- 172.21.15.22:0/970145226 <== mon.1 v2:172.21.15.22:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7f2e74035e10 con 0x7f2e880a19e0 2022-04-28T14:42:01.656 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.651+0000 7f2e90800700 1 -- 172.21.15.22:0/970145226 --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2e88095720 con 0x7f2e880a19e0 2022-04-28T14:42:01.657 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.652+0000 7f2e827fc700 1 -- 172.21.15.22:0/970145226 <== mon.1 v2:172.21.15.22:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v39) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2e74016030 con 0x7f2e880a19e0 2022-04-28T14:42:01.657 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2022-04-28T14:42:01.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.653+0000 7f2e90800700 1 -- 172.21.15.22:0/970145226 >> v1:172.21.15.22:6808/92758 conn(0x7f2e70041b30 legacy=0x7f2e70043ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:01.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.653+0000 7f2e90800700 1 -- 172.21.15.22:0/970145226 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2e880a19e0 msgr2=0x7f2e880951d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:01.658 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.653+0000 7f2e90800700 1 --2- 172.21.15.22:0/970145226 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2e880a19e0 0x7f2e880951d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f2e7400e9a0 tx=0x7f2e74009060).stop 2022-04-28T14:42:01.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.653+0000 7f2e90800700 1 -- 172.21.15.22:0/970145226 shutdown_connections 2022-04-28T14:42:01.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.653+0000 7f2e90800700 1 --2- 172.21.15.22:0/970145226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2e880af2e0 0x7f2e8813a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.653+0000 7f2e90800700 1 --2- 172.21.15.22:0/970145226 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7f2e88068470 0x7f2e88096ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.653+0000 7f2e90800700 1 --2- 172.21.15.22:0/970145226 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7f2e880a19e0 0x7f2e880951d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.653+0000 7f2e90800700 1 -- 172.21.15.22:0/970145226 >> 172.21.15.22:0/970145226 conn(0x7f2e880634a0 msgr2=0x7f2e880ae030 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:42:01.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.653+0000 7f2e90800700 1 -- 172.21.15.22:0/970145226 shutdown_connections 2022-04-28T14:42:01.659 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.653+0000 7f2e90800700 1 -- 172.21.15.22:0/970145226 wait complete. 2022-04-28T14:42:01.670 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-04-28T14:42:01.790 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.782+0000 7fa2acdfe700 1 Processor -- start 2022-04-28T14:42:01.791 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.782+0000 7fa2acdfe700 1 -- start start 2022-04-28T14:42:01.791 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.783+0000 7fa2acdfe700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa2a8068130 0x7fa2a8066c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:01.791 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.783+0000 7fa2acdfe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa2a8068d00 0x7fa2a8061f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:01.791 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.783+0000 7fa2acdfe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa2a8062420 0x7fa2a80628d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:01.791 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.783+0000 7fa2acdfe700 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a8067330 con 0x7fa2a8068130 2022-04-28T14:42:01.791 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.783+0000 7fa2acdfe700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a80aa710 con 0x7fa2a8062420 2022-04-28T14:42:01.791 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.783+0000 7fa2acdfe700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a80a5bc0 con 0x7fa2a8068d00 2022-04-28T14:42:01.792 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.783+0000 7fa2a659c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa2a8068130 0x7fa2a8066c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:01.792 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.783+0000 7fa2a5d9b700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa2a8068d00 0x7fa2a8061f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:01.792 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.783+0000 7fa2a6d9d700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa2a8062420 0x7fa2a80628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:01.792 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.783+0000 7fa2a659c700 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa2a8068130 0x7fa2a8066c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51476/0 (socket says 172.21.15.22:51476) 2022-04-28T14:42:01.792 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.783+0000 7fa2a5d9b700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa2a8068d00 0x7fa2a8061f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3302/0 says I am v2:172.21.15.22:48826/0 (socket says 172.21.15.22:48826) 2022-04-28T14:42:01.792 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.784+0000 7fa2a659c700 1 -- 172.21.15.22:0/2009462603 learned_addr learned my addr 172.21.15.22:0/2009462603 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:42:01.792 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.784+0000 7fa2a659c700 1 -- 172.21.15.22:0/2009462603 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa2a8068d00 msgr2=0x7fa2a8061f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:42:01.792 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.784+0000 7fa2a659c700 1 --2- 172.21.15.22:0/2009462603 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa2a8068d00 0x7fa2a8061f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.793 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.784+0000 7fa2a659c700 1 -- 172.21.15.22:0/2009462603 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa2a8062420 msgr2=0x7fa2a80628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-04-28T14:42:01.793 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.784+0000 7fa2a659c700 1 --2- 172.21.15.22:0/2009462603 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa2a8062420 0x7fa2a80628d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.793 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.784+0000 7fa2a659c700 1 -- 172.21.15.22:0/2009462603 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a80aa290 con 0x7fa2a8068130 2022-04-28T14:42:01.793 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.784+0000 7fa2a5d9b700 1 --2- 172.21.15.22:0/2009462603 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa2a8068d00 0x7fa2a8061f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:42:01.793 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.784+0000 7fa2a659c700 1 --2- 172.21.15.22:0/2009462603 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2a8068130 0x7fa2a8066c70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fa298006fd0 tx=0x7fa2980090f0).ready entity=mon.0 client_cookie=807c759fd42cedf1 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:42:01.793 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.784+0000 7fa2a559a700 1 -- 172.21.15.22:0/2009462603 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29800f510 con 0x7fa2a8068130 2022-04-28T14:42:01.793 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.784+0000 7fa2a559a700 1 -- 172.21.15.22:0/2009462603 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29800f670 con 0x7fa2a8068130 2022-04-28T14:42:01.793 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.784+0000 7fa2a559a700 1 -- 172.21.15.22:0/2009462603 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29800f9f0 con 0x7fa2a8068130 2022-04-28T14:42:01.793 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.785+0000 7fa2acdfe700 1 -- 172.21.15.22:0/2009462603 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2a8068130 msgr2=0x7fa2a8066c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:01.794 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.785+0000 7fa2acdfe700 1 --2- 172.21.15.22:0/2009462603 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2a8068130 0x7fa2a8066c70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fa298006fd0 tx=0x7fa2980090f0).stop 2022-04-28T14:42:01.794 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.785+0000 7fa2acdfe700 1 -- 172.21.15.22:0/2009462603 shutdown_connections 2022-04-28T14:42:01.794 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.785+0000 7fa2acdfe700 1 --2- 172.21.15.22:0/2009462603 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa2a8062420 0x7fa2a80628d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.794 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.785+0000 7fa2acdfe700 1 --2- 172.21.15.22:0/2009462603 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2a8068130 0x7fa2a8066c70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.794 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.785+0000 7fa2acdfe700 1 --2- 172.21.15.22:0/2009462603 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa2a8068d00 0x7fa2a8061f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.794 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.785+0000 7fa2acdfe700 1 -- 172.21.15.22:0/2009462603 >> 172.21.15.22:0/2009462603 conn(0x7fa2a80ae9d0 msgr2=0x7fa2a80aede0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:42:01.794 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.785+0000 7fa2acdfe700 1 -- 172.21.15.22:0/2009462603 shutdown_connections 2022-04-28T14:42:01.794 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.785+0000 7fa2acdfe700 1 -- 172.21.15.22:0/2009462603 wait complete. 2022-04-28T14:42:01.794 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.786+0000 7fa2acdfe700 1 Processor -- start 2022-04-28T14:42:01.795 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.786+0000 7fa2acdfe700 1 -- start start 2022-04-28T14:42:01.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.786+0000 7fa2acdfe700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2a8062420 0x7fa2a809b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:01.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.786+0000 7fa2acdfe700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa2a8068130 0x7fa2a809a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:01.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.786+0000 7fa2acdfe700 1 --2- >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa2a8068d00 0x7fa2a814b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-04-28T14:42:01.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.786+0000 7fa2acdfe700 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a809bcc0 con 0x7fa2a8062420 2022-04-28T14:42:01.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.786+0000 7fa2acdfe700 1 -- --> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a809ad00 con 0x7fa2a8068130 2022-04-28T14:42:01.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.786+0000 7fa2acdfe700 1 -- --> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a8097460 con 0x7fa2a8068d00 2022-04-28T14:42:01.797 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.786+0000 7fa2a659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2a8062420 0x7fa2a809b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:01.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.786+0000 7fa2a5d9b700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa2a8068130 0x7fa2a809a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:01.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.786+0000 7fa2a659c700 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2a8062420 0x7fa2a809b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51480/0 (socket says 172.21.15.22:51480) 2022-04-28T14:42:01.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.786+0000 7fa2a5d9b700 1 --2- >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa2a8068130 0x7fa2a809a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.22:3301/0 says I am v2:172.21.15.22:49050/0 (socket says 172.21.15.22:49050) 2022-04-28T14:42:01.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.786+0000 7fa2a659c700 1 -- 172.21.15.22:0/144900382 learned_addr learned my addr 172.21.15.22:0/144900382 (peer_addr_for_me v2:172.21.15.22:0/0) 2022-04-28T14:42:01.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.786+0000 7fa2a6d9d700 1 --2- 172.21.15.22:0/144900382 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa2a8068d00 0x7fa2a814b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-04-28T14:42:01.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.787+0000 7fa2a659c700 1 -- 172.21.15.22:0/144900382 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa2a8068d00 msgr2=0x7fa2a814b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:01.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.787+0000 7fa2a659c700 1 --2- 172.21.15.22:0/144900382 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa2a8068d00 0x7fa2a814b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.787+0000 7fa2a659c700 1 -- 172.21.15.22:0/144900382 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa2a8068130 msgr2=0x7fa2a809a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:01.798 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.787+0000 7fa2a659c700 1 --2- 172.21.15.22:0/144900382 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa2a8068130 0x7fa2a809a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.799 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.787+0000 7fa2a659c700 1 -- 172.21.15.22:0/144900382 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2900092a0 con 0x7fa2a8062420 2022-04-28T14:42:01.799 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.787+0000 7fa2a5d9b700 1 --2- 172.21.15.22:0/144900382 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa2a8068130 0x7fa2a809a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-04-28T14:42:01.799 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.787+0000 7fa2a659c700 1 --2- 172.21.15.22:0/144900382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2a8062420 0x7fa2a809b3a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fa2a8067470 tx=0x7fa298017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-04-28T14:42:01.799 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.787+0000 7fa29e7fc700 1 -- 172.21.15.22:0/144900382 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29800fe30 con 0x7fa2a8062420 2022-04-28T14:42:01.799 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.787+0000 7fa29e7fc700 1 -- 172.21.15.22:0/144900382 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29800f7e0 con 0x7fa2a8062420 2022-04-28T14:42:01.799 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.787+0000 7fa29e7fc700 1 -- 172.21.15.22:0/144900382 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29801c670 con 0x7fa2a8062420 2022-04-28T14:42:01.799 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.787+0000 7fa2acdfe700 1 -- 172.21.15.22:0/144900382 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa298009370 con 0x7fa2a8062420 2022-04-28T14:42:01.799 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.787+0000 7fa2acdfe700 1 -- 172.21.15.22:0/144900382 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a8099120 con 0x7fa2a8062420 2022-04-28T14:42:01.799 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.788+0000 7fa2acdfe700 1 -- 172.21.15.22:0/144900382 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a8065a50 con 0x7fa2a8062420 2022-04-28T14:42:01.799 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.789+0000 7fa29e7fc700 1 -- 172.21.15.22:0/144900382 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 8) v1 ==== 48574+0+0 (secure 0 0 0) 0x7fa29802c070 con 0x7fa2a8062420 2022-04-28T14:42:01.800 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.789+0000 7fa29e7fc700 1 -- 172.21.15.22:0/144900382 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3793+0+0 (secure 0 0 0) 0x7fa298057450 con 0x7fa2a8062420 2022-04-28T14:42:01.800 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.792+0000 7fa29e7fc700 1 -- 172.21.15.22:0/144900382 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+125807 (secure 0 0 0) 0x7fa298051b80 con 0x7fa2a8062420 2022-04-28T14:42:01.963 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.959+0000 7fa2acdfe700 1 -- 172.21.15.22:0/144900382 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2a80a3be0 con 0x7fa2a8062420 2022-04-28T14:42:01.964 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.959+0000 7fa29e7fc700 1 -- 172.21.15.22:0/144900382 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3560 (secure 0 0 0) 0x7fa298020e00 con 0x7fa2a8062420 2022-04-28T14:42:01.964 INFO:teuthology.orchestra.run.smithi022.stdout: 2022-04-28T14:42:01.965 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":true},"standbys":[{"gid":14329,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6819/3435808483","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6819","nonce":3435808483}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":14448,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6817/1307728249","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6817","nonce":1307728249}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-04-28T14:39:13.928436+0000","modified":"2022-04-28T14:41:51.946964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14457},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14457":{"gid":14457,"name":"c","rank":0,"incarnation":16,"state":"up:active","state_seq":4,"addr":"172.21.15.22:6818/2278609167","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6818","nonce":2278609167}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-04-28T14:42:01.966 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.961+0000 7fa2acdfe700 1 -- 172.21.15.22:0/144900382 >> v1:172.21.15.22:6808/92758 conn(0x7fa28c041b00 legacy=0x7fa28c043fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:01.966 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.961+0000 7fa2acdfe700 1 -- 172.21.15.22:0/144900382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2a8062420 msgr2=0x7fa2a809b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-04-28T14:42:01.966 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.961+0000 7fa2acdfe700 1 --2- 172.21.15.22:0/144900382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2a8062420 0x7fa2a809b3a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fa2a8067470 tx=0x7fa298017000).stop 2022-04-28T14:42:01.966 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.961+0000 7fa2acdfe700 1 -- 172.21.15.22:0/144900382 shutdown_connections 2022-04-28T14:42:01.967 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.961+0000 7fa2acdfe700 1 --2- 172.21.15.22:0/144900382 >> [v2:172.21.15.22:3302/0,v1:172.21.15.22:6791/0] conn(0x7fa2a8068d00 0x7fa2a814b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.967 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.961+0000 7fa2acdfe700 1 --2- 172.21.15.22:0/144900382 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa2a8062420 0x7fa2a809b3a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.967 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.961+0000 7fa2acdfe700 1 --2- 172.21.15.22:0/144900382 >> [v2:172.21.15.22:3301/0,v1:172.21.15.22:6790/0] conn(0x7fa2a8068130 0x7fa2a809a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-04-28T14:42:01.967 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.961+0000 7fa2acdfe700 1 -- 172.21.15.22:0/144900382 >> 172.21.15.22:0/144900382 conn(0x7fa2a80ae9d0 msgr2=0x7fa2a80ab860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-04-28T14:42:01.967 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.961+0000 7fa2acdfe700 1 -- 172.21.15.22:0/144900382 shutdown_connections 2022-04-28T14:42:01.967 INFO:teuthology.orchestra.run.smithi022.stderr:2022-04-28T14:42:01.961+0000 7fa2acdfe700 1 -- 172.21.15.22:0/144900382 wait complete. 2022-04-28T14:42:01.967 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 19 2022-04-28T14:42:02.178 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/teuthology/run_tasks.py", line 103, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/teuthology/run_tasks.py", line 82, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_4fa079ba14503defa8dc257d7c2d506ebefcfe6d/qa/tasks/ceph.py", line 1478, in healthy ceph_fs.wait_for_daemons(timeout=300) File "/home/teuthworker/src/github.com_ceph_ceph-c_4fa079ba14503defa8dc257d7c2d506ebefcfe6d/qa/tasks/cephfs/filesystem.py", line 1101, in wait_for_daemons if self.are_daemons_healthy(status=status, skip_max_mds_check=skip_max_mds_check): File "/home/teuthworker/src/github.com_ceph_ceph-c_4fa079ba14503defa8dc257d7c2d506ebefcfe6d/qa/tasks/cephfs/filesystem.py", line 948, in are_daemons_healthy mds.check_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/teuthology/orchestra/daemon/state.py", line 43, in check_status return self.proc.poll() File "/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/teuthology/orchestra/run.py", line 211, in poll self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi022 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2022-04-28T14:42:02.271 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=5aaffd642ce54b3e9a19719601af60c3 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/teuthology/run_tasks.py", line 103, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/teuthology/run_tasks.py", line 82, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_4fa079ba14503defa8dc257d7c2d506ebefcfe6d/qa/tasks/ceph.py", line 1478, in healthy ceph_fs.wait_for_daemons(timeout=300) File "/home/teuthworker/src/github.com_ceph_ceph-c_4fa079ba14503defa8dc257d7c2d506ebefcfe6d/qa/tasks/cephfs/filesystem.py", line 1101, in wait_for_daemons if self.are_daemons_healthy(status=status, skip_max_mds_check=skip_max_mds_check): File "/home/teuthworker/src/github.com_ceph_ceph-c_4fa079ba14503defa8dc257d7c2d506ebefcfe6d/qa/tasks/cephfs/filesystem.py", line 948, in are_daemons_healthy mds.check_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/teuthology/orchestra/daemon/state.py", line 43, in check_status return self.proc.poll() File "/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/teuthology/orchestra/run.py", line 211, in poll self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi022 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2022-04-28T14:42:02.274 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2022-04-28T14:42:02.288 DEBUG:teuthology.run_tasks:Unwinding manager ceph.stop 2022-04-28T14:42:02.328 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2022-04-28T14:42:02.371 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2022-04-28T14:42:02.412 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2022-04-28T14:42:02.453 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2022-04-28T14:42:02.504 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2022-04-28T14:42:02.505 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2022-04-28T14:42:02.505 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-04-28T14:42:02.505 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2022-04-28T14:42:02.542 INFO:teuthology.orchestra.run.smithi037.stderr:fusermount: failed to unmount /home/ubuntu/cephtest/mnt.0: Device or resource busy 2022-04-28T14:42:02.543 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-04-28T14:42:02.544 INFO:tasks.cephfs.fuse_mount:Failed to unmount ceph-fuse on ubuntu@smithi037.front.sepia.ceph.com, aborting... 2022-04-28T14:42:02.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-04-28T14:42:02.544 DEBUG:teuthology.orchestra.run.smithi037:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2022-04-28T14:42:26.876 INFO:tasks.ceph.mds.a.smithi022.stderr:2022-04-28T14:42:26.872+0000 7f881a42a700 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2022-04-28T14:42:28.880 INFO:tasks.ceph.mds.a.smithi022.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.7-969-g4fa079ba/rpm/el8/BUILD/ceph-16.2.7-969-g4fa079ba/src/mds/CDir.cc: In function 'bool CDir::check_rstats(bool)' thread 7f881bc2d700 time 2022-04-28T14:42:28.877498+0000 2022-04-28T14:42:28.881 INFO:tasks.ceph.mds.a.smithi022.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.7-969-g4fa079ba/rpm/el8/BUILD/ceph-16.2.7-969-g4fa079ba/src/mds/CDir.cc: 292: FAILED ceph_assert(frag_info.nsubdirs == fnode->fragstat.nsubdirs) 2022-04-28T14:42:28.882 INFO:tasks.ceph.mds.a.smithi022.stderr: ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable) 2022-04-28T14:42:28.882 INFO:tasks.ceph.mds.a.smithi022.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f8828c4cd48] 2022-04-28T14:42:28.882 INFO:tasks.ceph.mds.a.smithi022.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x276f62) [0x7f8828c4cf62] 2022-04-28T14:42:28.882 INFO:tasks.ceph.mds.a.smithi022.stderr: 3: (CDir::check_rstats(bool)+0x17dd) [0x561bf058842d] 2022-04-28T14:42:28.882 INFO:tasks.ceph.mds.a.smithi022.stderr: 4: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0xd56) [0x561bf0439206] 2022-04-28T14:42:28.883 INFO:tasks.ceph.mds.a.smithi022.stderr: 5: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x8de) [0x561bf043b2de] 2022-04-28T14:42:28.883 INFO:tasks.ceph.mds.a.smithi022.stderr: 6: (MDCache::populate_mydir()+0x806) [0x561bf0481bb6] 2022-04-28T14:42:28.883 INFO:tasks.ceph.mds.a.smithi022.stderr: 7: (MDCache::open_root()+0xd8) [0x561bf0481ea8] 2022-04-28T14:42:28.883 INFO:tasks.ceph.mds.a.smithi022.stderr: 8: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x561bf04e6ab7] 2022-04-28T14:42:28.883 INFO:tasks.ceph.mds.a.smithi022.stderr: 9: (MDSContext::complete(int)+0x203) [0x561bf0645f93] 2022-04-28T14:42:28.883 INFO:tasks.ceph.mds.a.smithi022.stderr: 10: (MDSRank::_advance_queues()+0x84) [0x561bf033ec64] 2022-04-28T14:42:28.884 INFO:tasks.ceph.mds.a.smithi022.stderr: 11: (MDSRank::ProgressThread::entry()+0xc5) [0x561bf033f385] 2022-04-28T14:42:28.884 INFO:tasks.ceph.mds.a.smithi022.stderr: 12: /lib64/libpthread.so.0(+0x81cf) [0x7f8827c301cf] 2022-04-28T14:42:28.884 INFO:tasks.ceph.mds.a.smithi022.stderr: 13: clone() 2022-04-28T14:42:28.884 INFO:tasks.ceph.mds.a.smithi022.stderr:2022-04-28T14:42:28.878+0000 7f881bc2d700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.7-969-g4fa079ba/rpm/el8/BUILD/ceph-16.2.7-969-g4fa079ba/src/mds/CDir.cc: In function 'bool CDir::check_rstats(bool)' thread 7f881bc2d700 time 2022-04-28T14:42:28.877498+0000 2022-04-28T14:42:28.884 INFO:tasks.ceph.mds.a.smithi022.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.7-969-g4fa079ba/rpm/el8/BUILD/ceph-16.2.7-969-g4fa079ba/src/mds/CDir.cc: 292: FAILED ceph_assert(frag_info.nsubdirs == fnode->fragstat.nsubdirs) 2022-04-28T14:42:28.884 INFO:tasks.ceph.mds.a.smithi022.stderr: 2022-04-28T14:42:28.884 INFO:tasks.ceph.mds.a.smithi022.stderr: ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable) 2022-04-28T14:42:28.885 INFO:tasks.ceph.mds.a.smithi022.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f8828c4cd48] 2022-04-28T14:42:28.885 INFO:tasks.ceph.mds.a.smithi022.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x276f62) [0x7f8828c4cf62] 2022-04-28T14:42:28.885 INFO:tasks.ceph.mds.a.smithi022.stderr: 3: (CDir::check_rstats(bool)+0x17dd) [0x561bf058842d] 2022-04-28T14:42:28.885 INFO:tasks.ceph.mds.a.smithi022.stderr: 4: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0xd56) [0x561bf0439206] 2022-04-28T14:42:28.885 INFO:tasks.ceph.mds.a.smithi022.stderr: 5: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x8de) [0x561bf043b2de] 2022-04-28T14:42:28.885 INFO:tasks.ceph.mds.a.smithi022.stderr: 6: (MDCache::populate_mydir()+0x806) [0x561bf0481bb6] 2022-04-28T14:42:28.886 INFO:tasks.ceph.mds.a.smithi022.stderr: 7: (MDCache::open_root()+0xd8) [0x561bf0481ea8] 2022-04-28T14:42:28.886 INFO:tasks.ceph.mds.a.smithi022.stderr: 8: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x561bf04e6ab7] 2022-04-28T14:42:28.886 INFO:tasks.ceph.mds.a.smithi022.stderr: 9: (MDSContext::complete(int)+0x203) [0x561bf0645f93] 2022-04-28T14:42:28.886 INFO:tasks.ceph.mds.a.smithi022.stderr: 10: (MDSRank::_advance_queues()+0x84) [0x561bf033ec64] 2022-04-28T14:42:28.886 INFO:tasks.ceph.mds.a.smithi022.stderr: 11: (MDSRank::ProgressThread::entry()+0xc5) [0x561bf033f385] 2022-04-28T14:42:28.886 INFO:tasks.ceph.mds.a.smithi022.stderr: 12: /lib64/libpthread.so.0(+0x81cf) [0x7f8827c301cf] 2022-04-28T14:42:28.886 INFO:tasks.ceph.mds.a.smithi022.stderr: 13: clone() 2022-04-28T14:42:28.887 INFO:tasks.ceph.mds.a.smithi022.stderr: 2022-04-28T14:42:28.887 INFO:tasks.ceph.mds.a.smithi022.stderr:*** Caught signal (Aborted) ** 2022-04-28T14:42:28.887 INFO:tasks.ceph.mds.a.smithi022.stderr: in thread 7f881bc2d700 thread_name:mds_rank_progr 2022-04-28T14:42:28.888 INFO:tasks.ceph.mds.a.smithi022.stderr: ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable) 2022-04-28T14:42:28.888 INFO:tasks.ceph.mds.a.smithi022.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f8827c3ace0] 2022-04-28T14:42:28.888 INFO:tasks.ceph.mds.a.smithi022.stderr: 2: gsignal() 2022-04-28T14:42:28.889 INFO:tasks.ceph.mds.a.smithi022.stderr: 3: abort() 2022-04-28T14:42:28.889 INFO:tasks.ceph.mds.a.smithi022.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7f8828c4cd99] 2022-04-28T14:42:28.889 INFO:tasks.ceph.mds.a.smithi022.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x276f62) [0x7f8828c4cf62] 2022-04-28T14:42:28.889 INFO:tasks.ceph.mds.a.smithi022.stderr: 6: (CDir::check_rstats(bool)+0x17dd) [0x561bf058842d] 2022-04-28T14:42:28.889 INFO:tasks.ceph.mds.a.smithi022.stderr: 7: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0xd56) [0x561bf0439206] 2022-04-28T14:42:28.889 INFO:tasks.ceph.mds.a.smithi022.stderr: 8: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x8de) [0x561bf043b2de] 2022-04-28T14:42:28.890 INFO:tasks.ceph.mds.a.smithi022.stderr: 9: (MDCache::populate_mydir()+0x806) [0x561bf0481bb6] 2022-04-28T14:42:28.890 INFO:tasks.ceph.mds.a.smithi022.stderr: 10: (MDCache::open_root()+0xd8) [0x561bf0481ea8] 2022-04-28T14:42:28.890 INFO:tasks.ceph.mds.a.smithi022.stderr: 11: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x561bf04e6ab7] 2022-04-28T14:42:28.890 INFO:tasks.ceph.mds.a.smithi022.stderr: 12: (MDSContext::complete(int)+0x203) [0x561bf0645f93] 2022-04-28T14:42:28.890 INFO:tasks.ceph.mds.a.smithi022.stderr: 13: (MDSRank::_advance_queues()+0x84) [0x561bf033ec64] 2022-04-28T14:42:28.890 INFO:tasks.ceph.mds.a.smithi022.stderr: 14: (MDSRank::ProgressThread::entry()+0xc5) [0x561bf033f385] 2022-04-28T14:42:28.890 INFO:tasks.ceph.mds.a.smithi022.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7f8827c301cf] 2022-04-28T14:42:28.891 INFO:tasks.ceph.mds.a.smithi022.stderr: 16: clone() 2022-04-28T14:42:28.891 INFO:tasks.ceph.mds.a.smithi022.stderr:2022-04-28T14:42:28.880+0000 7f881bc2d700 -1 *** Caught signal (Aborted) ** 2022-04-28T14:42:28.891 INFO:tasks.ceph.mds.a.smithi022.stderr: in thread 7f881bc2d700 thread_name:mds_rank_progr 2022-04-28T14:42:28.891 INFO:tasks.ceph.mds.a.smithi022.stderr: 2022-04-28T14:42:28.891 INFO:tasks.ceph.mds.a.smithi022.stderr: ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable) 2022-04-28T14:42:28.891 INFO:tasks.ceph.mds.a.smithi022.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f8827c3ace0] 2022-04-28T14:42:28.892 INFO:tasks.ceph.mds.a.smithi022.stderr: 2: gsignal() 2022-04-28T14:42:28.892 INFO:tasks.ceph.mds.a.smithi022.stderr: 3: abort() 2022-04-28T14:42:28.892 INFO:tasks.ceph.mds.a.smithi022.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7f8828c4cd99] 2022-04-28T14:42:28.892 INFO:tasks.ceph.mds.a.smithi022.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x276f62) [0x7f8828c4cf62] 2022-04-28T14:42:28.892 INFO:tasks.ceph.mds.a.smithi022.stderr: 6: (CDir::check_rstats(bool)+0x17dd) [0x561bf058842d] 2022-04-28T14:42:28.892 INFO:tasks.ceph.mds.a.smithi022.stderr: 7: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0xd56) [0x561bf0439206] 2022-04-28T14:42:28.893 INFO:tasks.ceph.mds.a.smithi022.stderr: 8: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x8de) [0x561bf043b2de] 2022-04-28T14:42:28.893 INFO:tasks.ceph.mds.a.smithi022.stderr: 9: (MDCache::populate_mydir()+0x806) [0x561bf0481bb6] 2022-04-28T14:42:28.893 INFO:tasks.ceph.mds.a.smithi022.stderr: 10: (MDCache::open_root()+0xd8) [0x561bf0481ea8] 2022-04-28T14:42:28.893 INFO:tasks.ceph.mds.a.smithi022.stderr: 11: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x561bf04e6ab7] 2022-04-28T14:42:28.893 INFO:tasks.ceph.mds.a.smithi022.stderr: 12: (MDSContext::complete(int)+0x203) [0x561bf0645f93] 2022-04-28T14:42:28.893 INFO:tasks.ceph.mds.a.smithi022.stderr: 13: (MDSRank::_advance_queues()+0x84) [0x561bf033ec64] 2022-04-28T14:42:28.893 INFO:tasks.ceph.mds.a.smithi022.stderr: 14: (MDSRank::ProgressThread::entry()+0xc5) [0x561bf033f385] 2022-04-28T14:42:28.894 INFO:tasks.ceph.mds.a.smithi022.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7f8827c301cf] 2022-04-28T14:42:28.894 INFO:tasks.ceph.mds.a.smithi022.stderr: 16: clone() 2022-04-28T14:42:28.894 INFO:tasks.ceph.mds.a.smithi022.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-04-28T14:42:28.894 INFO:tasks.ceph.mds.a.smithi022.stderr: 2022-04-28T14:42:28.894 INFO:tasks.ceph.mds.a.smithi022.stderr: -471> 2022-04-28T14:42:26.872+0000 7f881a42a700 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2022-04-28T14:42:28.894 INFO:tasks.ceph.mds.a.smithi022.stderr: -1> 2022-04-28T14:42:28.878+0000 7f881bc2d700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.7-969-g4fa079ba/rpm/el8/BUILD/ceph-16.2.7-969-g4fa079ba/src/mds/CDir.cc: In function 'bool CDir::check_rstats(bool)' thread 7f881bc2d700 time 2022-04-28T14:42:28.877498+0000 2022-04-28T14:42:28.895 INFO:tasks.ceph.mds.a.smithi022.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.7-969-g4fa079ba/rpm/el8/BUILD/ceph-16.2.7-969-g4fa079ba/src/mds/CDir.cc: 292: FAILED ceph_assert(frag_info.nsubdirs == fnode->fragstat.nsubdirs) 2022-04-28T14:42:28.895 INFO:tasks.ceph.mds.a.smithi022.stderr: 2022-04-28T14:42:28.895 INFO:tasks.ceph.mds.a.smithi022.stderr: ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable) 2022-04-28T14:42:28.895 INFO:tasks.ceph.mds.a.smithi022.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f8828c4cd48] 2022-04-28T14:42:28.895 INFO:tasks.ceph.mds.a.smithi022.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x276f62) [0x7f8828c4cf62] 2022-04-28T14:42:28.895 INFO:tasks.ceph.mds.a.smithi022.stderr: 3: (CDir::check_rstats(bool)+0x17dd) [0x561bf058842d] 2022-04-28T14:42:28.896 INFO:tasks.ceph.mds.a.smithi022.stderr: 4: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0xd56) [0x561bf0439206] 2022-04-28T14:42:28.896 INFO:tasks.ceph.mds.a.smithi022.stderr: 5: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x8de) [0x561bf043b2de] 2022-04-28T14:42:28.896 INFO:tasks.ceph.mds.a.smithi022.stderr: 6: (MDCache::populate_mydir()+0x806) [0x561bf0481bb6] 2022-04-28T14:42:28.896 INFO:tasks.ceph.mds.a.smithi022.stderr: 7: (MDCache::open_root()+0xd8) [0x561bf0481ea8] 2022-04-28T14:42:28.896 INFO:tasks.ceph.mds.a.smithi022.stderr: 8: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x561bf04e6ab7] 2022-04-28T14:42:28.896 INFO:tasks.ceph.mds.a.smithi022.stderr: 9: (MDSContext::complete(int)+0x203) [0x561bf0645f93] 2022-04-28T14:42:28.897 INFO:tasks.ceph.mds.a.smithi022.stderr: 10: (MDSRank::_advance_queues()+0x84) [0x561bf033ec64] 2022-04-28T14:42:28.897 INFO:tasks.ceph.mds.a.smithi022.stderr: 11: (MDSRank::ProgressThread::entry()+0xc5) [0x561bf033f385] 2022-04-28T14:42:28.897 INFO:tasks.ceph.mds.a.smithi022.stderr: 12: /lib64/libpthread.so.0(+0x81cf) [0x7f8827c301cf] 2022-04-28T14:42:28.897 INFO:tasks.ceph.mds.a.smithi022.stderr: 13: clone() 2022-04-28T14:42:28.897 INFO:tasks.ceph.mds.a.smithi022.stderr: 2022-04-28T14:42:28.898 INFO:tasks.ceph.mds.a.smithi022.stderr: 0> 2022-04-28T14:42:28.880+0000 7f881bc2d700 -1 *** Caught signal (Aborted) ** 2022-04-28T14:42:28.898 INFO:tasks.ceph.mds.a.smithi022.stderr: in thread 7f881bc2d700 thread_name:mds_rank_progr 2022-04-28T14:42:28.898 INFO:tasks.ceph.mds.a.smithi022.stderr: 2022-04-28T14:42:28.898 INFO:tasks.ceph.mds.a.smithi022.stderr: ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable) 2022-04-28T14:42:28.898 INFO:tasks.ceph.mds.a.smithi022.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f8827c3ace0] 2022-04-28T14:42:28.898 INFO:tasks.ceph.mds.a.smithi022.stderr: 2: gsignal() 2022-04-28T14:42:28.899 INFO:tasks.ceph.mds.a.smithi022.stderr: 3: abort() 2022-04-28T14:42:28.899 INFO:tasks.ceph.mds.a.smithi022.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7f8828c4cd99] 2022-04-28T14:42:28.899 INFO:tasks.ceph.mds.a.smithi022.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x276f62) [0x7f8828c4cf62] 2022-04-28T14:42:28.899 INFO:tasks.ceph.mds.a.smithi022.stderr: 6: (CDir::check_rstats(bool)+0x17dd) [0x561bf058842d] 2022-04-28T14:42:28.899 INFO:tasks.ceph.mds.a.smithi022.stderr: 7: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0xd56) [0x561bf0439206] 2022-04-28T14:42:28.899 INFO:tasks.ceph.mds.a.smithi022.stderr: 8: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x8de) [0x561bf043b2de] 2022-04-28T14:42:28.900 INFO:tasks.ceph.mds.a.smithi022.stderr: 9: (MDCache::populate_mydir()+0x806) [0x561bf0481bb6] 2022-04-28T14:42:28.900 INFO:tasks.ceph.mds.a.smithi022.stderr: 10: (MDCache::open_root()+0xd8) [0x561bf0481ea8] 2022-04-28T14:42:28.900 INFO:tasks.ceph.mds.a.smithi022.stderr: 11: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x561bf04e6ab7] 2022-04-28T14:42:28.900 INFO:tasks.ceph.mds.a.smithi022.stderr: 12: (MDSContext::complete(int)+0x203) [0x561bf0645f93] 2022-04-28T14:42:28.900 INFO:tasks.ceph.mds.a.smithi022.stderr: 13: (MDSRank::_advance_queues()+0x84) [0x561bf033ec64] 2022-04-28T14:42:28.900 INFO:tasks.ceph.mds.a.smithi022.stderr: 14: (MDSRank::ProgressThread::entry()+0xc5) [0x561bf033f385] 2022-04-28T14:42:28.901 INFO:tasks.ceph.mds.a.smithi022.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7f8827c301cf] 2022-04-28T14:42:28.901 INFO:tasks.ceph.mds.a.smithi022.stderr: 16: clone() 2022-04-28T14:42:28.901 INFO:tasks.ceph.mds.a.smithi022.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-04-28T14:42:28.901 INFO:tasks.ceph.mds.a.smithi022.stderr: 2022-04-28T14:42:28.901 INFO:tasks.ceph.mds.a.smithi022.stderr: -471> 2022-04-28T14:42:26.872+0000 7f881a42a700 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2022-04-28T14:42:28.901 INFO:tasks.ceph.mds.a.smithi022.stderr: -1> 2022-04-28T14:42:28.878+0000 7f881bc2d700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.7-969-g4fa079ba/rpm/el8/BUILD/ceph-16.2.7-969-g4fa079ba/src/mds/CDir.cc: In function 'bool CDir::check_rstats(bool)' thread 7f881bc2d700 time 2022-04-28T14:42:28.877498+0000 2022-04-28T14:42:28.901 INFO:tasks.ceph.mds.a.smithi022.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.7-969-g4fa079ba/rpm/el8/BUILD/ceph-16.2.7-969-g4fa079ba/src/mds/CDir.cc: 292: FAILED ceph_assert(frag_info.nsubdirs == fnode->fragstat.nsubdirs) 2022-04-28T14:42:28.902 INFO:tasks.ceph.mds.a.smithi022.stderr: 2022-04-28T14:42:28.902 INFO:tasks.ceph.mds.a.smithi022.stderr: ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable) 2022-04-28T14:42:28.902 INFO:tasks.ceph.mds.a.smithi022.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f8828c4cd48] 2022-04-28T14:42:28.902 INFO:tasks.ceph.mds.a.smithi022.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x276f62) [0x7f8828c4cf62] 2022-04-28T14:42:28.902 INFO:tasks.ceph.mds.a.smithi022.stderr: 3: (CDir::check_rstats(bool)+0x17dd) [0x561bf058842d] 2022-04-28T14:42:28.902 INFO:tasks.ceph.mds.a.smithi022.stderr: 4: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0xd56) [0x561bf0439206] 2022-04-28T14:42:28.903 INFO:tasks.ceph.mds.a.smithi022.stderr: 5: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x8de) [0x561bf043b2de] 2022-04-28T14:42:28.903 INFO:tasks.ceph.mds.a.smithi022.stderr: 6: (MDCache::populate_mydir()+0x806) [0x561bf0481bb6] 2022-04-28T14:42:28.903 INFO:tasks.ceph.mds.a.smithi022.stderr: 7: (MDCache::open_root()+0xd8) [0x561bf0481ea8] 2022-04-28T14:42:28.903 INFO:tasks.ceph.mds.a.smithi022.stderr: 8: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x561bf04e6ab7] 2022-04-28T14:42:28.903 INFO:tasks.ceph.mds.a.smithi022.stderr: 9: (MDSContext::complete(int)+0x203) [0x561bf0645f93] 2022-04-28T14:42:28.903 INFO:tasks.ceph.mds.a.smithi022.stderr: 10: (MDSRank::_advance_queues()+0x84) [0x561bf033ec64] 2022-04-28T14:42:28.904 INFO:tasks.ceph.mds.a.smithi022.stderr: 11: (MDSRank::ProgressThread::entry()+0xc5) [0x561bf033f385] 2022-04-28T14:42:28.904 INFO:tasks.ceph.mds.a.smithi022.stderr: 12: /lib64/libpthread.so.0(+0x81cf) [0x7f8827c301cf] 2022-04-28T14:42:28.904 INFO:tasks.ceph.mds.a.smithi022.stderr: 13: clone() 2022-04-28T14:42:28.904 INFO:tasks.ceph.mds.a.smithi022.stderr: 2022-04-28T14:42:28.904 INFO:tasks.ceph.mds.a.smithi022.stderr: 0> 2022-04-28T14:42:28.880+0000 7f881bc2d700 -1 *** Caught signal (Aborted) ** 2022-04-28T14:42:28.904 INFO:tasks.ceph.mds.a.smithi022.stderr: in thread 7f881bc2d700 thread_name:mds_rank_progr 2022-04-28T14:42:28.905 INFO:tasks.ceph.mds.a.smithi022.stderr: 2022-04-28T14:42:28.905 INFO:tasks.ceph.mds.a.smithi022.stderr: ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable) 2022-04-28T14:42:28.905 INFO:tasks.ceph.mds.a.smithi022.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f8827c3ace0] 2022-04-28T14:42:28.905 INFO:tasks.ceph.mds.a.smithi022.stderr: 2: gsignal() 2022-04-28T14:42:28.905 INFO:tasks.ceph.mds.a.smithi022.stderr: 3: abort() 2022-04-28T14:42:28.905 INFO:tasks.ceph.mds.a.smithi022.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7f8828c4cd99] 2022-04-28T14:42:28.906 INFO:tasks.ceph.mds.a.smithi022.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x276f62) [0x7f8828c4cf62] 2022-04-28T14:42:28.906 INFO:tasks.ceph.mds.a.smithi022.stderr: 6: (CDir::check_rstats(bool)+0x17dd) [0x561bf058842d] 2022-04-28T14:42:28.906 INFO:tasks.ceph.mds.a.smithi022.stderr: 7: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0xd56) [0x561bf0439206] 2022-04-28T14:42:28.906 INFO:tasks.ceph.mds.a.smithi022.stderr: 8: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x8de) [0x561bf043b2de] 2022-04-28T14:42:28.906 INFO:tasks.ceph.mds.a.smithi022.stderr: 9: (MDCache::populate_mydir()+0x806) [0x561bf0481bb6] 2022-04-28T14:42:28.906 INFO:tasks.ceph.mds.a.smithi022.stderr: 10: (MDCache::open_root()+0xd8) [0x561bf0481ea8] 2022-04-28T14:42:28.907 INFO:tasks.ceph.mds.a.smithi022.stderr: 11: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x561bf04e6ab7] 2022-04-28T14:42:28.907 INFO:tasks.ceph.mds.a.smithi022.stderr: 12: (MDSContext::complete(int)+0x203) [0x561bf0645f93] 2022-04-28T14:42:28.907 INFO:tasks.ceph.mds.a.smithi022.stderr: 13: (MDSRank::_advance_queues()+0x84) [0x561bf033ec64] 2022-04-28T14:42:28.907 INFO:tasks.ceph.mds.a.smithi022.stderr: 14: (MDSRank::ProgressThread::entry()+0xc5) [0x561bf033f385] 2022-04-28T14:42:28.907 INFO:tasks.ceph.mds.a.smithi022.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7f8827c301cf] 2022-04-28T14:42:28.907 INFO:tasks.ceph.mds.a.smithi022.stderr: 16: clone() 2022-04-28T14:42:28.907 INFO:tasks.ceph.mds.a.smithi022.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-04-28T14:42:28.908 INFO:tasks.ceph.mds.a.smithi022.stderr: 2022-04-28T14:42:29.045 INFO:tasks.ceph.mds.a.smithi022.stderr:daemon-helper: command crashed with signal 6 2022-04-28T14:42:45.880 INFO:tasks.ceph.mds.b.smithi022.stderr:2022-04-28T14:42:45.875+0000 7f0d9b486700 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2022-04-28T14:42:48.877 INFO:tasks.ceph.mds.b.smithi022.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.7-969-g4fa079ba/rpm/el8/BUILD/ceph-16.2.7-969-g4fa079ba/src/mds/CDir.cc: In function 'bool CDir::check_rstats(bool)' thread 7f0d9cc89700 time 2022-04-28T14:42:48.873933+0000 2022-04-28T14:42:48.877 INFO:tasks.ceph.mds.b.smithi022.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.7-969-g4fa079ba/rpm/el8/BUILD/ceph-16.2.7-969-g4fa079ba/src/mds/CDir.cc: 292: FAILED ceph_assert(frag_info.nsubdirs == fnode->fragstat.nsubdirs) 2022-04-28T14:42:48.878 INFO:tasks.ceph.mds.b.smithi022.stderr: ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable) 2022-04-28T14:42:48.878 INFO:tasks.ceph.mds.b.smithi022.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f0da9ca8d48] 2022-04-28T14:42:48.879 INFO:tasks.ceph.mds.b.smithi022.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x276f62) [0x7f0da9ca8f62] 2022-04-28T14:42:48.879 INFO:tasks.ceph.mds.b.smithi022.stderr: 3: (CDir::check_rstats(bool)+0x17dd) [0x55ee625da42d] 2022-04-28T14:42:48.879 INFO:tasks.ceph.mds.b.smithi022.stderr: 4: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0xd56) [0x55ee6248b206] 2022-04-28T14:42:48.879 INFO:tasks.ceph.mds.b.smithi022.stderr: 5: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x8de) [0x55ee6248d2de] 2022-04-28T14:42:48.879 INFO:tasks.ceph.mds.b.smithi022.stderr: 6: (MDCache::populate_mydir()+0x806) [0x55ee624d3bb6] 2022-04-28T14:42:48.880 INFO:tasks.ceph.mds.b.smithi022.stderr: 7: (MDCache::open_root()+0xd8) [0x55ee624d3ea8] 2022-04-28T14:42:48.880 INFO:tasks.ceph.mds.b.smithi022.stderr: 8: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x55ee62538ab7] 2022-04-28T14:42:48.880 INFO:tasks.ceph.mds.b.smithi022.stderr: 9: (MDSContext::complete(int)+0x203) [0x55ee62697f93] 2022-04-28T14:42:48.880 INFO:tasks.ceph.mds.b.smithi022.stderr: 10: (MDSRank::_advance_queues()+0x84) [0x55ee62390c64] 2022-04-28T14:42:48.880 INFO:tasks.ceph.mds.b.smithi022.stderr: 11: (MDSRank::ProgressThread::entry()+0xc5) [0x55ee62391385] 2022-04-28T14:42:48.880 INFO:tasks.ceph.mds.b.smithi022.stderr: 12: /lib64/libpthread.so.0(+0x81cf) [0x7f0da8c8c1cf] 2022-04-28T14:42:48.881 INFO:tasks.ceph.mds.b.smithi022.stderr: 13: clone() 2022-04-28T14:42:48.881 INFO:tasks.ceph.mds.b.smithi022.stderr:2022-04-28T14:42:48.874+0000 7f0d9cc89700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.7-969-g4fa079ba/rpm/el8/BUILD/ceph-16.2.7-969-g4fa079ba/src/mds/CDir.cc: In function 'bool CDir::check_rstats(bool)' thread 7f0d9cc89700 time 2022-04-28T14:42:48.873933+0000 2022-04-28T14:42:48.881 INFO:tasks.ceph.mds.b.smithi022.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.7-969-g4fa079ba/rpm/el8/BUILD/ceph-16.2.7-969-g4fa079ba/src/mds/CDir.cc: 292: FAILED ceph_assert(frag_info.nsubdirs == fnode->fragstat.nsubdirs) 2022-04-28T14:42:48.881 INFO:tasks.ceph.mds.b.smithi022.stderr: 2022-04-28T14:42:48.881 INFO:tasks.ceph.mds.b.smithi022.stderr: ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable) 2022-04-28T14:42:48.881 INFO:tasks.ceph.mds.b.smithi022.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f0da9ca8d48] 2022-04-28T14:42:48.882 INFO:tasks.ceph.mds.b.smithi022.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x276f62) [0x7f0da9ca8f62] 2022-04-28T14:42:48.882 INFO:tasks.ceph.mds.b.smithi022.stderr: 3: (CDir::check_rstats(bool)+0x17dd) [0x55ee625da42d] 2022-04-28T14:42:48.882 INFO:tasks.ceph.mds.b.smithi022.stderr: 4: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0xd56) [0x55ee6248b206] 2022-04-28T14:42:48.882 INFO:tasks.ceph.mds.b.smithi022.stderr: 5: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x8de) [0x55ee6248d2de] 2022-04-28T14:42:48.882 INFO:tasks.ceph.mds.b.smithi022.stderr: 6: (MDCache::populate_mydir()+0x806) [0x55ee624d3bb6] 2022-04-28T14:42:48.882 INFO:tasks.ceph.mds.b.smithi022.stderr: 7: (MDCache::open_root()+0xd8) [0x55ee624d3ea8] 2022-04-28T14:42:48.883 INFO:tasks.ceph.mds.b.smithi022.stderr: 8: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x55ee62538ab7] 2022-04-28T14:42:48.883 INFO:tasks.ceph.mds.b.smithi022.stderr: 9: (MDSContext::complete(int)+0x203) [0x55ee62697f93] 2022-04-28T14:42:48.883 INFO:tasks.ceph.mds.b.smithi022.stderr: 10: (MDSRank::_advance_queues()+0x84) [0x55ee62390c64] 2022-04-28T14:42:48.883 INFO:tasks.ceph.mds.b.smithi022.stderr: 11: (MDSRank::ProgressThread::entry()+0xc5) [0x55ee62391385] 2022-04-28T14:42:48.883 INFO:tasks.ceph.mds.b.smithi022.stderr: 12: /lib64/libpthread.so.0(+0x81cf) [0x7f0da8c8c1cf] 2022-04-28T14:42:48.883 INFO:tasks.ceph.mds.b.smithi022.stderr: 13: clone() 2022-04-28T14:42:48.884 INFO:tasks.ceph.mds.b.smithi022.stderr: 2022-04-28T14:42:48.884 INFO:tasks.ceph.mds.b.smithi022.stderr:*** Caught signal (Aborted) ** 2022-04-28T14:42:48.884 INFO:tasks.ceph.mds.b.smithi022.stderr: in thread 7f0d9cc89700 thread_name:mds_rank_progr 2022-04-28T14:42:48.885 INFO:tasks.ceph.mds.b.smithi022.stderr: ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable) 2022-04-28T14:42:48.885 INFO:tasks.ceph.mds.b.smithi022.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f0da8c96ce0] 2022-04-28T14:42:48.885 INFO:tasks.ceph.mds.b.smithi022.stderr: 2: gsignal() 2022-04-28T14:42:48.885 INFO:tasks.ceph.mds.b.smithi022.stderr: 3: abort() 2022-04-28T14:42:48.886 INFO:tasks.ceph.mds.b.smithi022.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7f0da9ca8d99] 2022-04-28T14:42:48.886 INFO:tasks.ceph.mds.b.smithi022.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x276f62) [0x7f0da9ca8f62] 2022-04-28T14:42:48.886 INFO:tasks.ceph.mds.b.smithi022.stderr: 6: (CDir::check_rstats(bool)+0x17dd) [0x55ee625da42d] 2022-04-28T14:42:48.886 INFO:tasks.ceph.mds.b.smithi022.stderr: 7: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0xd56) [0x55ee6248b206] 2022-04-28T14:42:48.886 INFO:tasks.ceph.mds.b.smithi022.stderr: 8: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x8de) [0x55ee6248d2de] 2022-04-28T14:42:48.886 INFO:tasks.ceph.mds.b.smithi022.stderr: 9: (MDCache::populate_mydir()+0x806) [0x55ee624d3bb6] 2022-04-28T14:42:48.887 INFO:tasks.ceph.mds.b.smithi022.stderr: 10: (MDCache::open_root()+0xd8) [0x55ee624d3ea8] 2022-04-28T14:42:48.887 INFO:tasks.ceph.mds.b.smithi022.stderr: 11: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x55ee62538ab7] 2022-04-28T14:42:48.887 INFO:tasks.ceph.mds.b.smithi022.stderr: 12: (MDSContext::complete(int)+0x203) [0x55ee62697f93] 2022-04-28T14:42:48.887 INFO:tasks.ceph.mds.b.smithi022.stderr: 13: (MDSRank::_advance_queues()+0x84) [0x55ee62390c64] 2022-04-28T14:42:48.887 INFO:tasks.ceph.mds.b.smithi022.stderr: 14: (MDSRank::ProgressThread::entry()+0xc5) [0x55ee62391385] 2022-04-28T14:42:48.887 INFO:tasks.ceph.mds.b.smithi022.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7f0da8c8c1cf] 2022-04-28T14:42:48.888 INFO:tasks.ceph.mds.b.smithi022.stderr: 16: clone() 2022-04-28T14:42:48.888 INFO:tasks.ceph.mds.b.smithi022.stderr:2022-04-28T14:42:48.875+0000 7f0d9cc89700 -1 *** Caught signal (Aborted) ** 2022-04-28T14:42:48.888 INFO:tasks.ceph.mds.b.smithi022.stderr: in thread 7f0d9cc89700 thread_name:mds_rank_progr 2022-04-28T14:42:48.888 INFO:tasks.ceph.mds.b.smithi022.stderr: 2022-04-28T14:42:48.888 INFO:tasks.ceph.mds.b.smithi022.stderr: ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable) 2022-04-28T14:42:48.888 INFO:tasks.ceph.mds.b.smithi022.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f0da8c96ce0] 2022-04-28T14:42:48.889 INFO:tasks.ceph.mds.b.smithi022.stderr: 2: gsignal() 2022-04-28T14:42:48.889 INFO:tasks.ceph.mds.b.smithi022.stderr: 3: abort() 2022-04-28T14:42:48.889 INFO:tasks.ceph.mds.b.smithi022.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7f0da9ca8d99] 2022-04-28T14:42:48.889 INFO:tasks.ceph.mds.b.smithi022.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x276f62) [0x7f0da9ca8f62] 2022-04-28T14:42:48.889 INFO:tasks.ceph.mds.b.smithi022.stderr: 6: (CDir::check_rstats(bool)+0x17dd) [0x55ee625da42d] 2022-04-28T14:42:48.889 INFO:tasks.ceph.mds.b.smithi022.stderr: 7: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0xd56) [0x55ee6248b206] 2022-04-28T14:42:48.890 INFO:tasks.ceph.mds.b.smithi022.stderr: 8: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x8de) [0x55ee6248d2de] 2022-04-28T14:42:48.890 INFO:tasks.ceph.mds.b.smithi022.stderr: 9: (MDCache::populate_mydir()+0x806) [0x55ee624d3bb6] 2022-04-28T14:42:48.890 INFO:tasks.ceph.mds.b.smithi022.stderr: 10: (MDCache::open_root()+0xd8) [0x55ee624d3ea8] 2022-04-28T14:42:48.890 INFO:tasks.ceph.mds.b.smithi022.stderr: 11: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x55ee62538ab7] 2022-04-28T14:42:48.890 INFO:tasks.ceph.mds.b.smithi022.stderr: 12: (MDSContext::complete(int)+0x203) [0x55ee62697f93] 2022-04-28T14:42:48.890 INFO:tasks.ceph.mds.b.smithi022.stderr: 13: (MDSRank::_advance_queues()+0x84) [0x55ee62390c64] 2022-04-28T14:42:48.890 INFO:tasks.ceph.mds.b.smithi022.stderr: 14: (MDSRank::ProgressThread::entry()+0xc5) [0x55ee62391385] 2022-04-28T14:42:48.891 INFO:tasks.ceph.mds.b.smithi022.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7f0da8c8c1cf] 2022-04-28T14:42:48.891 INFO:tasks.ceph.mds.b.smithi022.stderr: 16: clone() 2022-04-28T14:42:48.891 INFO:tasks.ceph.mds.b.smithi022.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-04-28T14:42:48.891 INFO:tasks.ceph.mds.b.smithi022.stderr: 2022-04-28T14:42:48.891 INFO:tasks.ceph.mds.b.smithi022.stderr: -646> 2022-04-28T14:42:45.875+0000 7f0d9b486700 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2022-04-28T14:42:48.891 INFO:tasks.ceph.mds.b.smithi022.stderr: -1> 2022-04-28T14:42:48.874+0000 7f0d9cc89700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.7-969-g4fa079ba/rpm/el8/BUILD/ceph-16.2.7-969-g4fa079ba/src/mds/CDir.cc: In function 'bool CDir::check_rstats(bool)' thread 7f0d9cc89700 time 2022-04-28T14:42:48.873933+0000 2022-04-28T14:42:48.892 INFO:tasks.ceph.mds.b.smithi022.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.7-969-g4fa079ba/rpm/el8/BUILD/ceph-16.2.7-969-g4fa079ba/src/mds/CDir.cc: 292: FAILED ceph_assert(frag_info.nsubdirs == fnode->fragstat.nsubdirs) 2022-04-28T14:42:48.892 INFO:tasks.ceph.mds.b.smithi022.stderr: 2022-04-28T14:42:48.892 INFO:tasks.ceph.mds.b.smithi022.stderr: ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable) 2022-04-28T14:42:48.892 INFO:tasks.ceph.mds.b.smithi022.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f0da9ca8d48] 2022-04-28T14:42:48.892 INFO:tasks.ceph.mds.b.smithi022.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x276f62) [0x7f0da9ca8f62] 2022-04-28T14:42:48.892 INFO:tasks.ceph.mds.b.smithi022.stderr: 3: (CDir::check_rstats(bool)+0x17dd) [0x55ee625da42d] 2022-04-28T14:42:48.893 INFO:tasks.ceph.mds.b.smithi022.stderr: 4: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0xd56) [0x55ee6248b206] 2022-04-28T14:42:48.893 INFO:tasks.ceph.mds.b.smithi022.stderr: 5: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x8de) [0x55ee6248d2de] 2022-04-28T14:42:48.893 INFO:tasks.ceph.mds.b.smithi022.stderr: 6: (MDCache::populate_mydir()+0x806) [0x55ee624d3bb6] 2022-04-28T14:42:48.893 INFO:tasks.ceph.mds.b.smithi022.stderr: 7: (MDCache::open_root()+0xd8) [0x55ee624d3ea8] 2022-04-28T14:42:48.893 INFO:tasks.ceph.mds.b.smithi022.stderr: 8: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x55ee62538ab7] 2022-04-28T14:42:48.893 INFO:tasks.ceph.mds.b.smithi022.stderr: 9: (MDSContext::complete(int)+0x203) [0x55ee62697f93] 2022-04-28T14:42:48.894 INFO:tasks.ceph.mds.b.smithi022.stderr: 10: (MDSRank::_advance_queues()+0x84) [0x55ee62390c64] 2022-04-28T14:42:48.894 INFO:tasks.ceph.mds.b.smithi022.stderr: 11: (MDSRank::ProgressThread::entry()+0xc5) [0x55ee62391385] 2022-04-28T14:42:48.894 INFO:tasks.ceph.mds.b.smithi022.stderr: 12: /lib64/libpthread.so.0(+0x81cf) [0x7f0da8c8c1cf] 2022-04-28T14:42:48.894 INFO:tasks.ceph.mds.b.smithi022.stderr: 13: clone() 2022-04-28T14:42:48.894 INFO:tasks.ceph.mds.b.smithi022.stderr: 2022-04-28T14:42:48.894 INFO:tasks.ceph.mds.b.smithi022.stderr: 0> 2022-04-28T14:42:48.875+0000 7f0d9cc89700 -1 *** Caught signal (Aborted) ** 2022-04-28T14:42:48.895 INFO:tasks.ceph.mds.b.smithi022.stderr: in thread 7f0d9cc89700 thread_name:mds_rank_progr 2022-04-28T14:42:48.895 INFO:tasks.ceph.mds.b.smithi022.stderr: 2022-04-28T14:42:48.895 INFO:tasks.ceph.mds.b.smithi022.stderr: ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable) 2022-04-28T14:42:48.895 INFO:tasks.ceph.mds.b.smithi022.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f0da8c96ce0] 2022-04-28T14:42:48.895 INFO:tasks.ceph.mds.b.smithi022.stderr: 2: gsignal() 2022-04-28T14:42:48.895 INFO:tasks.ceph.mds.b.smithi022.stderr: 3: abort() 2022-04-28T14:42:48.895 INFO:tasks.ceph.mds.b.smithi022.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7f0da9ca8d99] 2022-04-28T14:42:48.896 INFO:tasks.ceph.mds.b.smithi022.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x276f62) [0x7f0da9ca8f62] 2022-04-28T14:42:48.896 INFO:tasks.ceph.mds.b.smithi022.stderr: 6: (CDir::check_rstats(bool)+0x17dd) [0x55ee625da42d] 2022-04-28T14:42:48.896 INFO:tasks.ceph.mds.b.smithi022.stderr: 7: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0xd56) [0x55ee6248b206] 2022-04-28T14:42:48.896 INFO:tasks.ceph.mds.b.smithi022.stderr: 8: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x8de) [0x55ee6248d2de] 2022-04-28T14:42:48.896 INFO:tasks.ceph.mds.b.smithi022.stderr: 9: (MDCache::populate_mydir()+0x806) [0x55ee624d3bb6] 2022-04-28T14:42:48.896 INFO:tasks.ceph.mds.b.smithi022.stderr: 10: (MDCache::open_root()+0xd8) [0x55ee624d3ea8] 2022-04-28T14:42:48.897 INFO:tasks.ceph.mds.b.smithi022.stderr: 11: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x55ee62538ab7] 2022-04-28T14:42:48.897 INFO:tasks.ceph.mds.b.smithi022.stderr: 12: (MDSContext::complete(int)+0x203) [0x55ee62697f93] 2022-04-28T14:42:48.897 INFO:tasks.ceph.mds.b.smithi022.stderr: 13: (MDSRank::_advance_queues()+0x84) [0x55ee62390c64] 2022-04-28T14:42:48.897 INFO:tasks.ceph.mds.b.smithi022.stderr: 14: (MDSRank::ProgressThread::entry()+0xc5) [0x55ee62391385] 2022-04-28T14:42:48.897 INFO:tasks.ceph.mds.b.smithi022.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7f0da8c8c1cf] 2022-04-28T14:42:48.897 INFO:tasks.ceph.mds.b.smithi022.stderr: 16: clone() 2022-04-28T14:42:48.898 INFO:tasks.ceph.mds.b.smithi022.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-04-28T14:42:48.898 INFO:tasks.ceph.mds.b.smithi022.stderr: 2022-04-28T14:42:48.898 INFO:tasks.ceph.mds.b.smithi022.stderr: -646> 2022-04-28T14:42:45.875+0000 7f0d9b486700 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2022-04-28T14:42:48.898 INFO:tasks.ceph.mds.b.smithi022.stderr: -1> 2022-04-28T14:42:48.874+0000 7f0d9cc89700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.7-969-g4fa079ba/rpm/el8/BUILD/ceph-16.2.7-969-g4fa079ba/src/mds/CDir.cc: In function 'bool CDir::check_rstats(bool)' thread 7f0d9cc89700 time 2022-04-28T14:42:48.873933+0000 2022-04-28T14:42:48.898 INFO:tasks.ceph.mds.b.smithi022.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/16.2.7-969-g4fa079ba/rpm/el8/BUILD/ceph-16.2.7-969-g4fa079ba/src/mds/CDir.cc: 292: FAILED ceph_assert(frag_info.nsubdirs == fnode->fragstat.nsubdirs) 2022-04-28T14:42:48.898 INFO:tasks.ceph.mds.b.smithi022.stderr: 2022-04-28T14:42:48.899 INFO:tasks.ceph.mds.b.smithi022.stderr: ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable) 2022-04-28T14:42:48.899 INFO:tasks.ceph.mds.b.smithi022.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f0da9ca8d48] 2022-04-28T14:42:48.899 INFO:tasks.ceph.mds.b.smithi022.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x276f62) [0x7f0da9ca8f62] 2022-04-28T14:42:48.899 INFO:tasks.ceph.mds.b.smithi022.stderr: 3: (CDir::check_rstats(bool)+0x17dd) [0x55ee625da42d] 2022-04-28T14:42:48.899 INFO:tasks.ceph.mds.b.smithi022.stderr: 4: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0xd56) [0x55ee6248b206] 2022-04-28T14:42:48.899 INFO:tasks.ceph.mds.b.smithi022.stderr: 5: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x8de) [0x55ee6248d2de] 2022-04-28T14:42:48.900 INFO:tasks.ceph.mds.b.smithi022.stderr: 6: (MDCache::populate_mydir()+0x806) [0x55ee624d3bb6] 2022-04-28T14:42:48.900 INFO:tasks.ceph.mds.b.smithi022.stderr: 7: (MDCache::open_root()+0xd8) [0x55ee624d3ea8] 2022-04-28T14:42:48.900 INFO:tasks.ceph.mds.b.smithi022.stderr: 8: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x55ee62538ab7] 2022-04-28T14:42:48.900 INFO:tasks.ceph.mds.b.smithi022.stderr: 9: (MDSContext::complete(int)+0x203) [0x55ee62697f93] 2022-04-28T14:42:48.900 INFO:tasks.ceph.mds.b.smithi022.stderr: 10: (MDSRank::_advance_queues()+0x84) [0x55ee62390c64] 2022-04-28T14:42:48.900 INFO:tasks.ceph.mds.b.smithi022.stderr: 11: (MDSRank::ProgressThread::entry()+0xc5) [0x55ee62391385] 2022-04-28T14:42:48.901 INFO:tasks.ceph.mds.b.smithi022.stderr: 12: /lib64/libpthread.so.0(+0x81cf) [0x7f0da8c8c1cf] 2022-04-28T14:42:48.901 INFO:tasks.ceph.mds.b.smithi022.stderr: 13: clone() 2022-04-28T14:42:48.901 INFO:tasks.ceph.mds.b.smithi022.stderr: 2022-04-28T14:42:48.901 INFO:tasks.ceph.mds.b.smithi022.stderr: 0> 2022-04-28T14:42:48.875+0000 7f0d9cc89700 -1 *** Caught signal (Aborted) ** 2022-04-28T14:42:48.901 INFO:tasks.ceph.mds.b.smithi022.stderr: in thread 7f0d9cc89700 thread_name:mds_rank_progr 2022-04-28T14:42:48.901 INFO:tasks.ceph.mds.b.smithi022.stderr: 2022-04-28T14:42:48.902 INFO:tasks.ceph.mds.b.smithi022.stderr: ceph version 16.2.7-969-g4fa079ba (4fa079ba14503defa8dc257d7c2d506ebefcfe6d) pacific (stable) 2022-04-28T14:42:48.902 INFO:tasks.ceph.mds.b.smithi022.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f0da8c96ce0] 2022-04-28T14:42:48.902 INFO:tasks.ceph.mds.b.smithi022.stderr: 2: gsignal() 2022-04-28T14:42:48.904 INFO:tasks.ceph.mds.b.smithi022.stderr: 3: abort() 2022-04-28T14:42:48.904 INFO:tasks.ceph.mds.b.smithi022.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7f0da9ca8d99] 2022-04-28T14:42:48.904 INFO:tasks.ceph.mds.b.smithi022.stderr: 5: /usr/lib64/ceph/libceph-common.so.2(+0x276f62) [0x7f0da9ca8f62] 2022-04-28T14:42:48.904 INFO:tasks.ceph.mds.b.smithi022.stderr: 6: (CDir::check_rstats(bool)+0x17dd) [0x55ee625da42d] 2022-04-28T14:42:48.905 INFO:tasks.ceph.mds.b.smithi022.stderr: 7: (MDCache::predirty_journal_parents(boost::intrusive_ptr, EMetaBlob*, CInode*, CDir*, int, int, snapid_t)+0xd56) [0x55ee6248b206] 2022-04-28T14:42:48.905 INFO:tasks.ceph.mds.b.smithi022.stderr: 8: (MDCache::_create_system_file(CDir*, std::basic_string_view >, CInode*, MDSContext*)+0x8de) [0x55ee6248d2de] 2022-04-28T14:42:48.905 INFO:tasks.ceph.mds.b.smithi022.stderr: 9: (MDCache::populate_mydir()+0x806) [0x55ee624d3bb6] 2022-04-28T14:42:48.905 INFO:tasks.ceph.mds.b.smithi022.stderr: 10: (MDCache::open_root()+0xd8) [0x55ee624d3ea8] 2022-04-28T14:42:48.905 INFO:tasks.ceph.mds.b.smithi022.stderr: 11: (C_MDS_RetryOpenRoot::finish(int)+0x27) [0x55ee62538ab7] 2022-04-28T14:42:48.905 INFO:tasks.ceph.mds.b.smithi022.stderr: 12: (MDSContext::complete(int)+0x203) [0x55ee62697f93] 2022-04-28T14:42:48.906 INFO:tasks.ceph.mds.b.smithi022.stderr: 13: (MDSRank::_advance_queues()+0x84) [0x55ee62390c64] 2022-04-28T14:42:48.906 INFO:tasks.ceph.mds.b.smithi022.stderr: 14: (MDSRank::ProgressThread::entry()+0xc5) [0x55ee62391385] 2022-04-28T14:42:48.906 INFO:tasks.ceph.mds.b.smithi022.stderr: 15: /lib64/libpthread.so.0(+0x81cf) [0x7f0da8c8c1cf] 2022-04-28T14:42:48.906 INFO:tasks.ceph.mds.b.smithi022.stderr: 16: clone() 2022-04-28T14:42:48.906 INFO:tasks.ceph.mds.b.smithi022.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2022-04-28T14:42:48.906 INFO:tasks.ceph.mds.b.smithi022.stderr: 2022-04-28T14:42:49.076 INFO:tasks.ceph.mds.b.smithi022.stderr:daemon-helper: command crashed with signal 6 2022-04-28T14:57:02.593 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2022-04-28T14:57:02.618 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2022-04-28T21:00:49.697 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2022-04-28T21:00:49.731 DEBUG:teuthology.task.console_log:Killing console logger for smithi022 2022-04-28T21:00:49.772 DEBUG:teuthology.task.console_log:Killing console logger for smithi037 2022-04-28T21:00:49.773 DEBUG:teuthology.task.console_log:Killing console logger for smithi039 2022-04-28T21:00:49.774 DEBUG:teuthology.exit:Finished running handlers